fix(ffe/ruby): support provider-managed configuration startup by pavlokhrebto · Pull Request #7731 · DataDog/system-tests

pavlokhrebto · 2026-09-15T12:51:37Z

Motivation

Ruby development builds now start Remote Configuration during provider activation. The existing parametric adapter aborts when it finds that worker running, preventing shared tests from starting.

Changes and Decisions

Make adapter startup compatible with both SDK-managed and manually started Remote Configuration. Configured Feature Flags initialization waits through the OpenFeature API and returns an HTTP error on failure; generic unconfigured startup stays non-blocking. The Rails adapter uses the same public initialization API.

This compatibility change can land independently. Agentless test activation remains in #7733.

linear-code · 2026-09-15T12:51:50Z

FFLSDK-10

github-actions · 2026-09-15T12:52:08Z

CODEOWNERS have been resolved as:

utils/build/docker/ruby/parametric/server.rb                            @DataDog/system-tests-reviewers
utils/build/docker/ruby/rails72/app/controllers/open_feature_controller.rb  @DataDog/system-tests-reviewers

datadog-official · 2026-09-15T12:52:55Z

✨ Unblock PR with BitsAI

❌ Errors

Your PR has failed checks. Please review the issues below and take necessary action before merging.

🚦 16 Pipeline jobs failed

Testing the test | System Tests (nodejs, prod) / parametric / parametric (1) — ❌ 1 test failed · 🔧 Needs a code fix, caused by this PR

View more details · View in GitHub Actions

❌

tests.parametric.otel_env_vars.test_otel_exporter_otlp_traces_endpoint.Test_OTEL_EXPORTER_OTLP_TRACES_ENDPOINT.test_empty_falls_back_to_global_endpoint[empty...

from system_tests_suite

AssertionError: [{&#39;body&#39;: &#39;eyJhcGlfdmVyc2lvbiI6InYyIiwibmFtaW5nX3NjaGVtYV92ZXJzaW9uIjoidjAiLCJyZXF1ZXN0X3R5cGUiOiJhcHAtc3RhcnRlZCIsInR...od&#39;: &#39;POST&#39;, &#39;url&#39;: &#39;http://ddapm-test-agent-worker-gw5-5740354900026072187:8126/telemetry/proxy/api/v2/apmtelemetry&#39;}]
assert False
 &#43;  where False = any(&lt;generator object Test_OTEL_EXPORTER_OTLP_TRACES_ENDPOINT.test_empty_falls_back_to_global_endpoint.&lt;locals&gt;.&lt;genexpr&gt; at 0x7f38001f8740&gt;)

self = &lt;tests.parametric.otel_env_vars.test_otel_exporter_otlp_traces_endpoint.Test_OTEL_EXPORTER_OTLP_TRACES_ENDPOINT object at 0x7f3801cd0320&gt;
endpoint_value = &#39;empty&#39;, expected_path = &#39;/v1/traces&#39;
test_agent = &lt;utils.docker_fixtures._test_agent.TestAgentAPI object at 0x7f3800cd6960&gt;
test_library = &lt;utils.docker_fixtures._test_clients._test_client_parametric.ParametricTestClientApi object at 0x7f3800e52ea0&gt;

    @pytest.mark.parametrize((&#34;endpoint_value&#34;, &#34;expected_path&#34;), [pytest.param(&#34;empty&#34;, DEFAULT_PATH, id=&#34;empty&#34;)])
...

Testing the test | System Tests (ruby, dev) / End-to-end #1 / rails52 1 — ❌ 15 tests failed · 🔧 Needs a code fix, caused by this PR

View more details · View in GitHub Actions

❌ tests.ai_guard.test_ai_guard_sdk.Test_AIGuardEvent_Tag.test_ai_guard_event[rails52] from system_tests_suite

assert 500 == 200
 &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
 &#43;    where HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}) = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardEvent_Tag object at 0x7f46b043cc80&gt;.r

self = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardEvent_Tag object at 0x7f46b043cc80&gt;

    def test_ai_guard_event(self):
        &#34;&#34;&#34;Test AI Guard sets ai_guard.event:true tag in the local root span of the trace.&#34;&#34;&#34;
&gt;       assert self.r.status_code == 200
E       assert 500 == 200
...

❌ tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone.test_standalone_keeps_ai_guard_trace[rails52] from system_tests_suite

assert 500 == 200
 &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
 &#43;    where HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}) = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone object at 0x7f40547ab830&gt;.r

self = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone object at 0x7f40547ab830&gt;

    def test_standalone_keeps_ai_guard_trace(self):
&gt;       assert self.r.status_code == 200
E       assert 500 == 200
E        &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
...

❌

tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone_APMDisabledMarker.test_all_spans_have_apm_disabled_marker[rails52]

from system_tests_suite

assert 500 == 200
 &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
 &#43;    where HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}) = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone_APMDisabledMarker object at 0x7f40547a90d0&gt;.r

self = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone_APMDisabledMarker object at 0x7f40547a90d0&gt;

    def test_all_spans_have_apm_disabled_marker(self) -&gt; None:
&gt;       assert self.r.status_code == 200
E       assert 500 == 200
E        &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
...

↳ and 12 more — View all

Testing the test | System Tests (ruby, dev) / End-to-end #1 / rails61 1 — ❌ 15 tests failed · 🔧 Needs a code fix, caused by this PR

View more details · View in GitHub Actions

❌ tests.ai_guard.test_ai_guard_sdk.Test_AIGuardEvent_Tag.test_ai_guard_event[rails61] from system_tests_suite

assert 500 == 200
 &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
 &#43;    where HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}) = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardEvent_Tag object at 0x7f7a00a3bfb0&gt;.r

self = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardEvent_Tag object at 0x7f7a00a3bfb0&gt;

    def test_ai_guard_event(self):
        &#34;&#34;&#34;Test AI Guard sets ai_guard.event:true tag in the local root span of the trace.&#34;&#34;&#34;
&gt;       assert self.r.status_code == 200
E       assert 500 == 200
...

❌ tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone.test_standalone_keeps_ai_guard_trace[rails61] from system_tests_suite

assert 500 == 200
 &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
 &#43;    where HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}) = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone object at 0x7effd8906270&gt;.r

self = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone object at 0x7effd8906270&gt;

    def test_standalone_keeps_ai_guard_trace(self):
&gt;       assert self.r.status_code == 200
E       assert 500 == 200
E        &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
...

❌

tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone_APMDisabledMarker.test_all_spans_have_apm_disabled_marker[rails61]

from system_tests_suite

assert 500 == 200
 &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
 &#43;    where HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}) = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone_APMDisabledMarker object at 0x7effd8907ad0&gt;.r

self = &lt;tests.ai_guard.test_ai_guard_sdk.Test_AIGuardStandalone_APMDisabledMarker object at 0x7effd8907ad0&gt;

    def test_all_spans_have_apm_disabled_marker(self) -&gt; None:
&gt;       assert self.r.status_code == 200
E       assert 500 == 200
E        &#43;  where 500 = HttpResponse(status_code:500, headers:{&#39;X-Frame-Options&#39;: &#39;SAMEORIGIN&#39;, &#39;X-XSS-Protection&#39;: &#39;1; mode=block&#39;, &#39;X-Conten...&#39;Transfer-Encoding&#39;: &#39;chunked&#39;}, text:{&#34;error&#34;:&#34;unknown keywords: :id, :tool_name, :arguments&#34;,&#34;type&#34;:&#34;ArgumentError&#34;}).status_code
...

↳ and 12 more — View all

View all 16 failed jobs.

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 8499a19 | Docs | View more details | Give us feedback!}

…patibility

Refresh the compatibility PR while retaining only its two Ruby adapter changes. Environment: Datadog workspace

chatgpt-codex-connector · 2026-09-30T16:57:26Z

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review	Status	Commit	Review trigger
📝 Code Review	✅ Completed 2026-09-30T17:06:51.777776Z	`672a545`	Draft marked ready

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

vpellan

LGTM. Would that make sense to add the open_feature_controller to Rails 8 too?

…patibility

fix(ffe/ruby): preserve compatible provider startup

04861df

pavlokhrebto changed the title ~~fix(ffe/ruby): preserve compatible provider startup~~ fix(ffe/ruby): support provider-managed configuration startup Sep 15, 2026

pavlokhrebto mentioned this pull request Sep 15, 2026

test(ffe/ruby): enable agentless configuration tests #7733

Open

Merge branch 'main' into pavlo.khrebto/FFLSDK-10/ruby-ffe-adapter-com…

672a545

…patibility

leoromanovsky added this pull request to stack #7873 September 30, 2026 15:42

Merge latest main into Ruby FFE adapter compatibility

8dccad8

Refresh the compatibility PR while retaining only its two Ruby adapter changes. Environment: Datadog workspace

leoromanovsky marked this pull request as ready for review September 30, 2026 16:57

leoromanovsky requested a review from a team as a code owner September 30, 2026 16:57

leoromanovsky requested review from nccatoni and vpellan September 30, 2026 17:03

vpellan approved these changes Oct 1, 2026

View reviewed changes

nccatoni approved these changes Oct 1, 2026

View reviewed changes

gh-worker-dd-devflow-36fce6 Bot added mergequeue-status: waiting mergequeue-status: removed and removed mergequeue-status: waiting labels Oct 1, 2026

leoromanovsky removed this pull request from stack #7873 October 1, 2026 20:15

Merge branch 'main' into pavlo.khrebto/FFLSDK-10/ruby-ffe-adapter-com…

e2ec1a4

…patibility

leoromanovsky enabled auto-merge (squash) October 1, 2026 20:15

gh-worker-dd-devflow-36fce6 Bot added mergequeue-status: waiting mergequeue-status: removed and removed mergequeue-status: removed mergequeue-status: waiting labels Oct 1, 2026

Merge branch 'main' into pavlo.khrebto/FFLSDK-10/ruby-ffe-adapter-com…

8499a19

…patibility

gh-worker-dd-devflow-36fce6 Bot added mergequeue-status: waiting and removed mergequeue-status: removed mergequeue-status: waiting labels Oct 2, 2026

gh-worker-dd-devflow-36fce6 Bot added the mergequeue-status: removed label Oct 2, 2026

Navigation Menu

fix(ffe/ruby): support provider-managed configuration startup - #7731

fix(ffe/ruby): support provider-managed configuration startup#7731
pavlokhrebto wants to merge 5 commits into
mainfrom
pavlo.khrebto/FFLSDK-10/ruby-ffe-adapter-compatibility

pavlokhrebto commented Sep 15, 2026 •

edited by leoromanovsky

Loading

Uh oh!

linear-code Bot commented Sep 15, 2026

Uh oh!

github-actions Bot commented Sep 15, 2026

Uh oh!

datadog-official Bot commented Sep 15, 2026 •

edited by datadog-datadog-prod-us1-2 Bot

Loading

Uh oh!

chatgpt-codex-connector Bot commented Sep 30, 2026 •

edited

Loading

Uh oh!

vpellan left a comment

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

pavlokhrebto commented Sep 15, 2026 • edited by leoromanovsky Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation

Changes and Decisions

Uh oh!

linear-code Bot commented Sep 15, 2026

Uh oh!

github-actions Bot commented Sep 15, 2026

Uh oh!

datadog-official Bot commented Sep 15, 2026 • edited by datadog-datadog-prod-us1-2 Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

❌ Errors

ℹ️ Info

Uh oh!

chatgpt-codex-connector Bot commented Sep 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codex Review Summary

Uh oh!

vpellan left a comment

Choose a reason for hiding this comment

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

pavlokhrebto commented Sep 15, 2026 •

edited by leoromanovsky

Loading

datadog-official Bot commented Sep 15, 2026 •

edited by datadog-datadog-prod-us1-2 Bot

Loading

chatgpt-codex-connector Bot commented Sep 30, 2026 •

edited

Loading