diff --git a/manifests/golang.yml b/manifests/golang.yml index 9334e2d4ba7..8c8531b923c 100644 --- a/manifests/golang.yml +++ b/manifests/golang.yml @@ -62,7 +62,10 @@ manifest: echo: '>=2.10.1' chi: '>=2.10.1' net-http-orchestrion: '>=2.10.1' - tests/apm_tracing_e2e/test_single_span.py::Test_SingleSpan: missing_feature + tests/apm_tracing_e2e/test_single_span.py::Test_SingleSpan: # TODO: a lower version might be supported + - weblog_declaration: + '*': missing_feature + chi: '>=2.10.1' tests/appsec/api_security/test_api_security_rc.py: - declaration: missing_feature (Fiber v2 has no HTTP AppSec integration) weblog: fiber-v2-orchestrion @@ -1952,7 +1955,7 @@ manifest: net-http-span-pool: v1.70.1 tests/otel/test_tracing_otlp.py::Test_Otel_Tracing_OTLP: v2.8.0-dev tests/otel/test_tracing_otlp.py::Test_Otlp_Carries_Ot: v2.11.0-dev - tests/otel/test_tracing_otlp.py::Test_Otlp_Forwards_Inherited_Ot: v2.11.0-dev + tests/otel/test_tracing_otlp.py::Test_Otlp_Forwards_Inherited_Ot: v2.11.0-dev # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 tests/otel_tracing_e2e/test_e2e.py::Test_OTelLogE2E: irrelevant tests/otel_tracing_e2e/test_e2e.py::Test_OTelMetricE2E: irrelevant tests/otel_tracing_e2e/test_e2e.py::Test_OTelTracingE2E: irrelevant @@ -1964,7 +1967,13 @@ manifest: tests/parametric/otel_env_vars/test_otel_exporter_otlp_logs_endpoint.py::Test_OTEL_EXPORTER_OTLP_LOGS_ENDPOINT: v2.7.0 tests/parametric/otel_env_vars/test_otel_exporter_otlp_metrics_endpoint.py::Test_OTEL_EXPORTER_OTLP_METRICS_ENDPOINT: v2.6.0 tests/parametric/otel_env_vars/test_otel_exporter_otlp_traces_endpoint.py::Test_OTEL_EXPORTER_OTLP_TRACES_ENDPOINT: v2.8.0 - tests/parametric/otel_env_vars/test_otel_logs_exporter.py::Test_OTEL_LOGS_EXPORTER: missing_feature (OTEL_LOGS_EXPORTER does not configure the logs pipeline) + tests/parametric/otel_env_vars/test_otel_logs_exporter.py::Test_OTEL_LOGS_EXPORTER: # TODO: a lower version might be supported + - declaration: missing_feature (OTEL_LOGS_EXPORTER does not configure the logs pipeline) + component_version: <2.10.1 + tests/parametric/otel_env_vars/test_otel_logs_exporter.py::Test_OTEL_LOGS_EXPORTER::test_console: missing_feature (OTEL_LOGS_EXPORTER does not configure the logs pipeline) + tests/parametric/otel_env_vars/test_otel_logs_exporter.py::Test_OTEL_LOGS_EXPORTER::test_deprecated_values: missing_feature (OTEL_LOGS_EXPORTER does not configure the logs pipeline) + tests/parametric/otel_env_vars/test_otel_logs_exporter.py::Test_OTEL_LOGS_EXPORTER::test_development_values: missing_feature (OTEL_LOGS_EXPORTER does not configure the logs pipeline) + tests/parametric/otel_env_vars/test_otel_logs_exporter.py::Test_OTEL_LOGS_EXPORTER::test_none: missing_feature (OTEL_LOGS_EXPORTER does not configure the logs pipeline) tests/parametric/otel_env_vars/test_otel_metric_export_timeout.py::Test_OTEL_METRIC_EXPORT_TIMEOUT: v2.5.0 tests/parametric/otel_env_vars/test_otel_metric_export_timeout.py::Test_OTEL_METRIC_EXPORT_TIMEOUT::test_invalid_values: bug (APMAPI-2460) tests/parametric/otel_env_vars/test_otel_metric_export_timeout.py::Test_OTEL_METRIC_EXPORT_TIMEOUT::test_spec_default: irrelevant (Datadog intentionally defaults to 7500 ms) @@ -1996,7 +2005,9 @@ manifest: tests/parametric/otel_env_vars/test_otel_traces_sampler_arg.py::Test_OTEL_TRACES_SAMPLER_ARG::test_nonnumeric_is_ignored: missing_feature (Nonnumeric sampler arguments are not ignored) tests/parametric/test_128_bit_traceids.py::Test_128_Bit_Traceids: v1.50.0 tests/parametric/test_config_consistency.py::Test_Config_Dogstatsd: v1.72.0-dev - tests/parametric/test_config_consistency.py::Test_Config_Dogstatsd::test_dogstatsd_default: incomplete_test_app (PHP parameteric app can not access the dogstatsd default values, this logic is internal to the tracer) + tests/parametric/test_config_consistency.py::Test_Config_Dogstatsd::test_dogstatsd_default: # TODO: a lower version might be supported + - declaration: incomplete_test_app (PHP parameteric app can not access the dogstatsd default values, this logic is internal to the tracer) + component_version: <2.10.1 tests/parametric/test_config_consistency.py::Test_Config_RateLimit: v1.67.0 tests/parametric/test_config_consistency.py::Test_Config_RateLimit::test_setting_trace_rate_limit_strict: bug (APMAPI-1030) tests/parametric/test_config_consistency.py::Test_Config_Tags: v1.70.1 @@ -2013,7 +2024,9 @@ manifest: tests/parametric/test_dynamic_configuration.py::TestDynamicConfigTracingEnabled: v1.61.0 tests/parametric/test_dynamic_configuration.py::TestDynamicConfigTracingEnabled::test_tracing_client_tracing_disable_one_way: irrelevant tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1: v1.59.0 - tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1::test_log_injection_enabled: missing_feature (Tracer doesn't support automatic logs injection) + tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1::test_log_injection_enabled: # TODO: a lower version might be supported + - declaration: missing_feature (Tracer doesn't support automatic logs injection) + component_version: <2.10.1 tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1_EmptyServiceTargets: v1.73.0-dev tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1_ServiceTargets: v1.59.0 tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1_ServiceTargets::test_match_service_target_case_insensitively: # Modified by easy win activation script @@ -2022,10 +2035,19 @@ manifest: tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1_ServiceTargets::test_not_match_service_target: irrelevant (APMAPI-1003) tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV2: v1.59.0 tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV2::test_capability_tracing_logs_injection: irrelevant (Tracer doesn't support automatic logs injection) - tests/parametric/test_dynamic_configuration.py::Test_DynamicConfigSdkConfiguration: missing_feature (SDK_CONFIGURATION capability not yet implemented) + tests/parametric/test_dynamic_configuration.py::Test_DynamicConfigSdkConfiguration: # TODO: a lower version might be supported + - declaration: missing_feature (SDK_CONFIGURATION capability not yet implemented) + component_version: <2.10.1 + tests/parametric/test_dynamic_configuration.py::Test_DynamicConfigSdkConfiguration::test_capability_sdk_configuration: missing_feature (SDK_CONFIGURATION capability not yet implemented) + tests/parametric/test_dynamic_configuration.py::Test_DynamicConfigSdkConfiguration::test_sdk_config_field_is_applied: missing_feature (SDK_CONFIGURATION capability not yet implemented) + tests/parametric/test_dynamic_configuration.py::Test_DynamicConfigSdkConfiguration::test_sdk_config_profiling_enabled: missing_feature (SDK_CONFIGURATION capability not yet implemented) tests/parametric/test_extract_behavior.py::Test_ExtractBehavior_Default::test_multiple_tracecontexts: incomplete_test_app (The parametric test app does not preserve the expected span link semantics) - tests/parametric/test_extract_behavior.py::Test_ExtractBehavior_Default::test_single_tracecontext: incomplete_test_app (The parametric test app does not preserve the expected span link semantics) - tests/parametric/test_extract_behavior.py::Test_ExtractBehavior_Ignore: incomplete_test_app (The parametric test app does not apply DD_TRACE_PROPAGATION_BEHAVIOR_EXTRACT=ignore) + tests/parametric/test_extract_behavior.py::Test_ExtractBehavior_Default::test_single_tracecontext: # TODO: a lower version might be supported + - declaration: incomplete_test_app (The parametric test app does not preserve the expected span link semantics) + component_version: <2.10.1 + tests/parametric/test_extract_behavior.py::Test_ExtractBehavior_Ignore: # TODO: a lower version might be supported + - declaration: incomplete_test_app (The parametric test app does not apply DD_TRACE_PROPAGATION_BEHAVIOR_EXTRACT=ignore) + component_version: <2.10.1 tests/parametric/test_extract_behavior.py::Test_ExtractBehavior_Restart: incomplete_test_app (The parametric test app does not emit restart span links or preserve baggage) tests/parametric/test_extract_behavior.py::Test_ExtractBehavior_Restart_With_Extract_First: missing_feature (DD_TRACE_PROPAGATION_EXTRACT_FIRST=true is unsupported; dd-trace-go panics when extraction fails) tests/parametric/test_ffe/test_configuration_sources.py: v2.11.0-dev # Easy win for all weblogs and version 2.10.1 @@ -2066,7 +2088,17 @@ manifest: tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_default: missing_feature # Created by easy win activation script tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_key_with_asterisk: missing_feature # Created by easy win activation script tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_specific_keys: missing_feature # Created by easy win activation script - tests/parametric/test_headers_opm.py: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py: # TODO: a lower version might be supported + - declaration: missing_feature (Org Propagation Guard RFC not yet implemented) + component_version: <2.10.1 + tests/parametric/test_headers_opm.py::Test_HeadersOPM_AgentInfo::test_tracer_consumes_info_opm: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py::Test_HeadersOPM_ExtractEnabled::test_mismatch_strips_dd_state: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py::Test_HeadersOPM_ExtractEnabled::test_mismatch_strips_dd_tracestate_member: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py::Test_HeadersOPM_ExtractEnabled::test_missing_inbound_opm_does_not_enforce: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py::Test_HeadersOPM_Injection::test_local_opm_overrides_inbound_opm: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py::Test_HeadersOPM_Injection::test_opm_injected_in_both_styles: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py::Test_HeadersOPM_Strict::test_strict_missing_inbound_enforces: missing_feature (Org Propagation Guard RFC not yet implemented) + tests/parametric/test_headers_opm.py::Test_HeadersOPM_TrustedOpms::test_untrusted_inbound_opm_is_enforced: missing_feature (Org Propagation Guard RFC not yet implemented) ? tests/parametric/test_headers_precedence.py::Test_Headers_Precedence::test_headers_precedence_propagationstyle_default_datadog_tracecontext : - declaration: missing_feature (Default value was updated in v1.62.0 (w3c phase 2)) component_version: <1.62.0 @@ -2096,7 +2128,9 @@ manifest: tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_w3c_p_inject: - declaration: missing_feature (Not implemented) component_version: <1.64.0 - tests/parametric/test_headers_tracestate_dd.py::Test_Headers_Tracestate_DD::test_headers_tracestate_dd_propagate_propagatedtags: "missing_feature (\"False Bug: header[3,6]: can't guarantee the order of strings in the tracestate since they came from the map. BUG: header[4,5]: w3cTraceID shouldn't be present\")" + tests/parametric/test_headers_tracestate_dd.py::Test_Headers_Tracestate_DD::test_headers_tracestate_dd_propagate_propagatedtags: # TODO: a lower version might be supported + - declaration: "missing_feature (\"False Bug: header[3,6]: can't guarantee the order of strings in the tracestate since they came from the map. BUG: header[4,5]: w3cTraceID shouldn't be present\")" + component_version: <2.10.1 tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_cardinality_overflow_sentinel_TS017: # Easy win for all weblogs and version 2.10.1 - declaration: "missing_feature (CSS v1.2.0 Cardinality Limits: dd-trace-go implements collapsing to the tracer_blocked_value sentinel and DD_TRACE_STATS_*_CARDINALITY_LIMIT from v2.11.0 via #5032)" component_version: '<2.11.0-dev' @@ -2109,24 +2143,28 @@ manifest: tests/parametric/test_otel_env_vars.py::Test_Otel_Env_Vars::test_otel_log_level_env: missing_feature (DD_LOG_LEVEL is not supported in go) tests/parametric/test_otel_logs.py: '>=2.5.0' # Modified by easy win activation script tests/parametric/test_otel_logs.py::Test_FR01_Enable_OTLP_Log_Collection::test_otlp_logs_enabled: v2.10.1 - tests/parametric/test_otel_logs.py::Test_FR03_Resource_Attributes: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR04_Trace_Span_IDs: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR05_Custom_Endpoints: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR06_OTLP_Protocols: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR07_Host_Name: missing_feature # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR03_Resource_Attributes: '>=2.10.1' # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR04_Trace_Span_IDs: '>=2.10.1' # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR05_Custom_Endpoints: '>=2.10.1' # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR06_OTLP_Protocols: '>=2.10.1' # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR07_Host_Name: '>=2.10.1' # Created by easy win activation script tests/parametric/test_otel_logs.py::Test_FR07_Host_Name::test_hostname_from_dd_hostname: irrelevant (DD_HOSTNAME is only supported in Python) tests/parametric/test_otel_logs.py::Test_FR08_Custom_Headers: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR09_Log_Injection: missing_feature # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR09_Log_Injection: '>=2.10.1' # Created by easy win activation script tests/parametric/test_otel_logs.py::Test_FR10_Timeout_Configuration: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR11_Telemetry: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR12_Log_Levels: missing_feature # Created by easy win activation script - tests/parametric/test_otel_logs.py::Test_FR13_Scope_Fields: missing_feature # Created by easy win activation script - tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_default_configurations: missing_feature - tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_exporter_configurations: missing_feature - tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_exporter_metrics_configurations: missing_feature - tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_metrics_grpc: missing_feature - tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_metrics_http_protobuf: missing_feature - tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_add_event_meta_serialization: missing_feature (Newer agents/testagents enabled native span event serialization by default) + tests/parametric/test_otel_logs.py::Test_FR11_Telemetry: '>=2.10.1' # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR11_Telemetry::test_telemetry_exporter_configurations: missing_feature + tests/parametric/test_otel_logs.py::Test_FR11_Telemetry::test_telemetry_exporter_logs_configurations: missing_feature + tests/parametric/test_otel_logs.py::Test_FR12_Log_Levels: '>=2.10.1' # Created by easy win activation script + tests/parametric/test_otel_logs.py::Test_FR13_Scope_Fields: '>=2.10.1' # Created by easy win activation script + tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_default_configurations: '>=2.10.1' # TODO: a lower version might be supported + tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_exporter_configurations: '>=2.10.1' # TODO: a lower version might be supported + tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_exporter_metrics_configurations: '>=2.10.1' # TODO: a lower version might be supported + tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_metrics_grpc: '>=2.10.1' # TODO: a lower version might be supported + tests/parametric/test_otel_metrics.py::Test_Otel_Metrics_Telemetry::test_telemetry_metrics_http_protobuf: '>=2.10.1' # TODO: a lower version might be supported + tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_add_event_meta_serialization: # TODO: a lower version might be supported + - declaration: missing_feature (Newer agents/testagents enabled native span event serialization by default) + component_version: <2.10.1 tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_record_exception_attributes_serialization: missing_feature (Newer agents/testagents enabled native span event serialization by default) tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_record_exception_does_not_set_error: # Modified by easy win activation script - declaration: missing_feature (Not implemented) @@ -2161,7 +2199,7 @@ manifest: ? tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_span_strict_reserved_attributes_overrides_analytics_event : "irrelevant (\"Go tracer decided to always set _dd1.sr.eausr: 1 for truthy analytics.event inputs, else 0\")" tests/parametric/test_otel_span_with_baggage.py::Test_Otel_Span_With_Baggage: missing_feature - tests/parametric/test_otel_tracestate_sampling.py::Test_OtelTracestateSampling: v2.11.0-dev + tests/parametric/test_otel_tracestate_sampling.py::Test_OtelTracestateSampling: v2.11.0-dev # Easy win for all weblogs and version 2.10.1 tests/parametric/test_otlp_trace_metrics.py: v2.11.0-dev # Easy win for all weblogs and version 2.10.1 tests/parametric/test_otlp_trace_metrics.py::Test_FR08_AdditionalTags::test_fr08_10_dd_tags_tracer_tags_resource_attributes: missing_feature (DD_TAGS is not yet reported as datadog.tracer_tags on the OTLP trace metrics resource) tests/parametric/test_otlp_trace_metrics.py::Test_FR08_AdditionalTags::test_fr08_11_otel_resource_attributes_env_tracer_tags: missing_feature (OTEL_RESOURCE_ATTRIBUTES is not yet reported as datadog.tracer_tags on the OTLP trace metrics resource) @@ -2198,7 +2236,9 @@ manifest: tests/parametric/test_span_links.py: missing_feature tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_keep_span_with_stats_computation_sss010: missing_feature (this has to be implemented by a lot of the tracers and we need to do a bit of work on the assert) tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_always_keep_span_sampling_sss011: missing_feature (The Go tracer does not have a way to modulate trace sampling once started) - tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_with_head_and_rule_trace_sampling_drop_020: bug (APMAPI-1545) + tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_with_head_and_rule_trace_sampling_drop_020: # TODO: a lower version might be supported + - declaration: bug (APMAPI-1545) + component_version: <2.10.1 tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_with_head_and_rule_trace_sampling_keep_019: # Modified by easy win activation script - declaration: bug (APMAPI-1545) component_version: <2.5.0 @@ -2228,7 +2268,9 @@ manifest: tests/parametric/test_tracer.py::Test_TracerServiceNameSource::test_tracer_manual_service_name_sets_srv_src: irrelevant (Only implemented for Java) tests/parametric/test_tracer.py::Test_TracerServiceNameSource::test_tracer_no_srv_src_when_service_not_manually_set: '>=2.7.0-dev.1' tests/parametric/test_tracer.py::Test_TracerServiceNameSource::test_tracer_srv_src_inherited_on_child_span: v2.9.0-dev - tests/parametric/test_tracer.py::Test_TracerUniversalServiceTagging::test_tracer_service_name_environment_variable: "missing_feature (FIXME: library test client sets empty string as the service name)" + tests/parametric/test_tracer.py::Test_TracerUniversalServiceTagging::test_tracer_service_name_environment_variable: # TODO: a lower version might be supported + - declaration: 'missing_feature (FIXME: library test client sets empty string as the service name)' + component_version: <2.10.1 tests/parametric/test_tracer_flare.py::TestTracerFlareV1: '>=2.5.0' # Modified by easy win activation script tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_flare_log_level_order: missing_feature # Created by easy win activation script tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_no_tracer_flare_for_other_task_types: missing_feature # Created by easy win activation script @@ -2257,12 +2299,32 @@ manifest: tests/stats/test_stats.py::Test_Stats_Service_Source: irrelevant (Only implemented for Java) tests/test_baggage.py::Test_Baggage_Headers_Api_Datadog: incomplete_test_app (/otel_drop_in_baggage_api_datadog endpoint is not implemented) tests/test_baggage.py::Test_Baggage_Headers_Api_OTel: incomplete_test_app (/otel_drop_in_baggage_api_otel endpoint is not implemented) - tests/test_baggage.py::Test_Baggage_Headers_Basic: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + tests/test_baggage.py::Test_Baggage_Headers_Basic: # TODO: a lower version might be supported + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + component_version: <2.10.1 + weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo, fiber-v2-orchestrion] + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + excluded_weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo, fiber-v2-orchestrion] tests/test_baggage.py::Test_Baggage_Headers_Malformed: v2.2.3 tests/test_baggage.py::Test_Baggage_Headers_Malformed2: v2.2.3 - tests/test_baggage.py::Test_Baggage_Headers_Max_Bytes: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) - tests/test_baggage.py::Test_Baggage_Headers_Max_Items: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) - tests/test_baggage.py::Test_Only_Baggage_Header: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + tests/test_baggage.py::Test_Baggage_Headers_Max_Bytes: # TODO: a lower version might be supported + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + component_version: <2.10.1 + weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo] + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + excluded_weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo] + tests/test_baggage.py::Test_Baggage_Headers_Max_Items: # TODO: a lower version might be supported + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + component_version: <2.10.1 + weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo, fiber-v2-orchestrion] + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + excluded_weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo, fiber-v2-orchestrion] + tests/test_baggage.py::Test_Only_Baggage_Header: # TODO: a lower version might be supported + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + component_version: <2.10.1 + weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo, fiber-v2-orchestrion] + - declaration: incomplete_test_app (/make_distant_call endpoint is not correctly implemented) + excluded_weblog: [uds-echo, net-http, gin, chi, net-http-orchestrion, echo, fiber-v2-orchestrion] tests/test_config_consistency.py::Test_Config_ClientIPHeaderEnabled_False: v1.70.1 tests/test_config_consistency.py::Test_Config_ClientIPHeader_Configured: - weblog_declaration: @@ -2316,6 +2378,8 @@ manifest: net-http: bug (APMLP-659) uds-echo: bug (APMLP-659) chi: bug (APMLP-659) + - weblog_declaration: + fiber-v2-orchestrion: bug (APMLP-659) tests/test_config_consistency.py::Test_Config_LogInjection_Default_Structured: # Modified by easy win activation script - declaration: incomplete_test_app (weblog endpoint not implemented) component_version: <2.5.0 @@ -2384,7 +2448,16 @@ manifest: - declaration: missing_feature (Implemented in v1.72.0) component_version: <1.73.0-dev tests/test_data_integrity.py::Test_TraceHeaders::test_traces_header_present: v1.38.0 (APMRP-360) - tests/test_distributed.py::Test_DistributedHttp: missing_feature + tests/test_distributed.py::Test_DistributedHttp: # TODO: a lower version might be supported + - weblog_declaration: + '*': missing_feature + uds-echo: '>=2.10.1' + net-http: '>=2.10.1' + gin: '>=2.10.1' + chi: '>=2.10.1' + net-http-orchestrion: '>=2.10.1' + echo: '>=2.10.1' + fiber-v2-orchestrion: '>=2.10.1' tests/test_distributed.py::Test_Span_Links_Flags_From_Conflicting_Contexts: missing_feature (implementation specs have not been determined) tests/test_distributed.py::Test_Span_Links_From_Conflicting_Contexts: v2.2.3 tests/test_distributed.py::Test_Span_Links_From_Conflicting_Contexts::test_span_links_from_conflicting_contexts: @@ -2406,6 +2479,11 @@ manifest: uds-echo: bug (APMAPI-901) chi: bug (APMAPI-901) net-http-orchestrion: bug (APMAPI-901) + - weblog_declaration: + haproxy: bug (APMAPI-901) + envoy: bug (APMAPI-901) + apim: bug (APMAPI-901) + fiber-v2-orchestrion: bug (APMAPI-901) tests/test_graphql.py::Test_GraphQLOperationErrorReporting: - weblog_declaration: "*": irrelevant @@ -2629,15 +2707,15 @@ manifest: uds-echo: missing_feature (DD_TRACE_OTEL_SEMANTICS_ENABLED not implemented) gin: missing_feature (DD_TRACE_OTEL_SEMANTICS_ENABLED not implemented) tests/test_otel_tracestate_sampling.py::Test_EmitOtOnProbabilityDecision_Rate0_5: v2.11.0-dev - tests/test_otel_tracestate_sampling.py::Test_ForceKeepClearsTh: + tests/test_otel_tracestate_sampling.py::Test_ForceKeepClearsTh: # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) - tests/test_otel_tracestate_sampling.py::Test_ForwardInboundOtUnchanged: + tests/test_otel_tracestate_sampling.py::Test_ForwardInboundOtUnchanged: # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) - tests/test_otel_tracestate_sampling.py::Test_ForwardInboundOtUnchangedWhenDropped: + tests/test_otel_tracestate_sampling.py::Test_ForwardInboundOtUnchangedWhenDropped: # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) @@ -2645,7 +2723,7 @@ manifest: - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) - tests/test_otel_tracestate_sampling.py::Test_PreserveDdAndOtherVendors: + tests/test_otel_tracestate_sampling.py::Test_PreserveDdAndOtherVendors: # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) @@ -2653,15 +2731,15 @@ manifest: - weblog_declaration: "*": missing_feature (APMAPI-2171) envoy, apim, haproxy: irrelevant (not applicable to proxies) - tests/test_otel_tracestate_sampling.py::Test_SampledWithoutOtNotFabricated: + tests/test_otel_tracestate_sampling.py::Test_SampledWithoutOtNotFabricated: # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) - tests/test_otel_tracestate_sampling.py::Test_ThOnlyDoesNotFabricateRv: + tests/test_otel_tracestate_sampling.py::Test_ThOnlyDoesNotFabricateRv: # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) - tests/test_otel_tracestate_sampling.py::Test_ThOnlyDoesNotFabricateRvWhenDropped: + tests/test_otel_tracestate_sampling.py::Test_ThOnlyDoesNotFabricateRvWhenDropped: # Easy win for chi, echo, fiber-v2-orchestrion, gin, net-http, net-http-orchestrion, uds-echo and version 2.10.1 - weblog_declaration: "*": v2.11.0-dev envoy, apim, haproxy: irrelevant (not applicable to proxies) @@ -2806,6 +2884,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_spans_created: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2814,6 +2894,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_spans_enqueued_for_serialization: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2822,6 +2904,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_spans_finished: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2830,6 +2914,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_trace_api_requests: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2838,6 +2924,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_trace_api_responses: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2846,6 +2934,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_trace_chunks_enqueued_for_serialization: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2854,6 +2944,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_trace_chunks_sent: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2862,6 +2954,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_trace_segments_closed: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2870,6 +2964,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_Metric_Generation_Enabled::test_metric_tracers_trace_segments_created: # Created by easy win activation script - weblog_declaration: echo: missing_feature (checks for metrics from the tracer) @@ -2878,6 +2974,8 @@ manifest: uds-echo: missing_feature (checks for metrics from the tracer) chi: missing_feature (checks for metrics from the tracer) net-http-orchestrion: missing_feature (checks for metrics from the tracer) + - weblog_declaration: + fiber-v2-orchestrion: missing_feature (checks for metrics from the tracer) tests/test_telemetry.py::Test_ProductsDisabled: v1.53 tests/test_telemetry.py::Test_ProductsDisabled::test_debugger_products_disabled: irrelevant tests/test_telemetry.py::Test_Telemetry: v1.49.0 @@ -2894,7 +2992,25 @@ manifest: '*': irrelevant net-http: '>=2.8.0' tests/test_telemetry.py::Test_Telemetry::test_telemetry_message_has_datadog_container_id: "irrelevant (cgroup in weblog is 0::/, so this test can't work)" - tests/test_telemetry.py::Test_TelemetryEnhancedConfigReporting: missing_feature + tests/test_telemetry.py::Test_TelemetryEnhancedConfigReporting: # TODO: a lower version might be supported + - weblog_declaration: + '*': missing_feature + uds-echo: '>=2.10.1' + net-http: '>=2.10.1' + gin: '>=2.10.1' + chi: '>=2.10.1' + net-http-orchestrion: '>=2.10.1' + echo: '>=2.10.1' + fiber-v2-orchestrion: '>=2.10.1' + tests/test_telemetry.py::Test_TelemetryEnhancedConfigReporting::test_telemetry_enhanced_config_reporting_precedence: + - weblog_declaration: + echo: missing_feature + chi: missing_feature + uds-echo: missing_feature + fiber-v2-orchestrion: missing_feature + net-http-orchestrion: missing_feature + net-http: missing_feature + gin: missing_feature tests/test_telemetry.py::Test_TelemetrySCAEnvVar: missing_feature tests/test_telemetry.py::Test_TelemetryV2: v1.49.1 tests/test_v1_payloads.py: # Modified by easy win activation script