feat: add agentcore-observability-setup skill - #65
Open
vipulg1993 wants to merge 1 commit into
Open
Conversation
Add a skill that validates and bootstraps Amazon Bedrock AgentCore observability using a verify-where-reachable / prescribe-everywhere-else model. Covers Runtime agents, Memory and Gateway resources, built-in tools, and non-runtime hosts (Lambda, ECS, EKS, on-prem, multi-cloud) with three read-only IAM tiers and graceful degradation. Register the skill in llms.txt and add a gated read-only inline policy (EnableAgentCoreObservabilitySetup) to the CloudFormation skill policies for the Tier 2/3 permissions not covered by AIDevOpsAgentAccessPolicy.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds the
agentcore-observability-setupskill: validates and bootstraps Amazon Bedrock AgentCore observability so customers can trace agent reasoning, detect silent failures, and measure performance before an outage. It operates on a single principle — verify where reachable, prescribe everywhere else:opentelemetry-instrument, framework tracing) — validated by effect (are spans arriving?) and emitted as exact steps.Covers AgentCore Runtime agents (primary), Memory and Gateway resources, built-in tools, and agents hosted outside the runtime (Lambda, ECS, EKS, on-prem, multi-cloud). Three read-only IAM tiers with graceful degradation; the skill reports the exact scoped policy needed to unlock further checks and never mutates anything.
Testing
report): overall Grade A,"passed": true. Audit 100/A (0 critical/warning), Trigger 1.00 (6/6, 100% precision both ways), Functional passed (quality gain with lower token cost).IAM / CloudFormation
Tier 1 (CloudWatch Logs/Metrics telemetry-arrival reads) is covered by
AIDevOpsAgentAccessPolicy. Tier 2/3 add read-onlybedrock-agentcore(Get/List runtime),xray:GetTraceSegmentDestination,logs:DescribeDeliveries/DeliverySources/DeliveryDestinations/ResourcePolicies, andlambda:GetFunctionConfiguration/ecs:DescribeTaskDefinition,DescribeServices,ListTasks/eks:DescribeCluster. Added as a gated inline policy (EnableAgentCoreObservabilitySetup, defaulttrue) tocloudformation/devops-agent-skill-policies.yaml, with theSkillPolicySummaryoutput updated. All permissions are read-only.Taskei
V2323594559 — accepted by the Project Nebula team (reviewer: pbraz).
Checklist
versionandauthorin metadatanamein frontmatter matches directory namedescriptionclearly states what/when to activate"passed": true(Grade A)llms.txt.skilleval.yamlpresent (canonical STR-016 ignore)mainBy submitting this pull request, I confirm that my contribution is made under the terms of the Apache License 2.0.