Context
Sub-issue of the Safety-coverage gap. /09 is the first of two proposed Safety-axis categories. Tests whether the Safety gate detects sensitive content in tool-call arguments and whether Audit logs the detection.
Scope
Six pass/fail scenarios in the same shape as existing categories. Each scenario:
- /09.01 — PII in args, redact mode — agent calls `send_email` with body containing SSN. Safety should redact before forwarding, Audit should log original + redacted.
- /09.02 — PII in args, block mode — same but Safety configured to block. Should deny, Audit logs the would-be-call.
- /09.03 — Credentials in args — agent calls a tool with what looks like an API key in the args. Safety should detect (entropy + format heuristics) regardless of explicit pattern match.
- /09.04 — PII in nested object — sensitive field 3 levels deep in tool_input. Safety should walk the structure.
- /09.05 — PII type label propagation — when Safety detects PII, the type label (email/SSN/etc.) should appear in the audit row, not just a generic "redacted" marker.
- /09.06 — False-positive resilience — args that look like PII but are not (e.g. a UUID that matches a phone-number regex by coincidence). Safety should not block legitimate UUIDs.
Acceptance
Notes
Keep this category focused on did the gate fire — not how accurate is the recognizer. Recognizer accuracy is AgentLeak's territory (gatewaystack-connect#78 covers the recognizer roadmap).
Context
Sub-issue of the Safety-coverage gap. /09 is the first of two proposed Safety-axis categories. Tests whether the Safety gate detects sensitive content in tool-call arguments and whether Audit logs the detection.
Scope
Six pass/fail scenarios in the same shape as existing categories. Each scenario:
Acceptance
Notes
Keep this category focused on did the gate fire — not how accurate is the recognizer. Recognizer accuracy is AgentLeak's territory (gatewaystack-connect#78 covers the recognizer roadmap).