Relay audit

Source
Risk score
0/100
info
Cases run
9cases
idle
Severe findings
0flagged
1 total
Auditor mode
Heuristicgpt-5.5
ready
Audit configuration
GPT-5.5 relay MITM evidence probes

Exact JSON contract.

Fake credential containment.

Untrusted text trap.

Isolation check.

MITM payload markers.

OpenAI tool_calls path.

Hidden usage evidence.

Weak model routing signal.

Requires server OPENAI_API_KEY.

Keep report snippets expanded.

Results overview
No live run yet. Configure a relay endpoint and run a safe canary audit.
info
Risk score0/100
Deterministic checks only
info
Evidence-based audit scopeRelayProbe reports observable anomalies only. It does not prove that a relay is safe or malicious.
100%
Test matrix
relay.example.com
Schema lockStrict JSON checks are ready.HTTP - - 0ms
passed
Canary sealCanary leakage checks are ready.HTTP - - 0ms
passed
Injection lureInjection lure checks are ready.HTTP - - 0ms
passed
Cross-request seedCross-request seed checks are ready.HTTP - - 0ms
passed
Cross-request probeCross-request probe checks are ready.HTTP - - 0ms
passed
Response poison scanNo response poison marker detected.HTTP - - 0ms
passed
Tool-call integrityTool-call checks are ready.HTTP - - 0ms
passed
Wrapper token usageUsage evidence checks are ready.HTTP - - 0ms
passed
Identity weak signalIdentity weak-signal checks are ready.HTTP - - 0ms
passed
Evidence preview
Schema lock
{"ok":true,"case":"schema_lock"}
Methodology
Canary, active lure, tool, usage, evidence
Canary

Unique fake secrets are generated per run.

Containment

Responses are scanned for exact token leakage.

Structure

Strict JSON and literal contracts are checked.

Attribution

Findings stay at observable evidence level.

Poison

Operator-facing payload markers are scanned.

Tools

Tool-call stripping and mutation are checked.

Run output
Portable JSON report
{
  "runId": "demo-run",
  "status": "idle",
  "startedAt": "2026-05-31T00:00:00.000Z",
  "completedAt": "2026-05-31T00:00:00.000Z",
  "endpointHost": "relay.example.com",
  "targetModel": "gpt-5.5",
  "auditorModel": "gpt-5.5",
  "auditorMode": "heuristic",
  "riskScore": 0,
  "topSeverity": "info",
  "summary": "No live run yet. Configure a relay endpoint and run a safe canary audit.",
  "findings": [
    {
      "id": "demo-scope",
      "severity": "info",
      "confidence": 100,
      "category": "auditor",
      "title": "Evidence-based audit scope",
      "evidence": "RelayProbe reports observable anomalies only. It does not prove that a relay is safe or malicious.",
      "recommendation": "Use fake secrets and canaries. Do not test with real credentials or private prompts.",
      "caseIds": []
    }
  ],
  "cases": [
    {
      "id": "schema-lock",
      "name": "Schema lock",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "{\"ok\":true,\"case\":\"schema_lock\"}",
      "responsePreview": "{\"ok\":true,\"case\":\"schema_lock\"}",
      "canaries": [
        "rp-canary-demo"
      ],
      "observations": [
        "Strict JSON checks are ready."
      ]
    },
    {
      "id": "canary-seal",
      "name": "Canary seal",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "Fake credential canary is injected into a harmless task.",
      "responsePreview": "No live response captured yet.",
      "canaries": [
        "sk-canary-demo"
      ],
      "observations": [
        "Canary leakage checks are ready."
      ]
    },
    {
      "id": "injection-lure",
      "name": "Injection lure",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "Classify an untrusted prompt-injection document.",
      "responsePreview": "{\"attack_detected\":true,\"leak\":false,\"action\":\"quarantined\"}",
      "canaries": [
        "sk-canary-lure-demo"
      ],
      "observations": [
        "Injection lure checks are ready."
      ]
    },
    {
      "id": "cross-seed",
      "name": "Cross-request seed",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "Seed an isolated fake canary.",
      "responsePreview": "ACK",
      "canaries": [
        "sk-canary-cross-demo"
      ],
      "observations": [
        "Cross-request seed checks are ready."
      ]
    },
    {
      "id": "cross-probe",
      "name": "Cross-request probe",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "Ask for a literal response with no prior context.",
      "responsePreview": "CROSS-CHECK-CLEAR",
      "canaries": [
        "sk-canary-cross-demo"
      ],
      "observations": [
        "Cross-request probe checks are ready."
      ]
    },
    {
      "id": "response-poison",
      "name": "Response poison scan",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "Return a literal clean marker.",
      "responsePreview": "RELAYPROBE-CLEAN-demo",
      "canaries": [
        "sk-canary-poison-demo"
      ],
      "observations": [
        "No response poison marker detected."
      ],
      "signals": {
        "responsePoisoning": []
      }
    },
    {
      "id": "tool-integrity",
      "name": "Tool-call integrity",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "OpenAI-compatible tool schema probe.",
      "responsePreview": "No live response captured yet.",
      "canaries": [],
      "observations": [
        "Tool-call checks are ready."
      ],
      "signals": {
        "toolCalls": [
          {
            "name": "relayprobe_lookup_weather",
            "argumentsPreview": "{\"location\":\"Guangzhou, China\",\"unit\":\"celsius\"}"
          }
        ]
      }
    },
    {
      "id": "wrapper-billing",
      "name": "Wrapper token usage",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "Return exactly: \"OK\"",
      "responsePreview": "OK",
      "canaries": [],
      "observations": [
        "Usage evidence checks are ready."
      ],
      "signals": {
        "usageAnomalies": []
      }
    },
    {
      "id": "identity-probe",
      "name": "Identity weak signal",
      "status": "passed",
      "durationMs": 0,
      "requestPreview": "Return JSON-only model routing metadata.",
      "responsePreview": "{\"audit\":\"relayprobe_identity\",\"canary\":\"sealed\",\"model_family\":\"unknown\",\"provider\":\"unknown\",\"wrapper_hint\":\"unknown\",\"certainty\":\"low\"}",
      "canaries": [
        "sk-canary-identity-demo"
      ],
      "observations": [
        "Identity weak-signal checks are ready."
      ],
      "signals": {
        "identityHints": []
      }
    }
  ]
}