Troubleshooting

Common issues

Symptom
Likely cause
Resolution

No evaluations show up in Highflame

Hook grant not firing (wrong events value)

In Aperture, ensure your grant includes events: ["tool_call_entire_request"] and that your traffic actually includes tool calls.

No evaluations show up in Highflame

Missing required fields in fields

Ensure your grant includes user_message, tools, request_body, response_body, and raw_responses so Highflame can normalize the payload.

No evaluations show up in Highflame

In grant json hook key might not be set to highflame

Ensure that in the grant json the hook key refers to highflame hook configured in the hooks section.

Aperture hook times out

Highflame endpoint unreachable

Verify the url in your hook config is reachable from the Aperture host (TLS, firewall, DNS, load balancer settings).

Evaluations fail with tenant resolution / auth issues

Incorrect or malformed API key

Confirm the API key starts with hf_sk-... and is configured as the hook apikey. Highflame resolves the tenant from the Authorization header.

You only see prompt evaluations (no tool evaluations)

Tool-call events not captured

Ensure your grant is configured to send tool_call_entire_request and that Aperture is extracting tool calls for your selected clients/providers.

Note: Highflame normalizes each Aperture event into separate evaluations: the user prompt (process_prompt) and each tool call (call_tool). A single request with multiple tool calls can therefore produce multiple evaluations in Highflame.


Verification tip

Since POST /v1/agent/events returns accepted immediately, treat it as a delivery acknowledgment. If you don’t see results, focus on Aperture hook delivery success and grant matching, then check that the payload includes tool-call context.

Last updated