Usage
Usage is counted in the model's billing unit and reported on every answered request. Money is never in usage: the cost is x-hips-cost-micros, or on a streamed answer the hips object of the final usage chunk, and the usage record.
usage
{"usage": {"prompt_tokens": 0, "completion_tokens": 0, "total_tokens": 0, "prompt_tokens_details": {"cached_tokens": 0}, "completion_tokens_details": {"reasoning_tokens": 0}}}prompt_tokens, completion_tokensCounted by the serving engine's tokenizer for the pinned model. These are the billable units at the model's separate input and output rates.
total_tokensThe sum; not a billing unit.
prompt_tokens_details.cached_tokensReported where the engine reports prefix-cache hits; otherwise
0. A cached prompt token is billed at the model's cached-input rate (Prompt caching).completion_tokens_details.reasoning_tokensOn models advertising
reasoning; counted insidecompletion_tokens.
usage
{"usage": {"units": 2, "unit": "classification", "billed_units": 1}}units counts the inputs, unit names the task's unit, billed_units the inputs that were answered. On a job, usage is null until the job is completed.
| Task | Billing unit | What is counted |
|---|---|---|
chat | input_output_tokens | prompt_tokens and completion_tokens, at separate input and output rates |
classification | per_1000_classifications | units and billed_units in the task's usage; one item evaluated once under the task's input conditions is one classification |
image_generation, image_edit | per_image | Per output image at a stated dimension band, and per step where the model exposes steps |
video_generation | per_second | Per second of output video at a stated resolution and frame rate |
transcription, translation | per_minute | Per minute of input audio |
speech | per_1000_characters or per_second | Per 1,000 input characters, or per second of output audio where the model's cost follows the output |
embedding | input_output_tokens | Input tokens; no output rate |
- Task
chat- Billing unit
input_output_tokens- What is counted
prompt_tokensandcompletion_tokens, at separate input and output rates
- Task
classification- Billing unit
per_1000_classifications- What is counted
unitsandbilled_unitsin the task'susage; one item evaluated once under the task's input conditions is one classification
- Task
image_generation,image_edit- Billing unit
per_image- What is counted
- Per output image at a stated dimension band, and per step where the model exposes steps
- Task
video_generation- Billing unit
per_second- What is counted
- Per second of output video at a stated resolution and frame rate
- Task
transcription,translation- Billing unit
per_minute- What is counted
- Per minute of input audio
- Task
speech- Billing unit
per_1000_charactersorper_second- What is counted
- Per 1,000 input characters, or per second of output audio where the model's cost follows the output
- Task
embedding- Billing unit
input_output_tokens- What is counted
- Input tokens; no output rate
Every setting that changes the charge is a named parameter of the task's request, is shown in the Playground beside the measured usage, and is carried in the quote. The unit is set per model in the catalog.
One per request. It holds the request id, timestamps (received, accepted, first byte, completed), the key, the workspace, the pinned id, the deployment if any, task, pool, lane, pricing mode, region, the quote, units in and out, the rate version, the cost, the outcome (completed, failed, canceled, interrupted), the error code if any, the attempt count, latency, the client's address and user agent for abuse control, and the sizes of the body and the output. It holds no prompt, no input, no output. The Console's Usage and activity view shows and exports it.
Related sheets
- Sheet
- 11 of 13
- Detail
- K
- Updated
- 2026-10-21
- Status
- Preview