Skip to content
HIPS
  • Earn with your GPU
  • Pricing
  • Docs
Sign inJoin early access
⌘K

Get started

  1. 01Developer hub
  2. 02Quickstart
  3. 03Migrate to HIPS

Guides

  1. 04HIPS SDK
    1. APython
    2. BTypeScript and JavaScript
    3. CGo
    4. DRust
    5. EJava
    6. F.NET
    7. GPHP
    8. HRuby
  2. 05Import and run your model
  3. 06Model and task guides
    1. ATask guides
    2. BLanguage (chat)
    3. CClassification
    4. DImage
    5. EVideo
    6. FAudio
    7. GDocument processing
  4. 07Batch jobs
  5. 08Prompt caching
  6. 09Coding-tool setup
    1. AClaude Code
    2. BOther coding tools and editor integrations
  7. 10Command line
    1. ASign in

Reference

  1. 11API reference
    1. AAuthentication
    2. BChat completions
    3. CResponses
    4. DModels
    5. ETasks
    6. FJobs
    7. GUploads
    8. HDeployments
    9. IRequirements and headers
    10. JErrors
    11. KUsage
    12. LVersioning
  2. 12Operating guidance
    1. ALimits
    2. BErrors
    3. CRetries and billing outcomes
    4. DIdempotency
    5. EStreaming
    6. FData handling
    7. GCompatibility matrix
  3. 13Changelog
Sheet indexOperating guidance

Get started

  1. 01Developer hub
  2. 02Quickstart
  3. 03Migrate to HIPS

Guides

  1. 04HIPS SDK
    1. APython
    2. BTypeScript and JavaScript
    3. CGo
    4. DRust
    5. EJava
    6. F.NET
    7. GPHP
    8. HRuby
  2. 05Import and run your model
  3. 06Model and task guides
    1. ATask guides
    2. BLanguage (chat)
    3. CClassification
    4. DImage
    5. EVideo
    6. FAudio
    7. GDocument processing
  4. 07Batch jobs
  5. 08Prompt caching
  6. 09Coding-tool setup
    1. AClaude Code
    2. BOther coding tools and editor integrations
  7. 10Command line
    1. ASign in

Reference

  1. 11API reference
    1. AAuthentication
    2. BChat completions
    3. CResponses
    4. DModels
    5. ETasks
    6. FJobs
    7. GUploads
    8. HDeployments
    9. IRequirements and headers
    10. JErrors
    11. KUsage
    12. LVersioning
  2. 12Operating guidance
    1. ALimits
    2. BErrors
    3. CRetries and billing outcomes
    4. DIdempotency
    5. EStreaming
    6. FData handling
    7. GCompatibility matrix
  3. 13Changelog
12
  1. Docs/
  2. Operating guidance/
  3. Limits
(Detail A)

PreviewNot yet validated. Join early access

llms.txt

Limits

On this sheet2 sections
  1. Reading the headers
  2. What 429 means

Limits are per key and per workspace, set by plan, shown on the key in the Console and reported in the response headers. Every number is a placeholder until decided Not decided yet.

F
Fig. 1, sheet 12Operating guidance
LimitScopeValueOver the limit
Requests per minuteKey, workspaceNot decided yet by plan429 rate_limit_exceeded, param: "requests"
Tokens per minute (language models)Key, workspaceNot decided yet429 rate_limit_exceeded, param: "tokens"
Task units per minuteKey, workspaceNot decided yet429 rate_limit_exceeded, param: "units"
Concurrent streamsKeyNot decided yet429 concurrency_limit_exceeded, param: "streams"
Jobs in queued, assigned or runningWorkspaceNot decided yet429 concurrency_limit_exceeded, param: "jobs"
Request body sizeRequestNot decided yet400 request_too_large
Inline input bytes per request (task API)RequestNot decided yet and the model's hips.limits400 input_too_large (send it as an upload)
Inputs per task requestRequestThe model's hips.limits.max_inputs Not decided yet400 too_many_inputs
messages size and context_lengthRequestThe model's context_length400 context_length_exceeded; the prompt is never truncated
max_tokensRequestThe model's max_output_tokens400 max_tokens_exceeded
tools per request, json_schema size, stop entriesRequestNot decided yet400 invalid_value naming the field
Upload size, uploads per dayUpload, workspaceNot decided yet by plan400 upload_too_large, 429 rate_limit_exceeded param: "uploads"
Body arrivalConnectionA stalled body is closed after Not decided yet400 request_timeout
Job result retentionJobNot decided yet404 result_expired
Synchronous task timeRequestNot decided yet400 use_jobs before start; timed_out after
  • Limit
    Requests per minute
    Scope
    Key, workspace
    Value
    Not decided yet by plan
    Over the limit
    429 rate_limit_exceeded, param: "requests"
  • Limit
    Tokens per minute (language models)
    Scope
    Key, workspace
    Value
    Not decided yet
    Over the limit
    429 rate_limit_exceeded, param: "tokens"
  • Limit
    Task units per minute
    Scope
    Key, workspace
    Value
    Not decided yet
    Over the limit
    429 rate_limit_exceeded, param: "units"
  • Limit
    Concurrent streams
    Scope
    Key
    Value
    Not decided yet
    Over the limit
    429 concurrency_limit_exceeded, param: "streams"
  • Limit
    Jobs in queued, assigned or running
    Scope
    Workspace
    Value
    Not decided yet
    Over the limit
    429 concurrency_limit_exceeded, param: "jobs"
  • Limit
    Request body size
    Scope
    Request
    Value
    Not decided yet
    Over the limit
    400 request_too_large
  • Limit
    Inline input bytes per request (task API)
    Scope
    Request
    Value
    Not decided yet and the model's hips.limits
    Over the limit
    400 input_too_large (send it as an upload)
  • Limit
    Inputs per task request
    Scope
    Request
    Value
    The model's hips.limits.max_inputs Not decided yet
    Over the limit
    400 too_many_inputs
  • Limit
    messages size and context_length
    Scope
    Request
    Value
    The model's context_length
    Over the limit
    400 context_length_exceeded; the prompt is never truncated
  • Limit
    max_tokens
    Scope
    Request
    Value
    The model's max_output_tokens
    Over the limit
    400 max_tokens_exceeded
  • Limit
    tools per request, json_schema size, stop entries
    Scope
    Request
    Value
    Not decided yet
    Over the limit
    400 invalid_value naming the field
  • Limit
    Upload size, uploads per day
    Scope
    Upload, workspace
    Value
    Not decided yet by plan
    Over the limit
    400 upload_too_large, 429 rate_limit_exceeded param: "uploads"
  • Limit
    Body arrival
    Scope
    Connection
    Value
    A stalled body is closed after Not decided yet
    Over the limit
    400 request_timeout
  • Limit
    Job result retention
    Scope
    Job
    Value
    Not decided yet
    Over the limit
    404 result_expired
  • Limit
    Synchronous task time
    Scope
    Request
    Value
    Not decided yet
    Over the limit
    400 use_jobs before start; timed_out after

Reading the headers

x-ratelimit-limit-requests, x-ratelimit-remaining-requests and x-ratelimit-reset-requests carry the key's request limit in the current window, what remains, and the time to reset in OpenAI's duration format; the token equivalents do the same for tokens on language-model routes, and for task units on the task API under the same header names. Clients that already read them keep working.

What 429 means

A limit is never a 5xx. rate_limit_exceeded names the dimension in param (requests, tokens, units, uploads); concurrency_limit_exceeded names streams or jobs. Both carry Retry-After in seconds: wait that long, then retry; nothing was charged on the refusal, and the retry is a new quote. Rate-limit windows and burst behavior are the gateway's and will be documented with the numbers.

Related sheets

  • Requirements and headers
  • Retries and billing outcomes
Previous sheetOverview
Next sheetErrors
Sheet
12 of 13
Detail
A
Updated
2026-10-21
Status
Preview
Join early access

On this sheet

  1. Reading the headers
  2. What 429 means

Product

  • Inference
  • Models
  • Deploy your model
  • Always-on GPU capacity
  • How it works
  • Use cases
  • Pricing

Developer

  • Docs
  • Quickstart preview
  • Migrate to HIPS
  • HIPS SDK
  • Batch jobs
  • API reference

Provider

  • Earn with your GPU
  • Register GPU interest
  • Download for Mac
  • Download for Windows
  • Download for Linux

Resource

  • Security and Data
  • Resources
  • llms.txt

Company

  • About
  • Contact
  • Affiliate program
  • HIPS Payments

Legal

  • Legal
  • Consumer Health Data Privacy Policy
  • Report content
  • Cookie settings

Support

  • Contact HIPS
  • Looking for payments support?

HIPS. AI inference for builders.

hips.com

Hyperscale Inference Processing Systems OÜ