Skip to content
HIPS
  • Earn with your GPU
  • Pricing
  • Docs
Sign inJoin early access
⌘K

Get started

  1. 01Developer hub
  2. 02Quickstart
  3. 03Migrate to HIPS

Guides

  1. 04HIPS SDK
  2. 05Import and run your model
  3. 06Model and task guides
    1. ATask guides
    2. BLanguage (chat)
    3. CClassification
    4. DImage
    5. EVideo
    6. FAudio
    7. GDocument processing
  4. 07Batch jobs
  5. 08Prompt caching
  6. 09Code with HIPS
  7. 10Coding-tool setup
    1. AHIPS Code
    2. BClaude Code
    3. CCodex
    4. DOpenCode
    5. EKilo
    6. FPi
    7. GQwen Code
    8. HCrush
    9. ICline
    10. JPrime Agent
    11. KAider
    12. LGoose
    13. MHermes Agent
    14. NGrok Build
    15. ODeepSeek Harness
    16. POther coding tools and editor integrations
  8. 11Command line
    1. AInstall and update
    2. BSign in
    3. CStatus and models
    4. DCoding agents
  9. 12Console
    1. AAccount
    2. BWorkspaces
    3. CAPI keys
    4. DSettings
    5. EUsage
    6. FModels
    7. GPlayground
    8. HDeployments
  10. 13Billing
  11. 14Provider setup
    1. AWhen it works
    2. BCommands
    3. CSettings
    4. DProvider Console
    5. EEarnings
    6. FCrash reports
    7. GData centers
  12. 15Semantic routing
  13. 16Guardrails
  14. 17Knowledge

Reference

  1. 18API reference
    1. AAuthentication
    2. BChat completions
    3. CResponses
    4. DMessages
    5. ECount tokens
    6. FModels
    7. GPrices API
    8. HTasks
    9. IEmbeddings and rerank
    10. JImages
    11. KJobs
    12. LUploads
    13. MFiles
    14. NBatches
    15. OWebhooks
    16. PVector stores
    17. QDeployments
    18. RRequirements and headers
    19. SErrors
    20. TUsage
    21. UVersioning
  2. 19Operating guidance
    1. ALimits
    2. BErrors
    3. CRetries and billing outcomes
    4. DIdempotency
    5. EStreaming
    6. FData handling
    7. GCompatibility matrix
  3. 20Changelog
Sheet indexOperating guidance

Get started

  1. 01Developer hub
  2. 02Quickstart
  3. 03Migrate to HIPS

Guides

  1. 04HIPS SDK
  2. 05Import and run your model
  3. 06Model and task guides
    1. ATask guides
    2. BLanguage (chat)
    3. CClassification
    4. DImage
    5. EVideo
    6. FAudio
    7. GDocument processing
  4. 07Batch jobs
  5. 08Prompt caching
  6. 09Code with HIPS
  7. 10Coding-tool setup
    1. AHIPS Code
    2. BClaude Code
    3. CCodex
    4. DOpenCode
    5. EKilo
    6. FPi
    7. GQwen Code
    8. HCrush
    9. ICline
    10. JPrime Agent
    11. KAider
    12. LGoose
    13. MHermes Agent
    14. NGrok Build
    15. ODeepSeek Harness
    16. POther coding tools and editor integrations
  8. 11Command line
    1. AInstall and update
    2. BSign in
    3. CStatus and models
    4. DCoding agents
  9. 12Console
    1. AAccount
    2. BWorkspaces
    3. CAPI keys
    4. DSettings
    5. EUsage
    6. FModels
    7. GPlayground
    8. HDeployments
  10. 13Billing
  11. 14Provider setup
    1. AWhen it works
    2. BCommands
    3. CSettings
    4. DProvider Console
    5. EEarnings
    6. FCrash reports
    7. GData centers
  12. 15Semantic routing
  13. 16Guardrails
  14. 17Knowledge

Reference

  1. 18API reference
    1. AAuthentication
    2. BChat completions
    3. CResponses
    4. DMessages
    5. ECount tokens
    6. FModels
    7. GPrices API
    8. HTasks
    9. IEmbeddings and rerank
    10. JImages
    11. KJobs
    12. LUploads
    13. MFiles
    14. NBatches
    15. OWebhooks
    16. PVector stores
    17. QDeployments
    18. RRequirements and headers
    19. SErrors
    20. TUsage
    21. UVersioning
  2. 19Operating guidance
    1. ALimits
    2. BErrors
    3. CRetries and billing outcomes
    4. DIdempotency
    5. EStreaming
    6. FData handling
    7. GCompatibility matrix
  3. 20Changelog
19
  1. Docs/
  2. Operating guidance/
  3. Limits
(Detail A)
llms.txt

Limits

On this sheet2 sections
  1. Reading the headers
  2. What 429 means

Limits are per key and per workspace, set by plan, shown on the key in the Console and reported in the response headers. Every number is a placeholder until decided Not decided yet.

F
Fig. 1, sheet 19Operating guidance
LimitScopeValueOver the limit
Requests per minuteKey, workspaceNot decided yet by plan429 rate_limit_exceeded, param: "requests"
Tokens per minute (language models)Key, workspaceNot decided yet429 rate_limit_exceeded, param: "tokens"
Task units per minuteKey, workspaceNot counted today: a task request counts toward requests per minuteNone
Concurrent streamsKeyNot counted todayNone
Jobs in queued, assigned or runningWorkspaceNo job route is built yetNone
Request body sizeRequestNot decided yet400 request_too_large
Inline input bytes per request (task API)RequestNot decided yet and the model's hips.limits400 input_too_large (send it as an upload)
Inputs per task requestRequestThe model's hips.limits.max_inputs Not decided yet400 too_many_inputs
messages size and context_lengthRequestThe model's context_length, or the largest window any GPU serves it at now (the pool's context_window on Models)400 context_length_exceeded, the count and the limit in the message; the prompt is never truncated
max_tokensRequestThe model's max_output_tokens400 max_tokens_exceeded
stop entries (stop_sequences on Messages)Request16 (decided 2026-11-01)400 invalid_value naming the field
tools per request, json_schema sizeRequestNot decided yet400 invalid_value naming the field
prompt_cache_keyRequestDefault proposed: 512 characters Not decided yet400 invalid_value
Embedding inputs, rerank documentsRequest2,048 strings on /v1/embeddings; 1,000 documents on /v1/rerank, each and the query at most 32 KiB400 too_many_inputs; 400 input_too_long
Upload size, uploads per dayUpload, workspaceNot decided yet by plan; uploads are not offered in production yet400 upload_too_large, 429 rate_limit_exceeded param: "uploads"
Body arrivalConnectionA stalled body is closed after Not decided yet400 request_timeout
A task's idempotency-key after its request completedRequestHeld for the window Not decided yet; no answer is kept404 result_expired, naming the first request's req_ id
Embedding and rerank timeRequestThe gateway's time limit for a whole answer400 exceeds_time_limit before any work, when the measured speed shows it cannot finish
  • Limit
    Requests per minute
    Scope
    Key, workspace
    Value
    Not decided yet by plan
    Over the limit
    429 rate_limit_exceeded, param: "requests"
  • Limit
    Tokens per minute (language models)
    Scope
    Key, workspace
    Value
    Not decided yet
    Over the limit
    429 rate_limit_exceeded, param: "tokens"
  • Limit
    Task units per minute
    Scope
    Key, workspace
    Value
    Not counted today: a task request counts toward requests per minute
    Over the limit
    None
  • Limit
    Concurrent streams
    Scope
    Key
    Value
    Not counted today
    Over the limit
    None
  • Limit
    Jobs in queued, assigned or running
    Scope
    Workspace
    Value
    No job route is built yet
    Over the limit
    None
  • Limit
    Request body size
    Scope
    Request
    Value
    Not decided yet
    Over the limit
    400 request_too_large
  • Limit
    Inline input bytes per request (task API)
    Scope
    Request
    Value
    Not decided yet and the model's hips.limits
    Over the limit
    400 input_too_large (send it as an upload)
  • Limit
    Inputs per task request
    Scope
    Request
    Value
    The model's hips.limits.max_inputs Not decided yet
    Over the limit
    400 too_many_inputs
  • Limit
    messages size and context_length
    Scope
    Request
    Value
    The model's context_length, or the largest window any GPU serves it at now (the pool's context_window on Models)
    Over the limit
    400 context_length_exceeded, the count and the limit in the message; the prompt is never truncated
  • Limit
    max_tokens
    Scope
    Request
    Value
    The model's max_output_tokens
    Over the limit
    400 max_tokens_exceeded
  • Limit
    stop entries (stop_sequences on Messages)
    Scope
    Request
    Value
    16 (decided 2026-11-01)
    Over the limit
    400 invalid_value naming the field
  • Limit
    tools per request, json_schema size
    Scope
    Request
    Value
    Not decided yet
    Over the limit
    400 invalid_value naming the field
  • Limit
    prompt_cache_key
    Scope
    Request
    Value
    Default proposed: 512 characters Not decided yet
    Over the limit
    400 invalid_value
  • Limit
    Embedding inputs, rerank documents
    Scope
    Request
    Value
    2,048 strings on /v1/embeddings; 1,000 documents on /v1/rerank, each and the query at most 32 KiB
    Over the limit
    400 too_many_inputs; 400 input_too_long
  • Limit
    Upload size, uploads per day
    Scope
    Upload, workspace
    Value
    Not decided yet by plan; uploads are not offered in production yet
    Over the limit
    400 upload_too_large, 429 rate_limit_exceeded param: "uploads"
  • Limit
    Body arrival
    Scope
    Connection
    Value
    A stalled body is closed after Not decided yet
    Over the limit
    400 request_timeout
  • Limit
    A task's idempotency-key after its request completed
    Scope
    Request
    Value
    Held for the window Not decided yet; no answer is kept
    Over the limit
    404 result_expired, naming the first request's req_ id
  • Limit
    Embedding and rerank time
    Scope
    Request
    Value
    The gateway's time limit for a whole answer
    Over the limit
    400 exceeds_time_limit before any work, when the measured speed shows it cannot finish

Reading the headers

x-ratelimit-limit-requests, x-ratelimit-remaining-requests and x-ratelimit-reset-requests carry the key's request limit in the current window, what remains, and the time to reset in OpenAI's duration format; the token equivalents do the same for tokens on language-model routes, and for task units on the task API under the same header names. Clients that already read them keep working.

What 429 means

A limit is never a 5xx. rate_limit_exceeded names the dimension in param (requests, tokens, units, uploads); concurrency_limit_exceeded names streams or jobs. Both carry Retry-After in seconds: wait that long, then retry; nothing was charged on the refusal, and the retry is a new quote. Rate-limit windows and burst behavior are the gateway's and will be documented with the numbers.

Related sheets

  • Requirements and headers
  • Retries and billing outcomes
Previous sheetOverview
Next sheetErrors
Sheet
19 of 20
Detail
A
Updated
2026-11-15
Sign in to the Console

On this sheet

  1. Reading the headers
  2. What 429 means

Product

  • Inference
  • Models
  • Deploy your model
  • Always-on GPU capacity
  • How it works
  • Use cases
  • Pricing

Developer

  • Docs
  • Quickstart
  • Migrate to HIPS
  • HIPS SDK
  • Batch jobs
  • API reference

Provider

  • Earn with your GPU
  • Register GPU interest
  • Download for Mac
  • Download for Windows
  • Download for Linux

Resource

  • Security and Data
  • Resources
  • llms.txt

Compare

  • OpenRouter alternatives
  • Together AI alternatives
  • Groq alternatives
  • All comparisons

Company

  • About
  • Contact
  • Affiliate program
  • HIPS Payments

Legal

  • Legal
  • Consumer Health Data Privacy Policy
  • Report content
  • Cookie preferences

Support

  • Contact HIPS
  • Looking for payments support?

HIPS. AI inference for builders.

hips.com

Hyperscale Inference Processing Systems OÜ