Skip to content
HIPS
  • Earn with your GPU
  • Pricing
  • Docs
Sign inJoin early access
⌘K

Get started

  1. 01Developer hub
  2. 02Quickstart
  3. 03Migrate to HIPS

Guides

  1. 04HIPS SDK
  2. 05Import and run your model
  3. 06Model and task guides
    1. ATask guides
    2. BLanguage (chat)
    3. CClassification
    4. DImage
    5. EVideo
    6. FAudio
    7. GDocument processing
  4. 07Batch jobs
  5. 08Prompt caching
  6. 09Coding-tool setup
    1. AClaude Code
    2. BOther coding tools and editor integrations
  7. 10Command line
    1. ASign in
  8. 11Console
    1. AAccount
    2. BWorkspaces
    3. CAPI keys
    4. DSettings
    5. EUsage
    6. FModels
    7. GPlayground
    8. HDeployments
  9. 12Billing
  10. 13Provider setup
    1. AWhen it works
    2. BCommands
    3. CSettings
    4. DProvider Console
    5. EEarnings
    6. FCrash reports
    7. GData centers
  11. 14Router
  12. 15Guardrails
  13. 16Knowledge

Reference

  1. 17API reference
    1. AAuthentication
    2. BChat completions
    3. CResponses
    4. DMessages
    5. ECount tokens
    6. FModels
    7. GTasks
    8. HEmbeddings and rerank
    9. IJobs
    10. JUploads
    11. KFiles
    12. LBatches
    13. MWebhooks
    14. NVector stores
    15. ODeployments
    16. PRequirements and headers
    17. QErrors
    18. RUsage
    19. SVersioning
  2. 18Operating guidance
    1. ALimits
    2. BErrors
    3. CRetries and billing outcomes
    4. DIdempotency
    5. EStreaming
    6. FData handling
    7. GCompatibility matrix
  3. 19Changelog
Sheet indexKnowledge

Get started

  1. 01Developer hub
  2. 02Quickstart
  3. 03Migrate to HIPS

Guides

  1. 04HIPS SDK
  2. 05Import and run your model
  3. 06Model and task guides
    1. ATask guides
    2. BLanguage (chat)
    3. CClassification
    4. DImage
    5. EVideo
    6. FAudio
    7. GDocument processing
  4. 07Batch jobs
  5. 08Prompt caching
  6. 09Coding-tool setup
    1. AClaude Code
    2. BOther coding tools and editor integrations
  7. 10Command line
    1. ASign in
  8. 11Console
    1. AAccount
    2. BWorkspaces
    3. CAPI keys
    4. DSettings
    5. EUsage
    6. FModels
    7. GPlayground
    8. HDeployments
  9. 12Billing
  10. 13Provider setup
    1. AWhen it works
    2. BCommands
    3. CSettings
    4. DProvider Console
    5. EEarnings
    6. FCrash reports
    7. GData centers
  11. 14Router
  12. 15Guardrails
  13. 16Knowledge

Reference

  1. 17API reference
    1. AAuthentication
    2. BChat completions
    3. CResponses
    4. DMessages
    5. ECount tokens
    6. FModels
    7. GTasks
    8. HEmbeddings and rerank
    9. IJobs
    10. JUploads
    11. KFiles
    12. LBatches
    13. MWebhooks
    14. NVector stores
    15. ODeployments
    16. PRequirements and headers
    17. QErrors
    18. RUsage
    19. SVersioning
  2. 18Operating guidance
    1. ALimits
    2. BErrors
    3. CRetries and billing outcomes
    4. DIdempotency
    5. EStreaming
    6. FData handling
    7. GCompatibility matrix
  3. 19Changelog
16
  1. Docs/
  2. Knowledge
llms.txt

Knowledge

On this sheet10 sections
  1. A knowledge base
  2. Adding documents
  3. Searching from a model
  4. Searching from your code
  5. Citations
  6. Who reads your documents
  7. Limits
  8. Deletion and export
  9. Billing
  10. In the Console

Knowledge lets a model search your own documents. You make a knowledge base, add documents to it, and name it in a request: the model calls the hosted search tool when it needs to, HIPS searches the base and hands the model numbered passages with their sources, and the answer records which passages the model was given. It works with every model whose tool calls are validated, and it follows OpenAI's vector store API and its file_search tool, so the OpenAI SDKs call it with the HIPS key and base URL.

Note

Knowledge is built and not switched on in production yet. Until it is, every /v1/vector_stores path answers 404 route_not_found, a Messages or Responses request naming hips:knowledge_search or file_search answers 400 unsupported_value at tools ("not served on this platform yet"), chat completions refuse the tool entry as a field they do not know, and the Console's Knowledge screens are hidden.

Fig. 1, sheet 16Knowledge

A knowledge base

  • A base is a vector_store whose id is its kb_ id. It belongs to one workspace and is never shared with another.
  • It has one embedding model, chosen at creation and fixed for its life, and its own requirements: a pool (Auto by default, or certified) and a region (eu alone at first; another is refused with 400 region_unavailable until a regional store exists).
  • Its requirements bind its ingestion and every request that searches it: a request whose own requirements cannot meet the base's is a 400 requirement_conflict naming both, never placed where the base does not allow.

Adding documents

Upload a file with POST /v1/files and purpose: "user_data" (assistants is taken as its alias), then add it to the base. Each document is read in isolation, normalized, cut into chunks along its structure and embedded on GPUs, with a stage you can watch.

Formats

FormatRead
Plain text, MarkdownAs it is
HTMLIts main content, as Markdown
PDF with a text layerThe text layer, page by page, so a passage knows its pages
.docx, .pptx, .xlsxHeadings, paragraphs, lists and tables; slides in order with their notes; each sheet a table
CSV, JSONA table, and indented text
Scanned PDFs, imagesNot yet: they need a recognition model served on GPUs, and fail with empty_text until then
  • Format
    Plain text, Markdown
    Read
    As it is
  • Format
    HTML
    Read
    Its main content, as Markdown
  • Format
    PDF with a text layer
    Read
    The text layer, page by page, so a passage knows its pages
  • Format
    .docx, .pptx, .xlsx
    Read
    Headings, paragraphs, lists and tables; slides in order with their notes; each sheet a table
  • Format
    CSV, JSON
    Read
    A table, and indented text
  • Format
    Scanned PDFs, images
    Read
    Not yet: they need a recognition model served on GPUs, and fail with empty_text until then

Stages

Stage (`hips.stage`)`status`What happens
queuedin_progressWaiting for a slot, oldest first
extractingin_progressThe file's text is read and normalized
chunkingin_progressCut along its structure
embeddingin_progressEmbedded; hips.progress counts the chunks. A model HIPS cannot reach keeps it here with hips.delayed: true, never failed for HIPS's outage
completedcompletedSearchable
failedfailedlast_error with its code and sentence
cancelledcancelledA file batch canceled before the document was read
  • Stage (`hips.stage`)
    queued
    `status`
    in_progress
    What happens
    Waiting for a slot, oldest first
  • Stage (`hips.stage`)
    extracting
    `status`
    in_progress
    What happens
    The file's text is read and normalized
  • Stage (`hips.stage`)
    chunking
    `status`
    in_progress
    What happens
    Cut along its structure
  • Stage (`hips.stage`)
    embedding
    `status`
    in_progress
    What happens
    Embedded; hips.progress counts the chunks. A model HIPS cannot reach keeps it here with hips.delayed: true, never failed for HIPS's outage
  • Stage (`hips.stage`)
    completed
    `status`
    completed
    What happens
    Searchable
  • Stage (`hips.stage`)
    failed
    `status`
    failed
    What happens
    last_error with its code and sentence
  • Stage (`hips.stage`)
    cancelled
    `status`
    cancelled
    What happens
    A file batch canceled before the document was read

Failures

CodeWhenWhat to do
unsupported_fileNot a format aboveSend another format
file_unreadableProtected, encrypted or brokenSend a readable copy
empty_textNo text read (a scan, an image)Send a file with a text layer
too_large, too_many_pagesOver the bounds per file Not decided yetSplit it
limit_reachedThe workspace's chunk limit Not decided yetRetry once there is room
embedding_failedThe embedding model refused its inputRetry
  • Code
    unsupported_file
    When
    Not a format above
    What to do
    Send another format
  • Code
    file_unreadable
    When
    Protected, encrypted or broken
    What to do
    Send a readable copy
  • Code
    empty_text
    When
    No text read (a scan, an image)
    What to do
    Send a file with a text layer
  • Code
    too_large, too_many_pages
    When
    Over the bounds per file Not decided yet
    What to do
    Split it
  • Code
    limit_reached
    When
    The workspace's chunk limit Not decided yet
    What to do
    Retry once there is room
  • Code
    embedding_failed
    When
    The embedding model refused its input
    What to do
    Retry

A failed document stays listed with its reason until it is deleted, and counts toward no total, limit or storage.

Searching from a model

Name the hosted tool and the base in tools; the model decides when to search and writes the query. One base a search for now.

RouteThe tool entryWhat the answer records
POST /v1/chat/completions{"type": "hips:knowledge_search", "parameters": {"knowledge_base_ids": ["kb_..."], "max_num_results": 5}}The calls in a top-level hips.tool_calls of the answer, each with its results; message.tool_calls holds only your own functions' calls
POST /v1/messages{"type": "hips:knowledge_search", "name": "knowledge_search", "knowledge_base_ids": ["kb_..."]}A server_tool_use block and its hips_tool_result block, one Anthropic search_result block per passage
POST /v1/responses{"type": "file_search", "vector_store_ids": ["kb_..."]}A file_search_call item with its queries, and its results when include holds file_search_call.results; file_citation annotations where the model cites a passage
  • Route
    POST /v1/chat/completions
    The tool entry
    {"type": "hips:knowledge_search", "parameters": {"knowledge_base_ids": ["kb_..."], "max_num_results": 5}}
    What the answer records
    The calls in a top-level hips.tool_calls of the answer, each with its results; message.tool_calls holds only your own functions' calls
  • Route
    POST /v1/messages
    The tool entry
    {"type": "hips:knowledge_search", "name": "knowledge_search", "knowledge_base_ids": ["kb_..."]}
    What the answer records
    A server_tool_use block and its hips_tool_result block, one Anthropic search_result block per passage
  • Route
    POST /v1/responses
    The tool entry
    {"type": "file_search", "vector_store_ids": ["kb_..."]}
    What the answer records
    A file_search_call item with its queries, and its results when include holds file_search_call.results; file_citation annotations where the model cites a passage
  • The model must have validated tool calls in the pool the request resolves to (hips.tool_calls on Models); otherwise a 400 unsupported_parameter.
  • The tool is offered once its price per call is published: until then a 400 tool_not_available, and nothing is charged.
  • usage.server_tool_use.knowledge_search_requests counts the searches that ran; the token counts are every pass's, summed.
  • On Messages and Responses, stream: true with the tool is a 400 unsupported_value for now: it is served on whole answers. On chat completions a streamed request is answered once the search loop is done.
  • A base that is not the workspace's, or is being deleted, is a 404 knowledge_base_not_found before the model runs.

Searching from your code

POST /v1/vector_stores/{id}/search runs the same search without a model and answers OpenAI's search results page (Vector stores).

Citations

The record in the answer is the citation that always holds: which passages the model was given, from which document and where (file, heading path, byte offsets, pages). Where the model wrote a marker [n] naming a passage of the request, the Responses route adds a file_citation annotation at the marker and leaves the text as the model wrote it. Whether a model writes markers is the model's: the record is the guarantee, the annotations best effort.

Who reads your documents

Base poolWho reads the documents
AutoAt ingestion, every chunk is an embedding input on a GPU of whichever pool serves it, a provider's device included; at a search, the passages reach the device or server that serves the request's next pass, under its sandbox and data handling, as any prompt does
CertifiedOnly the Certified pool's GPUs read the chunks and the passages
  • Base pool
    Auto
    Who reads the documents
    At ingestion, every chunk is an embedding input on a GPU of whichever pool serves it, a provider's device included; at a search, the passages reach the device or server that serves the request's next pass, under its sandbox and data handling, as any prompt does
  • Base pool
    Certified
    Who reads the documents
    Only the Certified pool's GPUs read the chunks and the passages

The store, the chunks and the search run on the platform in the European Union (Ireland); a search from another region is one round trip there. The passages are data for the model, never instructions.

Limits

LimitValue
Knowledge bases a workspace, documents a base, a file's size and pages, chunks a workspaceNot decided yet
Documents a workspace keeps as user_data filesNot decided yet; past it, 400 limit_reached
Ingestion at once and per hourNot decided yet; past it, 429 rate_limit_exceeded with param: "knowledge_ingest"
SearchesCounted as requests of your limits; 429 with param: "knowledge_search"
Bases a search, results, passages from one documentOne base for now; the rest Not decided yet
  • Limit
    Knowledge bases a workspace, documents a base, a file's size and pages, chunks a workspace
    Value
    Not decided yet
  • Limit
    Documents a workspace keeps as user_data files
    Value
    Not decided yet; past it, 400 limit_reached
  • Limit
    Ingestion at once and per hour
    Value
    Not decided yet; past it, 429 rate_limit_exceeded with param: "knowledge_ingest"
  • Limit
    Searches
    Value
    Counted as requests of your limits; 429 with param: "knowledge_search"
  • Limit
    Bases a search, results, passages from one document
    Value
    One base for now; the rest Not decided yet

Deletion and export

  • Removing a document from a base removes its text, chunks and vectors at once; the File stays until you delete it.
  • Deleting a base marks it so nothing reads it, then purges it.
  • A base set to expire with expires_after is purged after that many days unused; HIPS sets no expiry of its own.
  • Reads, exports and deletes answer whatever the workspace's state, so you can always take your documents out: GET /v1/vector_stores/{id}/files/{file_id}/content gives a document's text.

Billing

WhatHow it is billed
IngestionThe embedding compute it uses, per started second at the base's embedding model's own rate (H109), on your usage as knowledge_ingest
StorageA base's stored bytes, and a document's File while kept, at the storage price of $0.10 per GB-month (decided 2026-11-07)
A searchPer call, at a price not published yet Not decided yet, the query's embedding included; a rerank on top per started second
A failed call, an outageNot charged
  • What
    Ingestion
    How it is billed
    The embedding compute it uses, per started second at the base's embedding model's own rate (H109), on your usage as knowledge_ingest
  • What
    Storage
    How it is billed
    A base's stored bytes, and a document's File while kept, at the storage price of $0.10 per GB-month (decided 2026-11-07)
  • What
    A search
    How it is billed
    Per call, at a price not published yet Not decided yet, the query's embedding included; a rerank on top per started second
  • What
    A failed call, an outage
    How it is billed
    Not charged

In the Console

Knowledge in the side menu, once it is switched on: the bases, a base with its documents and their stages, uploads, a search to try, and the storage and its cost. The screens are built and hidden while the platform does not serve Knowledge.

Related sheets

  • Vector stores reference
  • Data handling
Previous sheetGuardrails
Next sheetOverview
Sheet
16 of 19
Updated
2026-11-11
Sign in to the Console

On this sheet

  1. A knowledge base
  2. Adding documents
  3. Searching from a model
  4. Searching from your code
  5. Citations
  6. Who reads your documents
  7. Limits
  8. Deletion and export
  9. Billing
  10. In the Console

Product

  • Inference
  • Models
  • Deploy your model
  • Always-on GPU capacity
  • How it works
  • Use cases
  • Pricing

Developer

  • Docs
  • Quickstart
  • Migrate to HIPS
  • HIPS SDK
  • Batch jobs
  • API reference

Provider

  • Earn with your GPU
  • Register GPU interest
  • Download for Mac
  • Download for Windows
  • Download for Linux

Resource

  • Security and Data
  • Resources
  • llms.txt

Compare

  • OpenRouter alternatives
  • Together AI alternatives
  • Groq alternatives
  • All comparisons

Company

  • About
  • Contact
  • Affiliate program
  • HIPS Payments

Legal

  • Legal
  • Consumer Health Data Privacy Policy
  • Report content
  • Cookie preferences

Support

  • Contact HIPS
  • Looking for payments support?

HIPS. AI inference for builders.

hips.com

Hyperscale Inference Processing Systems OÜ