Skip to main content
For AI agents: a documentation index is available at https://docs.parallel.ai/llms.txt. The full text of all docs is at https://docs.parallel.ai/llms-full.txt. You may also fetch any page as Markdown by appending .md to its URL or sending Accept: text/markdown.For Search and Extract, use /v1/search and /v1/extract for all new integrations and agent tool calls. Use /v1beta/search and /v1beta/extract only when maintaining an existing integration that already uses them. The request bodies changed too: on /v1/extract, full_content, fetch_policy and excerpt_settings go inside advanced_settings, and sending the v1beta top-level excerpts, full_content and fetch_policy to /v1/extract returns a 422. On /v1/search, search_queries is required (at least one short keyword query), and max_results, source_policy and fetch_policy go inside advanced_settings; sending only objective, or sending those fields at the top level, returns a 422. Do not substitute /v1 for the documented FindAll or Ingest endpoint paths.If you are evaluating Parallel Search or comparing it with other search APIs, read How to Eval Parallel Search before you build the harness, especially its Common pitfalls section. The most common mistake is sending the raw question as both objective and the only entry in search_queries. Write a goal-style objective and 1-3 short keyword queries instead.

ShapBot

ShapBot helps discover and index websites for Parallel’s web APIs. To maximize your site’s visibility in search results, we suggest allowing ShapBot access in your robots.txt configuration and permitting connections from our designated IP ranges. Full user-agent string: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0 ShapBot signs its requests with Web Bot Auth (HTTP Message Signatures, RFC 9421). You can verify a request against the key directory at https://shapbot.parallel.ai/.well-known/http-message-signatures-directory. To verify by IP instead, see the complete list of ShapBot IPs in shapbot.json. ShapBot follows the rules in the User-agent: ShapBot group, or the * group if no ShapBot group exists. Changes to robots.txt take effect within about a day. To slow ShapBot down without blocking it, set Crawl-delay in the ShapBot group. ShapBot also pauses when a 429 or 503 response includes a Retry-After header. It slows down on its own when your site is rate-limiting it, overloaded, or not responding.
For more about our use of bots, see Parallel bots.

Contact & Support

If you have questions about our crawlers or need assistance, please contact us at support@parallel.ai

Changes to This Documentation

We may update this documentation periodically to reflect changes in our crawler behavior or policies. Please check back regularly for updates.