Skip to main content
GET
/
crawl
List website datasources
curl --request GET \
  --url https://api.open.cx/crawl \
  --header 'Authorization: Bearer <token>'
{
  "total": 123,
  "page": 123,
  "limit": 123,
  "total_pages": 123,
  "has_next_page": true,
  "has_prev_page": true,
  "data": [
    {
      "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
      "url": "<string>",
      "display_name": "<string>",
      "status": "<string>",
      "page_limit": 123,
      "exclude_paths": [
        "<string>"
      ],
      "include_paths": [
        "<string>"
      ],
      "crawl_interval_hours": 123,
      "last_crawl_started_at": "2023-11-07T05:31:56Z",
      "last_crawl_completed_at": "2023-11-07T05:31:56Z",
      "error_message": "<string>",
      "created_at": "2023-11-07T05:31:56Z",
      "updated_at": "2023-11-07T05:31:56Z",
      "page_count": 123
    }
  ]
}

Documentation Index

Fetch the complete documentation index at: https://docs.open.cx/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Query Parameters

​
page
integer
default:1
Required range: 1 <= x <= 9007199254740991
​
limit
integer
default:20
Required range: 1 <= x <= 100

Response

Default Response

​
total
number
required
​
page
number
required
​
limit
number
required
​
total_pages
number
required
​
has_next_page
boolean
required
​
has_prev_page
boolean
required
​
data
object[]
required