List scraped URLs in a knowledge base + their status

GET

https://api.smallest.ai/atoms/v1/knowledgebase/:id/scraped-urls

GET

/atoms/v1/knowledgebase/:id/scraped-urls

1 import requests
2 
3 url = "https://api.smallest.ai/atoms/v1/knowledgebase/id/scraped-urls"
4 
5 payload = {}
6 headers = {
7     "Authorization": "Bearer <token>",
8     "Content-Type": "application/json"
9 }
10 
11 response = requests.get(url, json=payload, headers=headers)
12 
13 print(response.json())

1 {
2   "status": true,
3   "data": [
4     {
5       "_id": "63b1f9a2e4b0c12d4f8a9e7c",
6       "url": "https://www.example.com/articles/ai-trends-2024",
7       "status": "scraping",
8       "createdAt": "2024-01-15T09:30:00Z",
9       "updatedAt": "2024-01-15T10:00:00Z"
10     },
11     {
12       "_id": "63b1f9a2e4b0c12d4f8a9e7d",
13       "url": "https://www.example.com/blog/knowledge-base-updates",
14       "status": "indexed",
15       "createdAt": "2024-01-14T14:20:00Z",
16       "updatedAt": "2024-01-15T08:45:00Z"
17     },
18     {
19       "_id": "63b1f9a2e4b0c12d4f8a9e7e",
20       "url": "https://www.example.com/resources/scrape-failures",
21       "status": "failed",
22       "createdAt": "2024-01-13T11:00:00Z",
23       "updatedAt": "2024-01-13T11:30:00Z"
24     }
25   ]
26 }

Returns every URL added to the knowledge base via POST /knowledgebase/{id}/scrape-urls, with its current scrape/index status. Poll this after kicking off a scrape job to track progress.

Authentication

AuthorizationBearer

API key from the console ApiKey collection, sent as Bearer token. Also accepts session cookies for browser-based auth.

Path parameters

idstringRequired

24-char hex ObjectId of the knowledge base.

Response

Successful response.

statusboolean

datalist of objects

Errors

401

Unauthorized Error

500

Internal Server Error