Add sites and files to the list below — each site can have its own settings. Add as
many of either as you like, then press Ingest to send them all as one job. Anything already
ingested is skipped — use a row’s “Update” to overwrite it.
Nothing added yet
Type
Source
Details
Add a site or files to get started.
Recent jobs
Type
Status
Dataset
Created
Finished
Detail
Actions
Loading…
Documents
Name
Type
Status
Chunks
Size
Last updated
Actions
Loading…
Crawled sites
Each row is a crawl root and the pages it produced. Refresh re-crawls the site,
overwrites changed pages and adds new ones. Refresh & prune also deletes pages the
re-crawl no longer finds (removed from the site). Both run as a background job — follow it under
“Recent jobs”. Edit changes the crawl bounds and turns on automatic re-crawl on a
schedule (the “Auto re-crawl” column) — no crawl runs when you save.