SDG Intelligence — Web Import

← back to search

Crawl a URL into the Corpus

Drives self-hosted Firecrawl to crawl the given URL and all same-domain subpages it discovers. Each page is written as a markdown file to /root/sdg-documents/web-imports/<domain>/. The next indexer run (or /admin/reindex) ingests them into Qdrant and the knowledge graph.

docs.python.org tutorial SAM.gov opportunities satcomdirect.com