https://cragdata.com 2026-06-04T21:17:48.877Z weekly 1 https://cragdata.com/docs 2026-06-04T21:17:48.877Z monthly 0.9 https://cragdata.com/blog 2026-06-04T21:17:48.877Z monthly 0.9 https://cragdata.com/llms.txt 2026-06-04T21:17:48.877Z monthly 0.88 https://cragdata.com/llm.txt 2026-06-04T21:17:48.877Z monthly 0.7 https://cragdata.com/.well-known/ai.txt 2026-06-04T21:17:48.877Z monthly 0.7 https://cragdata.com/privacy 2026-06-04T21:17:48.877Z monthly 0.7 https://cragdata.com/terms 2026-06-04T21:17:48.877Z monthly 0.7 https://cragdata.com/#products 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#fresh-data 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#architecture 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#engineering 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#how 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#why-cragdata 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#pricing 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#faq 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#contact 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#data-sample 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/#about-cragdata 2026-06-04T21:17:48.877Z weekly 0.8 https://cragdata.com/blog/technical-validation-for-ai-teams 2026-06-04T21:17:48.877Z monthly 0.75 https://cragdata.com/blog/web-scraping-vs-live-web-intelligence 2026-06-04T21:17:48.877Z monthly 0.75 https://cragdata.com/blog/crawl-orchestration-with-queues 2026-06-04T21:17:48.877Z monthly 0.75 https://cragdata.com/blog/why-ai-agents-need-live-web-crawling 2026-06-04T21:17:48.877Z monthly 0.75 https://cragdata.com/blog/static-datasets-are-dying 2026-06-04T21:17:48.877Z monthly 0.75 https://cragdata.com/blog/building-rag-with-live-web-data 2026-06-04T21:17:48.877Z monthly 0.75 https://cragdata.com/use-cases/ai-agent-data-source 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/lead-enrichment-api 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/website-monitoring 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/competitor-monitoring 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/market-intelligence 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/ecommerce-price-monitoring 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/news-monitoring 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/real-estate-data-api 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/public-records-crawling 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/use-cases/document-extraction 2026-06-04T21:17:48.877Z monthly 0.8 https://cragdata.com/compare/cragdata-vs-firecrawl 2026-06-04T21:17:48.877Z monthly 0.85 https://cragdata.com/compare/cragdata-vs-apify 2026-06-04T21:17:48.877Z monthly 0.85 https://cragdata.com/compare/cragdata-vs-brightdata 2026-06-04T21:17:48.877Z monthly 0.85 https://cragdata.com/compare/best-web-crawling-api 2026-06-04T21:17:48.877Z monthly 0.85 https://cragdata.com/compare/best-rag-data-source 2026-06-04T21:17:48.877Z monthly 0.85