Find every XML sitemap for any website to prepare for SEO audits and data scraping.
The full URL of the website where you want to find sitemaps. Must include the protocol (http:// or https://). Example: The Agent will check robots.txt, common sitemap locations, and HTML content to discover all XML sitemaps.
When enabled, the Agent searches for ALL sitemaps on the website including nested sitemap indexes. When disabled, it returns only the primary sitemap. Enable this to get a comprehensive list of all available sitemaps.
When enabled, the Agent skips XML format validation of discovered sitemaps. Use this option if sitemaps are being rejected due to minor formatting issues. When disabled, only properly formatted XML sitemaps are returned.
Maximum time in seconds to wait for each HTTP request to complete. Increase this value for slow websites or decrease for faster execution. Valid range: 1-60 seconds.
When enabled, the Agent outputs detailed logs about the sitemap discovery process including checked URLs, response times, and found links. Useful for debugging. When disabled, only essential information is logged.
Results to deliver
6,800 creditsThis agent actively searches live listings — results may vary. You are only charged for what is delivered, up to this number.
Lagic Proxy
Pricing
Enter any website URL to automatically discover all its XML sitemaps. The tool checks robots.txt, common sitemap locations, and HTML to provide a complete list of sitemap URLs.
A sitemap is the official roadmap to a website's content, created for search engines and other automated tools. Before you can analyze a competitor's content or scrape a site for data, you need to know what pages exist. This tool automates the discovery process, saving you the manual effort of hunting for sitemap files. ### How it Works Simply provide a website URL, and the tool intelligently searches for sitemaps using multiple methods: 1. **robots.txt Check:** It first checks the `robots.txt` file, which is the standard place to declare sitemap locations. 2. **Common Locations:** It then probes for over a dozen common sitemap filenames and paths (e.g., `sitemap.xml`, `sitemap_index.xml`, `sitemap.xml.gz`). 3. **Homepage Scan:** It also inspects the website's homepage for any links pointing to a sitemap. This multi-pronged approach ensures you find all sitemaps, including those that are nested within a sitemap index file. ### Who It's For - **SEO Specialists:** Quickly gather a complete list of a client's or competitor's indexable pages for a technical audit. - **Data Analysts & Researchers:** Use the sitemap as the starting point for a large-scale web scraping project to ensure complete data coverage. - **Web Developers:** Verify that sitemaps are correctly generated and accessible after a site migration or major update.
Enter the full URL of the target website.
Enable 'Find all sitemaps' to discover nested sitemaps within a sitemap index.
Optionally, enable 'Skip verification' for websites with minor sitemap formatting errors.
Adjust the 'Request timeout' if the target website is slow to load.
Run the tool to start the discovery process.
Download the results as a JSON file containing the list of found sitemap URLs.