How to Check Website Size Using Sitemap URL Extraction

Technical SEO / By / January 19, 2026
Website size analysis tutorial using sitemap URLs for SEO and performance

Understanding the size of a website is vital for SEO professionals, web developers, and site owners. Website size, in this context, typically refers to the number of pages or URLs indexed on the site, which provides insights into its scale, complexity, and potential crawl budget usage. By extracting URLs from an XML sitemap, you can quickly estimate this size without crawling the entire site.

This method is especially useful for technical SEO audits, competitor analysis, or planning site migrations. In this guide, we’ll explain why checking website size matters, how to do it using sitemap URL extraction, and recommend efficient tools to simplify the process.

What Does Website Size Mean and Why Check It?

Website size can encompass various metrics, such as total file storage or page load times, but here we’re focusing on the count of unique URLs or pages. This gives a snapshot of the site’s content volume.

Reasons to check website size include:

  • SEO Optimization: Large sites may exceed search engine crawl budgets, leading to unindexed pages.
  • Performance Audits: Identify bloat from duplicate or unnecessary pages.
  • Competitor Benchmarking: Compare your site’s scale to rivals for strategic insights.
  • Migration Planning: Ensure all pages are accounted for during site moves.
  • Resource Allocation: Gauge server needs or development efforts based on site magnitude.

Without this knowledge, hidden issues like overgrown content can impact rankings and user experience.

How XML Sitemaps Help in Checking Website Size

An XML sitemap is a file that lists a website’s important URLs, often with metadata like priority and last modified dates. It’s primarily for search engines but serves as a reliable source for URL extraction.

Sitemaps may be single files or indexes linking multiple sub-sitemaps, especially for large sites. Extracting and counting these URLs provides an accurate estimate of indexed pages, though it may not include every dynamic or unlisted URL.

To locate a sitemap:

  • Append “/sitemap.xml” to the domain (e.g., www.example.com/sitemap.xml).
  • Check the robots.txt file for a “Sitemap:” entry.
  • Use tools like Google Search Console if you have access.

Methods to Extract URLs and Check Website Size

Extracting URLs from a sitemap is straightforward with the right approaches. Once extracted, simply count the unique entries to determine size.

1. Manual Extraction

For small sitemaps, open the XML file in a browser or text editor and count the <loc> tags. However, this is impractical for sites with thousands of URLs.

2. Using SEO Crawler Tools like Screaming Frog

Screaming Frog is excellent for this task. Steps:

  • Enable “Crawl Linked XML Sitemaps” in Configuration > Spider > Crawl.
  • Enter the site URL or sitemap directly.
  • Crawl and export the “Sitemap” tab, which lists all URLs.
  • Use the report to count unique URLs for size estimation.

The free version handles up to 500 URLs; upgrade for larger sites.

3. Google Sheets or Spreadsheet Tools

Import the sitemap into Google Sheets using =IMPORTXML(“https://www.example.com/sitemap.xml”, “//loc”). This pulls all URLs into cells. Then, use COUNTA() to tally them.

For nested sitemaps, repeat for each sub-file.

4. Python or Scripting Methods

For automation, use Python libraries like requests and xml.etree.ElementTree to parse the sitemap and count URLs. Example code:

Python

import requests
from xml.etree import ElementTree

response = requests.get('https://www.example.com/sitemap.xml')
tree = ElementTree.fromstring(response.content)
urls = [elem.text for elem in tree.findall('.//{http://www.sitemaps.org/schemas/sitemap/0.9}loc')]
print(len(urls))  # Outputs the website size by URL count

This handles large or gzipped files efficiently.

5. Online Sitemap Extractor Tools

Online tools offer quick results without software installation. They process sitemaps, extract URLs, and often display counts directly.

A top choice is the Sitemap Extractor Tool from Cope Business. It’s free and handles complex sitemaps.

Step-by-Step Guide Using Cope Business Sitemap Extractor

  1. Go to https://www.copebusiness.com/tool/sitemap-extractor/.
  2. Input the sitemap URL or upload the XML file.
  3. Click “Extract URLs.”
  4. View the total count displayed, and download the URL list as CSV for further analysis.
  5. Use the count as your website size metric, filtering duplicates if needed.

This tool supports .xml, .gz, and nested sitemaps, making it ideal for accurate size checks.

Best Practices for Accurate Website Size Checks

  • Handle Nested Sitemaps: Ensure tools process all sub-sitemaps for complete counts.
  • Validate Sitemaps: Use Google Search Console to confirm no errors.
  • Account for Duplicates: Deduplicate URLs post-extraction for precise sizing.
  • Compare with Crawls: Cross-reference sitemap counts with full site crawls for discrepancies.
  • Monitor Over Time: Regularly check size to track growth and prune unnecessary pages.
  • Respect Limits: Sitemaps should not exceed 50,000 URLs or 50MB.

Conclusion

Checking website size via sitemap URL extraction is an efficient way to gain insights into your site’s scale and health. This approach empowers better SEO strategies and informed decision-making.

Get started effortlessly with the Cope Business Sitemap Extractor—your go-to tool for fast, reliable URL extraction and size estimation. For more SEO resources, explore our blog or reach out to the Cope Business team.

Was this article helpful?
YesNo

Related Posts