Origin Data Global (ODG)
How we diagnosed a crawl-budget bottleneck across a 700,000+ URL sitemap, fixed orphaned product and manufacturer pages, cleaned up recurring on-page and schema issues, and recovered lost page speed for a global electronic components distributor.
Visit WebsiteChallenges Faced
ODG's electronic components catalog spans hundreds of thousands of product pages, and the sheer scale was working against it — a sitemap structure Google couldn't fully crawl, orphaned pages with no internal links pointing to them, recurring on-page debt, and page speed regressions from legacy code.
A 700,000+ URL Sitemap Google Couldn't Keep Up With
The site's sitemapindex.xml held more than 700,000 URLs spread across 23 sub-sitemaps, yet Google had fetched fewer than 100 of them. A second, incomplete sitemap.xml was competing alongside it, splitting crawl authority instead of consolidating it.
Orphaned Product & Manufacturer Pages
The main /products page had no internal links pointing to its own product archive pages, and manufacturerId URLs were missing the internal links that other manufacturer pages relied on — leaving large sections of the catalog invisible to Google's crawl path.
Recurring On-Page & Schema Debt
Successive Ahrefs crawls kept surfacing new issues as the catalog changed — broken 3xx redirect chains, oversized title and meta description tags, an invalid sitemap reference in robots.txt, missing pagination canonicals, and schema and Open Graph tag errors.
Page Speed Dragged Down by Legacy Code
A problematic JavaScript implementation and a desktop slider were hurting speed and causing a Cumulative Layout Shift (CLS) issue, while an unused Font Awesome library was adding unnecessary page weight.
Our Strategy
A sustained, crawl-by-crawl technical SEO program built for the scale of a 700,000+ page catalog — diagnose the crawl-budget bottleneck, fix the orphaned pages, clear the on-page backlog, and recover page speed.
-
Ran a continuous cycle of Ahrefs site audits over two months to track fixes as they were published and catch new issues as the catalog changed
-
Diagnosed why Google was only reaching a fraction of the 700,000+ URL sitemap — crawl budget was split across two competing sitemaps, limiting how deep Google could go into the sub-sitemap structure
-
Documented every finding in ongoing GSC and Ahrefs reports, tracking each issue from discovery through fix through republish
-
Identified that the main /products page had no internal links to its own product archive pages, orphaning them from Google's crawl path
-
Found that manufacturerId URLs lacked the internal links other manufacturer pages relied on, and flagged both issues for the client's dev and content teams
-
Investigated "Crawled – currently not indexed" and "Discovered – currently not indexed" statuses in GSC, tracing them back to specific deindexed product pages
-
Resolved recurring on-page issues across successive crawls: 3xx redirect chains, oversized title and meta description tags, an invalid sitemap reference in robots.txt, and missing pagination canonical tags
-
Fixed schema errors flagged in both Ahrefs and Google Search Console, and corrected Open Graph tag issues across all-tags pages
-
Flagged discontinued and obsolete product listings for removal to keep the catalog and crawl budget focused on live inventory
-
Reverted a JavaScript implementation and a desktop slider that were dragging down page speed and causing a Cumulative Layout Shift (CLS) issue
-
Removed the unused Font Awesome library to cut unnecessary page weight
-
Preserved the desktop hero banner per the client's request while removing it on mobile to protect mobile page speed
-
Ran repeated speed audits across multiple commits to confirm each fix actually moved the needle
Results That Speak
A crawl-budget bottleneck diagnosed at scale, orphaned pages identified, and a confirmed clean backlink profile.
Product URLs Diagnosed in the Sitemap
Crawl-budget bottleneck identified across 23 sub-sitemaps
Toxic Backlink Domains Found
Confirmed clean in the January 2025 Semrush audit
Competing Sitemaps Identified
Flagged for consolidation to fix crawl-budget waste
Site Audit Crawls Run
Tracking fixes across two months of ongoing changes
Before & After
Backlink toxicity audit results confirming a clean link profile.
Origin Data Global (ODG)
Origin Data Global Limited (ODG) is a broad-line independent distributor of electronic components, headquartered in Shenzhen, China, specializing in sourcing obsolete, end-of-life, and hard-to-find parts alongside commonly used materials. With a product catalog spanning hundreds of thousands of pages, ODG needed a technical SEO partner who could work at the scale its site actually operates at — not just fix individual pages, but diagnose crawl-budget and indexing issues across an entire product ecosystem.
Origin Data Global
Electronic Components Distribution — Shenzhen
Small Issues, Big Losses —
We Solve Both
A catalog with hundreds of thousands of pages needs technical SEO built for that scale, not spot fixes. Let our specialists find where your crawl budget is actually going and fix it at the structural level.
