Duplicate content is one of the most widespread technical SEO problems and one of the most misunderstood. It does not mean you have plagiarised someone else's content. It means that identical or substantially similar content is accessible at more than one URL on your own website. Google does not know which version to index or rank, splits its signals across the duplicates, and often ends up ranking neither version as well as a single, clearly canonical page would rank. The result is ranking underperformance across pages that should be performing much better.
What Is Duplicate Content?
Duplicate content exists when the same or substantially similar content is accessible at multiple URLs. The duplication can be:
Exact duplicate: Identical content at two or more URLs. Example: yourdomain.com/page/ and yourdomain.com/page (with and without trailing slash) both serving the exact same page. Or http://yourdomain.com and https://yourdomain.com both accessible, or www.yourdomain.com and yourdomain.com.
Near-duplicate: Substantially similar content with minor variations. Example: product pages for the same item in different colours where only the colour name changes but all other content is identical. Or location pages for different cities where only the city name is swapped.
Syndicated content: The same article published on multiple websites. While this is external rather than internal duplication, it creates the same signal confusion when Google cannot determine the original source.
Why Does Duplicate Content Hurt SEO?
Google's algorithms face a specific problem with duplicate content: when multiple URLs serve the same content, which one should rank? Google must make a choice. Often it chooses the "wrong" one from your perspective (an archived version, a URL with session parameters, a printer-friendly version). The page you want to rank may be de-prioritised in favour of a version you had not considered.
Duplicate content also dilutes link equity. If your article is linked to from 50 external sources but the links are split between two URL variants, each URL has half the link equity it should have. A single consolidated URL with all 50 links pointing to it would rank significantly better.
Additionally, Google's crawl budget is wasted on duplicate pages. For large sites with significant duplicate content, Googlebot may spend crawl capacity on variants that add no value, reducing the frequency with which your important, unique pages are crawled and re-evaluated.
What Are the Most Common Sources of Duplicate Content?
HTTP vs HTTPS and www vs Non-www
If your site is accessible at both http://yourdomain.com and https://yourdomain.com, and at both www.yourdomain.com and yourdomain.com, you have four potential versions of every page. Each combination is a separate URL to Google.
Fix: Redirect all HTTP traffic to HTTPS using server-level redirects (301). Redirect www to non-www (or vice versa): choose one and apply it consistently. Set your preferred domain in Google Search Console.
Trailing Slash Variations
yourdomain.com/about/ and yourdomain.com/about are two distinct URLs. If your server serves both without redirecting one to the other, you have systematic duplication across every page on your site.
Fix: Configure your server to redirect all trailing slash or non-trailing slash variants to your chosen canonical format. This is typically a one-line server configuration.
URL Parameters
E-commerce sites are particularly vulnerable to parameter-based duplication. Sorting parameters (?sort=price-asc), session IDs (?sessionid=abc123), tracking parameters (?utm_source=email), and filter combinations all create unique URLs serving the same (or nearly the same) content.
Fix: Use canonical tags to point parameter URLs back to the clean base URL. Configure Google Search Console's URL Parameters tool to tell Google which parameters change page content (and should be crawled) and which do not (and should be ignored). Consider adding noindex to parameter URLs that serve no unique content.
Faceted Navigation on E-Commerce Sites
A product category with five filter options for colour, five for size, and three for material can generate hundreds of URL combinations. Most of these show highly similar product sets and should not be independently indexed.
Fix: Apply a combination of canonical tags (pointing faceted URLs to the root category), noindex tags (for filter combinations unlikely to be searched independently), and robots.txt disallow rules (for parameters that create zero value and should be excluded from crawling entirely).
Print-Friendly and Mobile Versions
Older websites sometimes serve print-friendly or mobile-specific versions of pages at distinct URLs (/print/page/, /mobile/page/). These are exact duplicates of the desktop versions.
Fix: Redirect these URLs to the canonical desktop/mobile-responsive version. Modern responsive web design eliminates the need for separate mobile URLs entirely.
Content Syndication
If you publish content that is then republished on other websites (press releases on PR wire services, articles syndicated to aggregators), external sites may outrank your original. This is external rather than internal duplication.
Fix: Request that syndication partners include a canonical tag pointing to your original URL. Add your own canonical tag to your original article. Publish your content first, allow it to be indexed on your domain before it appears elsewhere, to establish your URL as the original.
How Do You Fix Duplicate Content?
Canonical Tags
A canonical tag (<link rel="canonical" href="preferred-url">) tells Google which version of a page is the authoritative, indexable version. All other versions with this canonical tag are treated as duplicates of the canonical page and de-prioritised in indexing.
Canonical tags should:
- Be placed in the
<head>section of every page - Self-reference on pages that are already canonical (the canonical tag on your main article page points to itself)
- Point to the correct URL including protocol (https), subdomain preference (www or non-www), and trailing slash preference
301 Redirects
For duplicate content caused by different URL variants serving the same content (HTTP/HTTPS, www/non-www, trailing slash), 301 redirects are the correct solution. They permanently redirect all traffic and signals from the duplicate URL to the canonical one, consolidating authority.
Do not use 302 (temporary) redirects for duplicate content fixes. 302 redirects do not pass full authority to the destination URL.
Content Consolidation
When near-duplicate pages exist (similar location pages, similar product pages), the option beyond technical fixes is consolidation: merging the content of multiple similar pages into one genuinely comprehensive page and redirecting the duplicates to it. This approach is most appropriate when the duplicates exist because your content strategy has not been well-planned rather than because of technical reasons.
How Do You Audit for Duplicate Content?
Screaming Frog crawls your site and identifies near-duplicate pages using a page similarity percentage. Pages above an 85% similarity threshold are flagged for review. The tool also identifies canonical tag inconsistencies and redirect chains.
Siteliner provides a quick duplicate content audit showing the most duplicated content across your site. Google Search Console's Coverage report shows pages indexed or excluded by Google and provides clues about how it is handling duplicate versions.
Duplicate content is one of the most reliable technical SEO problems to fix for a measurable ranking improvement. Dynamically includes a full duplicate content audit in every technical SEO review. Get in touch to arrange one.
