Short answer: To avoid duplicate content, give every piece of content one preferred URL and make every signal agree with it: 301 redirect old or alternate versions, add a self-referencing rel=”canonical” on the preferred page, link internally only to that URL, list only canonical URLs in your sitemap, and write original copy instead of reusing manufacturer or boilerplate text. Duplicate content is not a penalty, but it splits signals and wastes crawling.
This guide is for site owners, developers and content teams who have seen “Duplicate, Google chose different canonical than user” in Search Console, or who suspect their product, category or location pages are competing with each other. By the end you will know what counts as duplicate content, how to find it on your own site, which fix to use for each cause, and how to check the fix worked.
What duplicate content actually is
Duplicate content is a substantial block of content that is the same, or nearly the same, at more than one URL. It can sit on your own domain (internal duplication) or on other domains (external duplication). Most of it is not written twice. It is created by the way a site serves the same page at several addresses.
Google lists five common reasons a site ends up with duplicates in its canonicalization documentation: region variants (for example, near-identical US and UK pages in the same language), device variants (separate mobile and desktop URLs), protocol variants (HTTP and HTTPS), site functions such as sorting and filtering on category pages, and accidental variants such as a demo or staging site left open to crawlers.
Exact, near and cross-domain duplicates
- Exact duplicates: the same HTML at two addresses, such as
/shoes/and/shoes/?sort=price, or a page reachable with and withoutwww. - Near duplicates: pages that differ by a word or two. City pages that only swap “Karachi” for “Lahore” are the classic case, and Google’s spam policies warn against creating substantially similar pages as doorways.
- Cross-domain duplicates: your article republished by a partner, scraped by another site, or a product description you copied from the manufacturer that hundreds of other stores also use.
Does duplicate content hurt SEO?
There is no duplicate content penalty for normal technical duplication. What happens instead is that Google groups the duplicates, picks one URL as canonical, and shows that one. The problems start when Google picks a different URL from the one you want, or when the duplicates eat into resources you would rather spend elsewhere:
- Split signals. Links and internal links pointing at three versions of a page are weaker than all of them pointing at one. Consolidating them is one of the reasons Google gives for specifying a canonical in its guide to consolidating duplicate URLs.
- The wrong URL ranks. A tracking-parameter URL or a print version can end up in results, which breaks your reporting and sometimes your conversion tracking.
- Wasted crawling. On large sites, especially stores with filters, crawlers spend time on endless variants. This matters most once a site has many thousands of URLs; see my guide to crawl budget for when it becomes a real constraint.
- Messy analytics. Traffic for one page is spread across several URLs, so you underrate your best content.
Copied content is different. Google’s spam policies treat republishing other sites’ content without adding original value, or copying it with only slight changes, as scraping. A site built mainly from copied text can be demoted or removed. That is a quality problem, closely related to thin content, not a canonical tag problem.
Rather have an expert do this for you?
Hand it over and get back to running your business.
Common causes and the right fix for each
Most duplicate content guides list every fix and leave you to choose. When I audit a site I match each cause to one primary fix, because mixing methods (for example, a canonical to page A and a redirect to page B) sends conflicting signals. Google’s own guidance says not to specify different canonical URLs for the same page using different techniques.
| Cause | Example | Primary fix | Avoid |
|---|---|---|---|
| HTTP/HTTPS, www/non-www, trailing slash | http://site.com/page and https://www.site.com/page/ | Site-wide 301 redirect to one version | Relying on canonical tags alone |
| Sorting, filtering and tracking parameters | ?sort=price, ?utm_source=, ?gclid= | Canonical to the clean URL; internal links to the clean URL | Blocking in robots.txt |
| Two old posts on the same topic | “SEO tips 2023” and “SEO tips 2024” | Merge into one, 301 the weaker URL | Keeping both “for safety” |
| Product in several categories | /men/shoes/runner and /sale/runner | One product URL; categories link to it | Category paths inside product URLs |
| Staging or demo site indexed | staging.site.com | Password-protect it, then remove from the index | Leaving it open with only a noindex you might forget to lift |
| Manufacturer or supplier descriptions | Same text as every other retailer | Rewrite with your own specs, photos and use cases | Spinning the text with a tool |
| Your article syndicated elsewhere | Republished on a news portal | Ask the partner to noindex their copy and link back | Relying on a cross-domain canonical |
| Same content for different countries | UK and US pages in English | hreflang, plus a self-canonical on each version | Canonicalising all countries to one page |
How to find duplicate content on your site
- Start in Search Console. Open the Pages report and look at “Duplicate without user-selected canonical”, “Duplicate, Google chose different canonical than user” and “Alternate page with proper canonical tag”. The middle one is the important one: it means Google disagrees with you. My guide to the Search Console coverage report explains each status.
- Inspect sample URLs. The URL Inspection tool shows the user-declared canonical and the Google-selected canonical side by side.
- Crawl the site. Screaming Frog, Sitebulb, Semrush or Ahrefs will flag exact duplicates (by content hash), near duplicates, duplicate titles and pages with missing or conflicting canonicals.
- Check URL variants by hand. Type the HTTP, non-www and trailing-slash versions of your home page. Each should 301 to the one preferred version in a single hop. My free redirect and status code checker shows every hop.
- Search for your own sentences. Put a distinctive sentence from a key page in quotes in Google. Copies on other domains show up quickly. Copyscape does the same at scale.
- Compare rendered and raw HTML. If JavaScript rewrites your canonical, Google may see a different value from the one in your source. The 2024 Web Almanac found rendering changed the canonical on 2.1% of mobile pages it tested.
How to fix and prevent duplicate content
1. Choose one preferred URL format and enforce it
Decide on HTTPS, www or non-www, and trailing slash or not, then redirect every other version with a single 301. Redirects are the strongest canonical signal Google lists, ahead of rel=”canonical”, with sitemap inclusion as a weak signal.
2. Add self-referencing canonicals everywhere
Every indexable page should carry a canonical tag pointing at its own clean, absolute URL. Parameter versions then inherit the right canonical automatically. If you are new to the tag, my guide to the canonical tag in SEO covers the syntax and common errors.
Worked example: a store category with sorting parameters
A WooCommerce store serves its men’s shoes category at https://example.pk/men/shoes/. The sort menu creates /men/shoes/?orderby=price and /men/shoes/?orderby=popularity, and paid ads add ?gclid=. All four show the same products. The fix: keep <link rel="canonical" href="https://example.pk/men/shoes/"> in the head of every variant, make sure menus, breadcrumbs and product pages link to the clean URL, and keep parameter URLs out of the XML sitemap. Do not block ?orderby= in robots.txt, because Google then cannot see the canonical tag on those pages and may index the bare URLs anyway. Check a sample in URL Inspection two to three weeks later: the Google-selected canonical should be the clean URL.
3. Merge pages that answer the same question
Two posts targeting the same query are a duplication problem even when the wording differs, and they usually show up as keyword cannibalisation. Combine the best parts into the stronger URL, 301 the other, and update internal links so they point straight at the survivor.
4. Keep parameter and filter pages under control
Faceted navigation can create millions of URLs from a few hundred products. Decide which filter combinations deserve their own indexable pages (for example “black running shoes” if people search for it), give those clean URLs and unique copy, and canonicalise the rest to the parent category. My guide to faceted navigation SEO walks through that decision.
5. Use noindex, robots.txt and canonicals for the right jobs
Google does not recommend noindex for choosing a canonical within one site, because noindex removes the page from Search entirely, and it advises against robots.txt for canonicalisation because blocked URLs can still be indexed without their content. Use noindex for pages that should never appear (internal search results, thank-you pages), and canonicals for variants of a page you want indexed. If you are unsure which to use, see noindex vs canonical vs robots.txt.
6. Write original copy where templates repeat
Boilerplate is fine in a footer. It is not fine as the main content. On product pages, add your own specifications, sizing notes, photos and answers to the questions customers actually ask; my guide to product descriptions that rank has a template. On location pages, include genuinely local details (service areas, staff, local photos, directions) or do not create the page.
7. Handle syndication and scrapers
If you let a partner republish your article, ask them to noindex their copy and link to your original. Google moved away from recommending cross-domain canonicals for this in 2023, as Search Engine Land reported. For scrapers outranking you, file a DMCA request through Google’s legal removals process; for low-value scrapers that do not outrank you, it is usually not worth the time.
A Pakistan-specific pattern I see often
Many Pakistani online stores sell on Daraz and on their own Shopify or WooCommerce site at the same time, and paste the same product description into both, often the supplier’s text that other sellers also use. Daraz is a far larger domain, so Google tends to show the Daraz listing and filter the store’s own page. The fix is not technical: keep a short version on the marketplace and put the fuller, original description (Urdu size notes, local delivery and warranty details, your own photos) on your own site. The same applies to service businesses that build near-identical pages for Karachi, Lahore and Islamabad: either make each city page useful on its own or use one strong page that lists the cities you cover.
Duplicate content prevention checklist
- One URL format: HTTP, non-www and trailing-slash variants all 301 to one version in a single hop.
- Self-canonicals: every indexable page has an absolute, self-referencing canonical tag.
- Canonical in raw HTML: the canonical is in the source, not only added by JavaScript.
- Clean internal links: menus, breadcrumbs and in-text links point to canonical URLs, never parameter versions.
- Clean sitemap: the XML sitemap lists only canonical, indexable 200 URLs.
- Parameters handled: sort, filter and tracking parameters canonicalise to the clean URL.
- No robots.txt canonicalisation: parameter pages are not blocked if they carry a canonical you need Google to see.
- Staging locked: staging and demo sites are password-protected.
- One page per intent: overlapping posts are merged and redirected.
- Original product copy: no manufacturer descriptions on your most important products.
- Real location pages: city pages contain local detail, not a swapped place name.
- Syndication agreed: partners noindex their copy and link back to your original.
- International variants: country versions use hreflang with self-canonicals.
- Monthly check: “Google chose different canonical than user” in Search Console is reviewed and trending down.
Ticks are saved in your browser.
Mistakes I see when sites try to fix duplicates
- Canonicalising every paginated page to page 1, which hides products and posts that only appear on later pages. Each page in a series should usually self-canonicalise.
- Pointing a canonical at a URL that redirects, returns a 404 or is noindexed. Google will ignore it.
- Using relative canonicals like
href="/page"that break when the site moves or is served on another host. Google recommends absolute URLs. - Pointing all country or language versions at one canonical, which tells Google to drop the others.
- Adding a noindex and a canonical on the same page, which sends mixed signals.
- Fixing the tags but leaving hundreds of internal links pointing at the old URLs, so Google keeps finding them.
Most of these come up in a standard technical SEO review, and they are much cheaper to prevent at build time than to unpick later.
Frequently asked questions
Does Google penalise duplicate content?
Not for normal technical duplication. Google says some duplicate content is normal and not a spam policy violation; it simply picks one version to show. Content copied from other sites with no added value is a different matter, and Google’s spam policies treat it as scraping.
What percentage of duplicate content is acceptable?
Google publishes no percentage, and I would not use one. What matters is whether your important pages are the ones Google selects as canonical and whether each page has a reason to exist. Repeated footers and legal text are fine; repeated main content is what to fix.
Should I use a canonical tag or a 301 redirect?
Use a 301 when the duplicate URL has no reason to exist for users, such as an old post or an HTTP version. Use a canonical when users need the variant, such as a sorted category or a tracking URL, but you want search signals to go to the clean version.
Is it duplicate content if I republish my article on LinkedIn or Medium?
Yes, it is a cross-domain copy, and the larger site may outrank you. Publish on your own site first, wait until it is indexed, then republish a shorter version with a clear link back to the original, or add a fresh introduction for that audience.
Do product variants like colours and sizes create duplicate content?
They can if each variant has its own URL with identical text. Most stores are better served by one product URL with variant options. Give a variant its own indexable page only if people search for it specifically and you can describe it differently.
How long does it take Google to recognise a canonical fix?
It depends on how often the pages are crawled. In my experience, sample URLs usually show the new Google-selected canonical within a few weeks, while large sites can take longer for every variant to be reprocessed.
Sources
- Google Search Central, “What is URL canonicalization” (last updated 2026).
- Google Search Central, “How to specify a canonical URL with rel=”canonical” and other methods” (last updated 2026).
- Google Search Central, “Spam policies for Google web search” (last updated 2026).
- HTTP Archive, “Web Almanac 2024: SEO chapter” (2024).
- Search Engine Land, “Google no longer recommends canonical tags for syndicated content” (2023).
If Search Console keeps choosing a different canonical than the one you set, or you are not sure which duplicates are worth fixing first, my SEO audit service maps every cause to one fix, or you can ask me a question directly.
Request received
Thank you! Saad will contact you within the next 24 hours.
Keep an eye on your phone and inbox.