Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Technical Duplicate Issues Mikkel deMib Svendsen Creative Director, deMib.com & RedZoneGlobal Denmark Director of European Business Development, WebmasterRadio.FM Contact: – (+45)

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Common Technical Duplicate Issues With & without WWW Session IDs URL rewriting Many-to-one problems in forum Sort order parameters Bread crumb navigation The list is infinite! It often takes a great deal of research to identify all duplicate issues on large and dynamic websites. Deal with it – before the engines do! ! !

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen With and/or without WWW Indexing issues? Most engines seems to be able to handle common use of both www and not www Linking issues? Yes, direct links is always the best! Solution: Redirect one-to-one From: To:

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen The nightmare of session IDs Almost 200,000 versions of the same page indexed! Solution: Dump all session information in a cookie for all users – or identify spiders and strip the session ID for them only. In any case: Deal with it!

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Customize Permalink Structure

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Rewriting not blocking Rewritten URL: Original URL: As default both will be accessible! Both pages are 100% identical Indexing & Linking Solution: 301 redirect all requests to “non-official” URLs to the correct (re-written) URL

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen One WordPress Canonical URL plugin Tool: #1 Server Response: HTTP Status Code: HTTP/ : Moved Permanently Date: Sun, 16 Jul :50:46 GMT Server: Apache/ (Win32) PHP/5.1.2 X-Powered-By: PHP/5.1.2 X-Pingback: Status: 200 OK Location: Content-Length: 268 Connection: close Content-Type: text/html; charset=UTF-8 Redirect Target: #2 Server Response: HTTP Status Code: HTTP/ OK Date: Sun, 16 Jul :50:47 GMT Server: Apache/ (Win32) PHP/5.1.2 X-Powered-By: PHP/5.1.2 X-Pingback: Status: 200 OK Connection: close Content-Type: text/html; charset=UTF-8

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Many-to-one in forums Indeks solution? In this case they have used a POST form, that engines do not (currently) execute. Also, the “Rate This” form is on this forum is only available to logged in users. Both URLs are accessible by all (including spiders) Linking solution? None! (apparently) Suggestion: Check for major bots and 301 redirect all URL’s with the “pp=“ parameter or “page=1” value to the default URL for the page

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Sort Order Parameters Sort by Col 1: Publisher (desc/asc) Col 2: Site (desc/asc) Col 3: Unique visitors (desc/asc) Col 4: % +/- (desc/asc) Col 5: Visitors (desc/asc) Col 6: % +/- (desc/asc) ALL VERSIONS INDEXED! Indexing & Linking Solution: Identify spiders and issue a 301 for all “non- official” URLs back to the default URL

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Breadcrumb Navigation Typical breadcrumb Products -> Shoes -> Running Shoes -> Adidas Alternative product location Products -> Sports Equipment -> Shoes -> Adidas If your breadcrumb navigation is reflected in your URLs you may have a problem! ! ! Indexing & Linking Solution: Pages should only have one location! Store user navigation paths/breadcrumbs in a cookie

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Remember! There are infinite ways to create multiple URLs to a single page. Whatever you do, don’t leave it to the engines to deal with! ! !

Mikkel deMib Svendsen Duplicate Content & Multiple Site Issue Mikkel deMib Svendsen Thank you! Mikkel deMib Svendsen Creative Director, deMib.com & RedZoneGlobal Denmark Director of European Business Development, WebmasterRadio.FM Contact: – (+45) And remember … You don't have to be genius to be a Geek! Tune into StrikePoint At WebMasterRadio.FM (FREE!) DaveN & Mikkel deMib Svendsen - only European SEO radio show! Monday at 21:00 (Central Europe Time)