Before a webpage can rank well, it needs to be crawled and indexed. More than some other kind of website, e-commerce sites are well-known for developing URL structures that create indexing and crawling issues with the search engines.
4 ways to keep your e-commerce website’s indexation optimal.
- Optimize sitemaps, navigation links and robots.txt file
These three components are key to strong indexation. It is imperative to note Google and Bing’s rules still say pages ought to be reachable from at least one link, and sitemaps by no means disqualify the significance of this.
The most important thing is to make sure that your robots.txt file is functional, and isn’t blocking Google to crawl any part of your website you want to be indexed.
- Proper use of canonicalization and noindex
Things that should be canonicalized:
- Canonicalize paginated substance to a combined “view all” page.
- Copies made by faceted navigation and URL parameters should canonicalize to the standard version of the web page.
Things that should be noindex:
- Any shopping cart and thank you pages.
- Any staff login pages and membership areas
- Any duplicate or near to duplicate pages that cannot be canonicalized
- Product categories that are not adequately unique from their parent categories
- Internal search result pages
- Good and Bad filters
At the point when should a filter be crawlable by the search engines, and when would it be a good idea for it to be noindexed or canonicalized?
- Should help specify a product
- Should act as a useful extension of your product categories
- By keeping user preference that modifies the design or layout but doesn’t affect the basic content
- Reorganising the content without modifying it, such as sorting by popularity or price
- Get a handle on URL parameters
Uniform Resource Locators are the most common cause of duplicate content and infinite spaces, which severely limits crawl budget and can dilute signals. These variables are added to your uniform resource locator structure that carries server instructions used to do things like:
- Filter items
- Return in-site search result
- Sort items
- Customize page appearance
- Track signal information or ad campaigns to Google Analytics
Some of Google’s Recommendations on proper implementation:
- You should only allow pages to crawled if they build new content for the search engines
- You should never allow links to be clicked for categories that feature no products
Always use standard URL encoding