The official web crawler for Pricesearcher
- Millions of shoppers use Pricesearcher to search for products.
- Pricesearcher is the UK's biggest price search engine.
- Trusted by thousands of retailers around the world.
Request Crawl: Simply submit your URL or Sitemap and Pricebot will take care of the rest!
Crawl Settings: Learn how to control the Pricebot crawl settings.
Product Feed: Already have a product feed? Great! Submit your feed here.
Get In Touch: If you're unsure about anything, please get in touch.
A trusted source of organic traffic
Pricesearcher is trusted by many of the leading online retailers. Recently added retailers include: Amazon, AO.com, Argos, ASOS, B&Q, Boots, Bose, Carphone Warehouse, Currys PC World, Dreams, Dyson, Dune, Disney, Game, Groupon, HP, IKEA, Missguided, Office and The Entertainer.
We're a UK based business
All of our team is based in various locations in the UK.
What is Pricesearcher?
Pricesearcher is the world's first truly unbiased product search engine. Millions of shoppers use our site every month to find the products they are are looking for.
Our mission is to provide unbiased access to the world's prices across any vertical, product, good or service. Pricesearcher will help you find the best deal on the products you're searching for.
What is a web crawler?
Web crawlers are a type of software designed to follow links and gather information. Web crawlers are also sometimes referred to as spiders, bots and robots.
What does Pricebot do?
Pricebot retrieves product details from eCommerce websites. Pricebot is an automated computer program which uses an algorithmic process to crawl a website to determine which information is useful to a user searching for prices.
This information is sent back to Pricesearcher to be included in the Pricesearcher index.
What information do you collect?
PriceBot is only interested in related information about products, namely (product title, product description, price, product URL, image) and any other relevant information specific to the product.
We will not be collecting any personal data. We are only interested in related information about products.
We use Pricebot solely for the purpose of collecting relevant information so that we can direct users to the retailer’s site.
What is the Pricesearcher index?
The Pricesearcher index is the database of all of the products that we store. We use this information to provide unbiased search results that are relevant to the search terms entered by the site visitor.
The first step to being ranked by Pricesearcher is indexing your products.
How can I index my products?
It is our mission to index all of the world’s prices. In order to do this we have removed all barriers to make this as easy as possible for online retailers. You can submit a product feed in any format or request website crawl directly using your URL or Sitemap and some basic contact details.
What is a Sitemap?
A Sitemap is a file that lists the pages of a website accessible to crawlers or users, typically organised in hierarchical fashion. Search engine crawlers like Pricebot utilise this file to more intelligently crawl your site.
What cost is involved?
Indexing your products on Pricesearcher is 100% free of charge. We do not charge to index your products. Any traffic directed to your site is also 100% free of charge. This is our promise to you.
Can I control Pricebot?
Yes, Pricebot follows instructions it finds in your websites robots.txt.
What is a robots.txt file?
The robots.txt file controls how web crawlers like Pricebot see and interact with your webpages.
In short, a robots.txt file tells web crawlers what to do when they visit your pages by listing files and folders that you do not want them to access.
Can I prevent Pricebot from crawling content?
If you want to prevent Pricebot from crawling content on your site, you can:
- you can use robots.txt to block access to files and directories on your server (see example below); or
- you can write to us directly at email@example.com and we will ensure that Pricebot does not crawl or access any information from your website.
We will not index anything you would like to remain private. All you have to do is tell us.
Example of how to use the official robots exclusion standard:
Can I control Pricebot website request rate?
Pricebot will automatically try to figure out the optimum rate to crawl your website. If you wish to manually override that, please specify the following in robots.txt :
Crawl-delay: 2 # specifies a 2 second timeout
Please note that it might take upto 24 hours for the Crawl-delay to take effect.
Official Pricebot support
If you have any questions regarding the Pricesearcher Pricebot or indexing your products please get in touch.