RaveetoBot, the Raveeto crawler

RaveetoBot is the crawler of Raveeto (raveeto.com), the site of the best bike deals in Canada. If you see it in your store's logs, here is what it does, how it behaves and how to reach us. It was formerly called VDealBot.

What it does

Every night, RaveetoBot reads the public catalogue of Canadian bike stores to show their prices, discounts and stock on Raveeto. Every product links to its page at the store, where the purchase happens.

It only reads:

• the price, the compare-at price and the availability;
• the title, the brand, the barcodes (UPC / EAN) and the manufacturer part numbers;
• the address of the main image (linked, never copied).

It never copies descriptions, reviews or photos, never creates an account, never fills a cart and collects no personal data.

How it behaves

• It follows each store's robots.txt, including the Crawl-delay directive.
• It spaces its requests by several seconds (never more than one per second), all stores together, and stops by itself as soon as a server answers that it goes too fast.
• It always identifies itself the same way: RaveetoBot/1.0 (+https://raveeto.com/robot), with the header From: [email protected].
• Its requests are signed with the Web Bot Auth protocol (HTTP message signatures, Ed25519). Our public keys are published at https://raveeto.com/.well-known/http-message-signatures-directory: a request that claims to come from RaveetoBot without a valid signature does not come from us.

Limiting or blocking it

To block RaveetoBot on your store, add this to your robots.txt (applied at the next collection):

User-agent: RaveetoBot
Disallow: /

You can also write to us to have it come less often, to correct some information or to remove your store from Raveeto.

Contact

[email protected]