Skip to content

CervejaBarataBot

Seen CervejaBarataBot in your logs? It is the crawler behind Cerveja Barata (cervejabarata.com.br), a free price comparison for beer in bars, botecos, beach shacks, supermarkets and depósitos in Brazil.

What it reads and how often

  • Preço da Hora Bahia (SEFAZ-BA): beer sales recorded on electronic receipts (product, price, date and barcode), with the name, address and CNPJ (company number) of the seller. Each run makes up to 30 searches, at least 20 seconds apart, and lasts about ten minutes. Between runs the crawler waits eight minutes: that is about three runs an hour, day and night.
  • OpenStreetMap and Overture Maps: name, address and location of bars, from open lists. A few queries a day at most.
  • Instagram: public posts and profiles of bars, with beer prices and promotions, only through Meta's official API and under its rules. Once a day.
  • Company register (CNPJ): main activity and trade name of each business, through minhareceita.org and CNPJá. One query per CNPJ, repeated only after 90 days.

It never logs in, never enters restricted areas and collects no personal data about customers.

How it behaves

It always identifies itself with this User-Agent:

CervejaBarataBot/1.0 (+https://cervejabarata.com.br/bot)
  • Reads your robots.txt at the start of every run and follows its Crawl-delay.
  • Waits at least 3 seconds between two requests to the same site.
  • At the first 403, 429, CAPTCHA or unexpected answer, the run ends. The next one, at the next scheduled time, tries again and ends again if the block lasts.
  • Never tries to get around a CAPTCHA, a block or a rate limit.

How to block it

To stop it visiting your site, add this to your robots.txt:

User-agent: CervejaBarataBot
Disallow: /

To correct or remove details about your venue, or with any question about the crawler, write to contato@cervejabarata.com.br.