JevCrawler

JevCrawler is the web crawler operated by Marsala (marsala.dev). If you found this page through your server logs, our crawler visited your site with a user agent like:

JevCrawler/<version> (+https://jevcrawler.marsala.dev/bot)

What it does

• Reads public business web pages (for example company, product, team and contact pages) to build business directory and property-owner research data.
• Always obeys robots.txt (RFC 9309), including Crawl-delay. If robots.txt cannot be read because of a server error, it does not crawl the site.
• Waits at least one second between requests to the same host, and longer if your robots.txt asks for it.
• Does not log in, does not bypass paywalls, and does not crawl .gov or .mil sites.
• Identifies itself honestly with the user agent above.

How to opt out

Add these lines to https://your-site/robots.txt:

User-agent: JevCrawler
Disallow: /

Or email us at contact@marsala.dev with your domain; we add it to our block list and stop crawling it.

Abuse and contact

To report a problem (load, unexpected requests, anything else), email contact@marsala.dev. Please include your domain and the approximate time of the requests.

Marsala · marsala.dev