About YidListBot

YidListBot is YidList's crawler. It identifies itself with the user agent YidListBot/0.1 and a link to this page. It only runs against sites whose operators have given permission or that publish a feed licensed for this use; as of today it is not collecting listings from any site.

How it behaves

• It follows robots.txt rules for YidListBot or *, including Crawl-delay, and waits at least 5 seconds between requests to a site.
• It stops on login walls, paywalls, bot challenges, and 401, 403 or 429 responses. It never retries with a different identity.
• It collects factual details only (such as area, price, room counts and dates) and links back to the original. It does not copy photos, full descriptions or contact details unless the source's permission covers them.

Opting out

Add User-agent: YidListBot / Disallow: / to your robots.txt, or email hello@yidlist.co. To remove listings already shown, use Request removal; we act within 24 hours.