Suchmaschinen: Googlebot, Bingbot, YandexBot, Baiduspider, DuckDuckBot, Applebot, Qwantbot, SeznamBot, Sogou.
KI- & LLM-Crawler: ChatGPT-User, GPTBot, Google-Extended, ClaudeBot, Claude-Web, PerplexityBot, Cohere, Anthropics, OAI-SearchBot, Quillbot, YouBot, MyCentralAIScraperBot.
SEO-Tools: AhrefsBot, SemrushBot, MJ12bot, DotBot, DataForSeoBot, Awario-Bots, SEOkicks, Botify, Jetslide, peer39.
Social & Sharing: facebookexternalhit, FacebookBot, Twitterbot (X), Pinterestbot, Slackbot, externe Meta-Fetcher.
Sicherheit & Cloud: AliyunSecBot, Amazonbot, Google-CloudVertexBot und mehr.
Scraper & Forschung: BLEXBot, Bytespider, CCBot, Diffbot, DuckAssistBot, EchoboxBot, FriendlyCrawler, ImagesiftBot, magpie-crawler, NewsNow, news-please, omgili, Poseidon Research Crawler, Quora-Bot, Scrapy, SeekrBot, SeznamHomepageCrawler, TaraGroup, Timpibot, TurnitinBot, ViennaTinyBot, ZoomBot, ZoominfoBot.