KI-Agenten & Web-Crawler Verzeichnis
Umfassende Datenbank von KI-Agenten, Web-Crawlern und Bots, die Websites besuchen. Erfahren Sie mehr über jeden einzelnen und wie Sie deren Zugang zu Ihren Inhalten verwalten.
KI-Traffic auf Ihrer Website verfolgen
Erhalten Sie Echtzeit-Einblick, welche KI-Agenten und Crawler Ihre Website besuchen. Richten Sie Blockierungsregeln und Analytics-Integration in Minuten ein.
Kostenlose Testversion startenAI Model Trainers
5 BotsBots collecting web data for AI model training
AI Model Trainers
Crawlers that index content for use in building AI models
AI Visitors
5 BotsAI systems acting directly on behalf of user requests
AI Assistants
Direct AI assistants executing web requests
Crawler
30 BotsBots indexing content for search engines and online tools
AI Search Engine Crawlers
Bots that crawl to improve AI search capabilities
Archive Crawlers
Web archival services
Ecommerce Crawlers
Crawlers from online marketplaces or Ecommerce sites
Search Engine Crawlers
Major search engine crawlers
Zeige erste 12 von 20 Bots
SEO Tools
Tools for SEO analysis and monitoring
Scraper
7 BotsData collection tools, code and command-line tools, and other items that can be used to scrape web content. These are different than crawlers in that they are typically initiated by an application or a person and do not re-visit sites and pages on a schedule.
Code Libraries
Code modules that can access web pages. Note that it is possible for the application developer to override the user agent, which would cause these tools to not. report correctly.
Command-Line Tools
Visits generated by tools that can be run from a command line, like cURL, wget, and others. These tools are not necessarily malicious, but they are often used for scraping or other data collection, which is why they are listed here.
Data Collection Tools
Known data collection tools
Special Purpose
9 BotsBots and tools that support specific applications. Generally these are safe to allow.
Monitoring Tools
Tools for monitoring website availability and performance
Security Tools
Tools for security scanning and monitoring
Social Media Tools
Tools used by social media sites for specific purposes, like generating link previews, fetching page titles, and the like.
Unknown
563 BotsUnclassified or ambiguous bots
Unclassified
Bots pending classification
Bereit, die Kontrolle über Ihren KI-Traffic zu übernehmen?
Schließen Sie sich Tausenden von Websites an, die Spyglasses verwenden, um KI-Agenten-Traffic zu erkennen, zu analysieren und zu verwalten. Starten Sie noch heute Ihre kostenlose Testversion.
Kostenlos loslegen