René's URL Experiment: Known Crawlers

Some crawlers that identify themselves with a leading + in my webserver logs include Crawlers without leading + include: Twitterbot/1.0, http://www.trendiction.de/bot, DuckDuckGo/5, Thinkbot/0.5.8, wpbot/1.3 (however rogether with +https://forms.gl), NetcraftSurveyAgent/1.0 (together with +info@netcraft.com), ClaudeBot/1.0 (+ClaudeBot@anthropic.com) …
See also Robots Database.