RSS Feed/News Not all bots are being detected

Status
Not open for further replies.

ENXF NET

Administrator
Staff member
Administrator
Moderator
+Lifetime VIP+
S.V.I.P.S Member
S.V.I.P Member
V.I.P Member
Collaborate
Registered
Joined
Nov 13, 2018
Messages
24,174
Points
823

Reputation:

XF\Data\Robot::getRobotUserAgents() detects 35 bots only.

This function should be replaced with CrawlerDetect or similar library, which detects 1,000's of bots/spiders/crawlers:
github.com

GitHub - JayBizzle/Crawler-Detect: 🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent - JayBizzle/Crawler-Detect
github.com
github.com

Continue reading...
 
Status
Not open for further replies.
Top