RSS Feed/News Claudebot - Thousands of Hits

Status
Not open for further replies.

ENXF NET

Administrator
Staff member
Administrator
Moderator
+Lifetime VIP+
S.V.I.P.S Member
S.V.I.P Member
V.I.P Member
Collaborate
Registered
Joined
Nov 13, 2018
Messages
19,706
Points
823

Reputation:

Just in case you didn't see this...

Added to robots.txt:
Code:

Code:
User-agent: anthropic-ai
Disallow: /

It seems to obey the rules with robots.txt at this moment in time, so that is one solution.

Regards,

Alex

Continue reading...
 
Status
Not open for further replies.
Top