Help: Google is not indexing Posts

Kenpachi · Oct 20, 2022

Hello.

Google is not indexing the posts, only the node, threads. In the Sitemap generator, I have disabled tag, could it be because of that?

Would it be good for the SEO of the forum, to leave it like that, or is it better to index the posts as well?

DareSec · Oct 20, 2022

leave it as it is. It does not guarantee google will crawl all of your content .

DareSec · Oct 20, 2022

MY robots.txt File

Code:

User-agent: MJ12bot
Disallow: /

User-agent: rogerbot
Disallow: /

User-agent: AspiegelBot
Disallow: /

User-agent: admantx
Disallow: /

User-agent: Baiduspider
Disallow: /


User-agent: trendictionbot0.5.0
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: rogerbot
Disallow: /

User-agent: AspiegelBot
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: proximic
Disallow: /

User-agent: trendictionbot0.5.0
Disallow: /

User-agent: magpie-crawler
Disallow: /

User-agent: TTD-Content
Disallow: /

User-agent: grapeshot
Disallow: /


User-agent: *
Disallow: /misc/style?*
Disallow: /misc/quick-navigation-menu?*
Disallow: /media/keyword/
Disallow: /media/user/
Disallow: /media/service/
Disallow: /media/submit/
Disallow: /media/category/
Disallow: /media/
Disallow: /events/birthdays/
Disallow: /events/monthly
Disallow: /events/weekly
Disallow: /ThemeHouse/
Disallow: /search/
Disallow: /uix/
Disallow: /credits/
Disallow: /DBTech/
Disallow: /XF/
Disallow: /members/


Disallow: /online/
Disallow: /lost-password/
Disallow: /register/
Disallow: /misc/
Disallow: /help/
Disallow: /admin.php
Allow: /

Search

Help: Google is not indexing Posts

Kenpachi

Well-known member

DareSec

Inforc3r

Kenpachi

Well-known member

DareSec

Inforc3r

Kenpachi

Well-known member