# robots.txtUser-agent: *Disallow: /
User-agent: *
Disallow: /admin
Disallow: /user-*
Disallow: /serach-*
User-agent: SemrushBot
Disallow: /
User-agent: DotBot
User-agent: MegaIndex.ru
User-agent: MauiBot
User-agent: AhrefsBot
User-agent: MJ12bot
User-agent: BLEXBot
User-agent: Barkrowler
User-agent: Mail.RU_Bot
User-agent: ZoominfoBot
User-agent: SeznamBot
User-agent: ExtLinksBot
User-agent: aiHitBot
User-agent: Researchscan
User-agent: DnyzBot
User-agent: spbot
啥意思?
这不叫随缘,这叫蜘蛛杀手