User-Agent: * Allow: / Allow: /api/v1 Allow: /api/mcp Disallow: /admin Disallow: /api/admin Disallow: /api/auth Disallow: /api/badge-check Disallow: /api/cron Disallow: /api/webhooks Disallow: /monitoring Disallow: /oauth Disallow: /profile Disallow: /rpc User-Agent: MJ12bot User-Agent: DotBot User-Agent: BLEXBot User-Agent: PetalBot User-Agent: DataForSeoBot User-Agent: serpstatbot User-Agent: SeekportBot Disallow: / Sitemap: https://neeed.directory/sitemap.xml