# ================================================================ # CREATIVE-ONES.COM - ROBOTS.TXT OPTIMIZAT PENTRU AI # ================================================================ # Permitere generală pentru crawlerii legitimi User-agent: * Disallow: /admin-creative Disallow: /aicapp Disallow: /QRCODE Disallow: /search Disallow: /cautare Disallow: /partnersApi # ================================================================ # AI CRAWLERS - PERMITERE COMPLETA (Pentru ChatGPT, Claude, etc.) # ================================================================ # OpenAI (ChatGPT Search și Models) User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ChatGPT-User/2.0 Allow: / User-agent: GPTBot Allow: / # Anthropic (Claude) User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: claude-web Allow: / # Google AI (Gemini) User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / # Microsoft (Copilot/Bing AI) User-agent: BingBot Allow: / User-agent: BingPreview Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Meta AI User-agent: meta-externalagent Allow: / User-agent: FacebookBot Allow: / # Mistral AI (Le Chat) User-agent: MistralAI-User Allow: / # Altri AI utili User-agent: YouBot Allow: / User-agent: cohere-ai Allow: / User-agent: DuckAssistBot Allow: / # Apple Intelligence / Siri User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Google Vertex AI (Gemini pentru companii) User-agent: Google-CloudVertexBot Allow: / # Meta AI (fetch la cererea utilizatorului) User-agent: meta-externalfetcher Allow: / # Amazon (Alexa / Rufus) User-agent: Amazonbot Allow: / # Common Crawl - sursa de date pentru antrenarea multor modele AI User-agent: CCBot Allow: / # Instrumente SEO folosite pentru audit (Ahrefs, Semrush) User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / # ================================================================ # BAD BOTS - BLOCARE COMPLETA # ================================================================ # SEO Spiders agresivi User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / # Content Scrapers User-agent: BLEXBot Disallow: / User-agent: proximic Disallow: / User-agent: GrapeshotCrawler Disallow: / User-agent: LinkdexBot Disallow: / # Bots chinezești/ruși User-agent: Baiduspider Disallow: / User-agent: YandexBot Disallow: / User-agent: Sogou Disallow: / # Spammers și scrapers User-agent: MegaIndex Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: PetalBot Disallow: / # Academic/Research (dacă nu vrei să fii în research) User-agent: Internet Archive Disallow: / User-agent: archive.org_bot Disallow: / # ================================================================ # SITEMAP # ================================================================ Sitemap: https://www.creative-ones.com/sitemap.xml