# Robots.txt para Tecnonauta.com # # A crawler obeys only the most specific group that names it, so every group # below repeats the same Disallow lines. The AI crawlers are listed explicitly # to make the "allowed" decision deliberate rather than an accident of the # wildcard group. User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ # Buscadores y asistentes de IA User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /admin/ User-agent: OAI-SearchBot Allow: / Disallow: /api/ Disallow: /admin/ User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /admin/ User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /admin/ User-agent: Claude-SearchBot Allow: / Disallow: /api/ Disallow: /admin/ User-agent: Claude-User Allow: / Disallow: /api/ Disallow: /admin/ User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /admin/ User-agent: Perplexity-User Allow: / Disallow: /api/ Disallow: /admin/ User-agent: Google-Extended Allow: / Disallow: /api/ Disallow: /admin/ User-agent: Applebot-Extended Allow: / Disallow: /api/ Disallow: /admin/ # Sitemaps # sitemap.xml is a sitemap index pointing at sitemap-content.xml and # sitemap-shorts.xml. The children are listed too so crawlers that do not # expand indexes still find them. Sitemap: https://tecnonauta.com/sitemap.xml Sitemap: https://tecnonauta.com/sitemap-content.xml Sitemap: https://tecnonauta.com/sitemap-shorts.xml Sitemap: https://tecnonauta.com/sitemap-news.xml # Feeds (robots.txt has no feed directive; listed for reference only): # https://tecnonauta.com/rss.xml articulos # https://tecnonauta.com/shorts/rss.xml shorts # Resumen para modelos de lenguaje: https://tecnonauta.com/llms.txt