User-agent: * Sitemap: https://www.thegreencorner.net/sitemap.xml ############## # custom # ############## # Bots de SEO y de IA que no nos traen clientes User-agent: PetalBot Disallow: / User-agent: DotBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / # Todos los demás: más despacio y sin páginas repetidas User-agent: * Crawl-delay: 5 Disallow: /*?order= Disallow: /*&order= Disallow: /*?*search= Disallow: /shop/cart Disallow: /shop/checkout # Filtros de la tienda: miles de combinaciones Disallow: /*tags= Disallow: /*marca= Disallow: /*disponibles= Disallow: /*min_price= Disallow: /*max_price= Disallow: /*attribute_value= Disallow: /*attrib=