# Периметр обхода marketly.ru. Открыт публичный каталог, карточки каналов, # блог и лендинги; закрыт личный кабинет и служебные API. User-agent: * Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / Clean-param: utm_source&utm_medium&utm_campaign&utm_content&utm_term&from&ref&ref_id&gclid&yclid&ysclid&etext&source_type&erid&modal&auth&returnTo # Ответные движки и ИИ-краулеры перечислены отдельными секциями намеренно. # Правила групп по RFC 9309 не складываются, поэтому периметр в каждой # секции повторён целиком — иначе явное упоминание бота открыло бы ему # личный кабинет. # Яндекс: показ сайта в Алисе AI и быстрых ответах с YandexGPT. Ключевой токен для русского рынка User-agent: YandexAdditional Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Яндекс: второй токен того же механизма, указан в справке про запрет показов в Алисе AI User-agent: YandexAdditionalBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # OpenAI: индекс поиска ChatGPT User-agent: OAI-SearchBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Anthropic: индекс поиска Claude User-agent: Claude-SearchBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Perplexity: индекс ответов User-agent: PerplexityBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Google: использование в Gemini и в обосновании ответов (grounding). Не отдельный краулер, а разрешение поверх обхода Googlebot User-agent: Google-Extended Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Apple: индекс Siri и Spotlight User-agent: Applebot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Mistral: индекс Le Chat User-agent: MistralAI-Index Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Meta: индекс Meta AI User-agent: Meta-WebIndexer Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Amazon: индекс ответов Alexa и Rufus User-agent: Amzn-SearchBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # OpenAI: заход в момент вопроса пользователя User-agent: ChatGPT-User Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Anthropic: заход в момент вопроса пользователя User-agent: Claude-User Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Perplexity: заход в момент вопроса пользователя User-agent: Perplexity-User Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Mistral: заход в момент вопроса пользователя User-agent: MistralAI-User Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # DuckDuckGo: сборка ответа DuckAssist User-agent: DuckAssistBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Meta: заход по запросу пользователя User-agent: Meta-ExternalFetcher Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Amazon: заход по запросу пользователя User-agent: Amzn-User Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # OpenAI: сбор корпуса для обучения User-agent: GPTBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Anthropic: сбор корпуса для обучения User-agent: ClaudeBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Apple: обучение Apple Intelligence User-agent: Applebot-Extended Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Meta: сбор корпуса для обучения User-agent: Meta-ExternalAgent Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Mistral: сбор корпуса для обучения User-agent: MistralAI-Training Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Amazon: сбор корпуса User-agent: Amazonbot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / # Common Crawl: открытый корпус, из которого учится множество моделей User-agent: CCBot Allow: /api/catalog/ Allow: /api/media/ Disallow: /account Disallow: /my-channels Disallow: /my-requests Disallow: /my-orders Disallow: /cart Disallow: /more Disallow: /order-success Disallow: /invoice Disallow: /analytics Disallow: /sentry-server-probe Disallow: /api/ Disallow: /statly-api/ Allow: / Sitemap: https://marketly.ru/sitemap.xml