User-agent: Twitterbot Disallow: User-agent: * Disallow: /*? Disallow: /hyper/ Disallow: /*/*.html Sitemap: https://novayagazeta.ru/feed/sitemap