User-agent: WebAlta Crawler/2.0 Disallow: / User-agent: MLBot Disallow: / User-agent: LinkWalker Disallow: / User-agent: MJ12bot Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Gaisbot Disallow: / User-agent: twiceler Disallow: / User-agent: Charlotte Disallow: / User-agent: Exabot Disallow: / User-agent: ScoutJet Disallow: / User-agent: dotbot Disallow: / User-agent: discobot Disallow: / User-agent: ccbot Disallow: / User-agent: voyager Disallow: / User-agent: DBLBot Disallow: / User-agent: Yandex Disallow: / User-agent: MojeekBot Disallow: / User-agent: BecomeBot Disallow: / User-agent: daumoa Disallow: / User-agent: panscient.com Disallow: /