#refer https://github.com/jonasjacek/robots.txt/blob/master/robots.txt 2020/11/10 for windows User-agent: Googlebot User-agent: Baiduspider User-agent: Googlebot-Image User-agent: Baiduspider-image Crawl-delay: 30 User-agent: Googlebot-Video User-agent: msnbot-media User-agent: Slurp User-agent: Bingbot User-agent: msnbot User-agent: Sogou blog User-agent: Sogou web spider Crawl-delay: 30 Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.gif$ Disallow: /*.png$ Disallow: /*.bmp$ User-agent: * Disallow: /