# /robots.txt file for http://hwgn.org # User-agent: * Crawl-delay: 5 Disallow: /johnd Disallow: /wss User-agent: BecomeBot Disallow: / User-agent: TechFerret Disallow: /johnd Crawl-delay: 7