# This is a file retrieved by Web Robots, Web Wanderers, Web Crawlers or Spiders # that confirm to a defacto standard. # # See URL: http://info.webcrawler.com/mak/projects/robots/robots.html # # 02/25/98 The following code will prevent access from all of the above. # 9/5/02 Last updated (JMM) to remove maps, setup, and ge3-ge5 game files entirely to focus robots on interesting pages User-agent: * Disallow: /tests/ Disallow: /xyz123/ Disallow: /stats/ Disallow: /_private/ Disallow: /ge3/turns/ Disallow: /ge3/ Disallow: /Family/ Disallow: /family/ Disallow: /ge4/turns/ Disallow: /ge4/ Disallow: /ge5/turns/ Disallow: /ge5/ Disallow: /setup/ Disallow: /Maps/ Disallow: /genealogy/pix_McDowellBealeBarr.htm Disallow: /genealogy/Pix_BroasMoreyWillson.htm User-agent: seventwentyfour Disallow: / User-agent: TurnitinBot Disallow: /