# This robot.txt file is for http://www.prowillen.com # Each line in the group has the format # : # The purpose it to hopefully "controll" the robots/spiders # from indexing directories that have "confidential" data. # Which robot is allowed and where our case, all are welcome User-agent: * Disallow: /Admin Disallow: /Art Disallow: /attic Disallow: /cgi-bin Disallow: /email_gw_logs Disallow: /ErrorResponces Disallow: /graphics Disallow: /Logos Disallow: /photogallery Disallow: /Portfolio Disallow: /test Disallow: /rtv Disallow: /mailserver Disallow: /labpub Disallow: /includes Disallow: /giants.html Disallow: /ettinger Disallow: /sfbee.html