User-agent: * # This * symbol tells all Spiders to follow the below rules Disallow: /images/ # Disallow indexing of any files in Pictures folder Disallow: /cgi-bin/ # Again this helps clean up my search results so that I don't get half pages and 404 errors Disallow: /gifts/*.cat Disallow: /gifts/*.fil Disallow: /thumbnails/ Disallow: /gifts/test Disallow: /gifts/bounce* Disallow: *cPath=* Disallow: *product_info.php*