User-agent: * # being phased out Disallow: /shared_code/ Disallow: /shared_files_to_distribute/ Disallow: /shared_systems/ Disallow: /libraries/ Disallow: /security/ # end of being phaased out Disallow: /_errors/ Disallow: /_security/ Disallow: /_security2/ Disallow: /administrator/ Disallow: /back_db/ # backup databases Disallow: /back_backup/ # backup hosts Disallow: /back_site/ # backup sites Disallow: /cgi-bin/ Disallow: /files/ # certain files that need copied to startups Disallow: /help/ # usually a redirect to get access Disallow: /images/ Disallow: /inc/ #place to put all include files Disallow: /logs/ Disallow: /private/ Disallow: /secure/ Disallow: /static/ #static non-changing files Disallow: /tools_closed/ Disallow: /tools_open/ Disallow: /tools_pass/ Disallow: /usr/ Disallow: /tmp/