#site, you would write the following: # #User-agent: * #Disallow: /aboutme/ # # #If you want to do this for multiple directories, you add on more Disallow #lines: # User-agent: * Disallow: /Oi/ Disallow: /oi/ Disallow: /FileServer/ Disallow: /sysadmin/ Disallow: /photo/ Disallow: /phpWebFTP/ Disallow: /jobtrakka/ Disallow: /openwebmail/ Disallow: /moodle/ Disallow: /moodledata/ Disallow: /phpSysInfo/ Disallow: /phpMyAdmin/ Disallow: /phpwebftp/ Disallow: /cgi-bin/ Disallow: /english/ Disallow: /faults/ Disallow: /sysadmin.html Disallow: /status/ # #If you want to exclude certain files, then type in the rest of the path to #the files you want to exclude: # #User-agent: * #Disallow: /aboutme/album.html #Disallow: /stats/refer.htm # #If you are curious, here is what I used to keep an article from getting #indexed: # #User-agent: * #Disallow: /zine/article002.htm # #If you want to keep a specific search engine spider from indexing your #site, #do this: # #User-agent: Robot_Name #Disallow: /