#Disalow dinamic content and things which will clutter the logs User-agent: * Disallow: /cgib-public/ Disallow: /cgib-private/ Disallow: /phpMyAdmin/ Disallow: /family/ Disallow: /PDF_Files/ Disallow: /Engineering/