User-agent: * Disallow: /logs/ Disallow: /db/ Disallow: /etc/ Disallow: /stats/