User-agent: * Disallow: /admin Disallow: /dev Disallow: / Disallow: /page-not-found/ Disallow: /server-error/ Disallow: /files-2/