user-agent: * Disallow: /en-old/ Disallow: /en/portals/herbertdirect/ Disallow: /api/ Disallow: /compscripts/ Disallow: /up/user/ Disallow: /up/tmp/