User-agent: * Disallow: /pg/ Disallow: /checkout/ Disallow: /result/ Disallow: /error/