User-agent: * # disallow all files with ? in url Disallow: /*?