User-agent: W3C-checklink Disallow: /cgi-bin/ User-agent: * Disallow: /cgi-bin/ Disallow: /graphics/ Disallow: /sphider.de/ Disallow: /sphider.en/ Disallow: /videos/