User-agent: * Allow: /index.* Allow: / Disallow: /cgi-bin2/ Disallow: /*.htm Disallow: /*.html