User-agent: * Disallow: /area/ Disallow: /api/ Disallow: /cgi-bin/ Disallow: /api.php Allow: /*.css Allow: /*.js