Download robots.txt from FINAL-Bench/all-bench-leaderboard: direct link, hf CLI and curl.
- Browser
- Download file 354 Bytes
-
https://huggingface.co/spaces/FINAL-Bench/all-bench-leaderboard/resolve/main/robots.txt
- Command line
-
hf download hf://spaces/FINAL-Bench/all-bench-leaderboard/robots.txt
-
curl -L -o robots.txt https://huggingface.co/spaces/FINAL-Bench/all-bench-leaderboard/resolve/main/robots.txt
354 Bytes
| User-agent: * | |
| Allow: / | |
| User-agent: Googlebot | |
| Allow: / | |
| User-agent: Bingbot | |
| Allow: / | |
| User-agent: ChatGPT-User | |
| Allow: / | |
| User-agent: GPTBot | |
| Allow: / | |
| User-agent: ClaudeBot | |
| Allow: / | |
| User-agent: PerplexityBot | |
| Allow: / | |
| User-agent: Google-Extended | |
| Allow: / | |
| Sitemap: https://huggingface.co/spaces/FINAL-Bench/all-bench-leaderboard/resolve/main/sitemap.xml | |