Upload RPC-Bench leaderboard Space
Browse files
README.md
CHANGED
|
@@ -27,12 +27,11 @@ Fork the RPC-Bench dataset repository, create a branch, add one submission folde
|
|
| 27 |
|
| 28 |
```text
|
| 29 |
submissions/
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
artifacts/ # optional logs, prompts, run notes
|
| 36 |
```
|
| 37 |
|
| 38 |
Use URL-safe directory names. Replace spaces, slashes, and special characters with hyphens; keep `input_config` as `TEXT` or `VISUAL`.
|
|
|
|
| 27 |
|
| 28 |
```text
|
| 29 |
submissions/
|
| 30 |
+
<organization>__<model>__<input_config>/
|
| 31 |
+
metadata.yaml
|
| 32 |
+
predictions.jsonl
|
| 33 |
+
generation_config.json # optional
|
| 34 |
+
artifacts/ # optional logs, prompts, run notes
|
|
|
|
| 35 |
```
|
| 36 |
|
| 37 |
Use URL-safe directory names. Replace spaces, slashes, and special characters with hyphens; keep `input_config` as `TEXT` or `VISUAL`.
|
app.py
CHANGED
|
@@ -253,7 +253,7 @@ SUBMISSION_GUIDE = """
|
|
| 253 |
1. Fork <a href="https://huggingface.co/datasets/zai-org/RPC-Bench" target="_blank" rel="noopener noreferrer">this repository</a>.
|
| 254 |
2. Create a new branch for your submission.
|
| 255 |
3. Add your submission folder under
|
| 256 |
-
`submissions/
|
| 257 |
4. Open a Pull Request with the new submission folder.
|
| 258 |
|
| 259 |
### Submission Directory Requirements
|
|
@@ -321,7 +321,7 @@ Your submission will be validated before evaluation. To pass:
|
|
| 321 |
### Submission Process
|
| 322 |
|
| 323 |
1. Open PR: add your folder under
|
| 324 |
-
`submissions/
|
| 325 |
2. Fix issues: if validation fails, update the PR with corrected files.
|
| 326 |
3. Review: once validation passes, a maintainer reviews the submission.
|
| 327 |
4. Evaluate: maintainers run the official evaluator in a controlled local
|
|
|
|
| 253 |
1. Fork <a href="https://huggingface.co/datasets/zai-org/RPC-Bench" target="_blank" rel="noopener noreferrer">this repository</a>.
|
| 254 |
2. Create a new branch for your submission.
|
| 255 |
3. Add your submission folder under
|
| 256 |
+
`submissions/<organization>__<model>__<input_config>/`.
|
| 257 |
4. Open a Pull Request with the new submission folder.
|
| 258 |
|
| 259 |
### Submission Directory Requirements
|
|
|
|
| 321 |
### Submission Process
|
| 322 |
|
| 323 |
1. Open PR: add your folder under
|
| 324 |
+
`submissions/<organization>__<model>__<input_config>/`.
|
| 325 |
2. Fix issues: if validation fails, update the PR with corrected files.
|
| 326 |
3. Review: once validation passes, a maintainer reviews the submission.
|
| 327 |
4. Evaluate: maintainers run the official evaluator in a controlled local
|