Spaces:
Running on CPU Upgrade
Running on CPU Upgrade
GAIA LEADERBOARD IS DOWN PLEASE FIX !!!!
#97
by felipepiresx - opened
This comment has been hidden
Thanks for flagging. Two PRs up that should fix this together:
- Space: https://huggingface.co/spaces/gaia-benchmark/leaderboard/discussions/98 (drops
trust_remote_code=Truefrom allload_datasetcalls) - Dataset: https://huggingface.co/datasets/gaia-benchmark/GAIA_internal/discussions/1 (converts
gaia-benchmark/GAIA_internalfrom a loading script to Parquet, mirroring the layout of the publicgaia-benchmark/GAIA)
Both need to land for the Space to boot under datasets 4.x. Verified locally that row counts match the leaderboard's reference (test=301, validation=165, plus the expected per-level breakdown). Will ping back here once merged.
hey all of you keep ignoring everything who is asking why the account is not authorized to submit on this leaderboard @thomwolf