tarekziade's picture
tarekziade HF Staff
Clean benchmark pass: decode 13.92, 4K prefill 227.6, after 6K doc 205.6 / 12.41 (guessed reads, in-place caches, HC step)
8b3e9bc verified