Question: can this run on mobile?

#190
by 3morixd - opened

Great Space! ๐Ÿ‘‹

At Dispatch AI (FZE, UAE), we build mobile AI. Question: has anyone tried running this on a phone?

We test AI applications on 40 Samsung S20 FE devices (Snapdragon 865). If this could be adapted for mobile, we'd love to benchmark it.

Specifically interested in:

  • Model size after quantization

  • Inference speed on ARM

  • Memory requirements

  • Dispatch AI (FZE), Sharjah UAE

Massive Text Embedding Benchmark org

Hey @3morixd ,
MTEB doesn't run models live on a benchmark. We run models beforehand, save their results to https://github.com/embeddings-benchmark/results, and that's what gets loaded on LB, which you see. So, we don't have any specific requirements that you have mentioned. Is this an answer to your question?
Also, you can easily see this LB on a mobile phone on any browser.

Samoed changed discussion status to closed

Sign up or log in to comment