Instructions to use TheBloke/falcon-40b-instruct-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/falcon-40b-instruct-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/falcon-40b-instruct-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download falcon-40b-instruct.ggccv1.q6_k.bin from TheBloke/falcon-40b-instruct-GGML: direct link, hf CLI and curl.
- Browser
- Download file 34.3 GB
-
https://huggingface.co/TheBloke/falcon-40b-instruct-GGML/resolve/main/falcon-40b-instruct.ggccv1.q6_k.bin
- Command line
-
hf download hf://TheBloke/falcon-40b-instruct-GGML/falcon-40b-instruct.ggccv1.q6_k.bin
-
curl -L -o falcon-40b-instruct.ggccv1.q6_k.bin https://huggingface.co/TheBloke/falcon-40b-instruct-GGML/resolve/main/falcon-40b-instruct.ggccv1.q6_k.bin
34.3 GB
- Xet hash:
- 94592d5d0d031ba3a81dbd70dcadc11fcc46d840b32234c41b16f49ce10331ab
- Size of remote file:
- 34.3 GB
- SHA256:
- 761c3cd6c1243c4f2787c30fa7cce690e9dc92952d35bd428bad0481ba60e846
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.