Instructions to use TheBloke/falcon-40b-instruct-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/falcon-40b-instruct-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/falcon-40b-instruct-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download falcon-40b-instruct.ggccv1.q5_1.bin from TheBloke/falcon-40b-instruct-GGML: direct link, hf CLI and curl.
- Browser
- Download file 31.4 GB
-
https://huggingface.co/TheBloke/falcon-40b-instruct-GGML/resolve/main/falcon-40b-instruct.ggccv1.q5_1.bin
- Command line
-
hf download hf://TheBloke/falcon-40b-instruct-GGML/falcon-40b-instruct.ggccv1.q5_1.bin
-
curl -L -o falcon-40b-instruct.ggccv1.q5_1.bin https://huggingface.co/TheBloke/falcon-40b-instruct-GGML/resolve/main/falcon-40b-instruct.ggccv1.q5_1.bin
31.4 GB
- Xet hash:
- cf01733b38778edab6cc5079f14858f0586ba3d4b4f9a14b03e929e55e172e86
- Size of remote file:
- 31.4 GB
- SHA256:
- a66d922d9bf6fba272fde686b451b54804cfcc03126ef33465b1563976602b45
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.