Instructions to use TheBloke/falcon-40b-instruct-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/falcon-40b-instruct-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/falcon-40b-instruct-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 6ca681c426b7d6760c695c0db79e06d07e112e0c09da20dd0c52ae0e5beb7c07
- Size of remote file:
- 28.8 GB
- SHA256:
- cd3754383b14ceb9650e784de44eb2ac2a7f43b94901505d2a978b5288d05b42
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.