Huggingface_converted_model
Collection
3 items • Updated
How to use xiaol/Huggingface-RWKV-claude-for-mobile-v4-world-1.5B-16k with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("xiaol/Huggingface-RWKV-claude-for-mobile-v4-world-1.5B-16k", device_map="auto")This is converted model for Huggingface format
use this repo https://github.com/xiaol/Huggingface-RWKV-World change repo id to this model hub.
to do
Using this script below https://github.com/xiaol/Huggingface-RWKV-World/blob/main/convert_rwkv_checkpoint_to_hf.py
python .\convert_rwkv_checkpoint_to_hf.py --checkpoint_file D:\copilot\RWKV-claude-4-World-7B-65k\RWKV-claude-4-World-7B-20230805-ctx65k.pth --output_dir ./RWKV-7B-65k-HF --size 7B