Instructions to use BroAlanTaps/Stage1-PCC-Lite-4x with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BroAlanTaps/Stage1-PCC-Lite-4x with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="BroAlanTaps/Stage1-PCC-Lite-4x")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("BroAlanTaps/Stage1-PCC-Lite-4x") model = AutoModelForCausalLM.from_pretrained("BroAlanTaps/Stage1-PCC-Lite-4x") - Notebooks
- Google Colab
- Kaggle
metadata
library_name: transformers
license: apache-2.0
datasets:
- HuggingFaceFW/fineweb
metrics:
- f1
- bleu
- rouge
base_model:
- openai-community/gpt2-large
pipeline_tag: feature-extraction
Model Card for Model ID
PCC-Lite-4x Model:
Compressor: Continue pre-training based on GPT2-Large