---
library_name: transformers
license: apache-2.0
datasets:
- HuggingFaceFW/fineweb
metrics:
- f1
- bleu
- rouge
base_model:
- openai-community/gpt2-large
pipeline_tag: feature-extraction
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
**PCC-Lite-4x Model:**

Compressor: Continue pre-training based on GPT2-Large