BramVanroy commited on
Commit
6db11a3
·
verified ·
1 Parent(s): 6022959

fix hidden size

Browse files

AFAICT the hidden size of the model is 640 so the pooling dimension would also be 640 https://huggingface.co/codefuse-ai/F2LLM-v2-160M/blob/main/config.json#L12

Files changed (1) hide show
  1. 1_Pooling/config.json +1 -1
1_Pooling/config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "word_embedding_dimension": 1024,
3
  "pooling_mode_cls_token": false,
4
  "pooling_mode_mean_tokens": false,
5
  "pooling_mode_max_tokens": false,
 
1
  {
2
+ "word_embedding_dimension": 640,
3
  "pooling_mode_cls_token": false,
4
  "pooling_mode_mean_tokens": false,
5
  "pooling_mode_max_tokens": false,