nomic-ai

/

nomic-bert-2048

Like 54

Follow

Nomic AI 1.24k

NomicBertModel doesn't implement get_input_embeddings() or set_input_embeddings(), so the transformers fallback in EmbeddingAccessMixi tries to resolve them automatically. This fails because:

• _input_embed_layer defaults to embed_tokens, but NomicBERT uses word_embeddings
• base_model_prefix = "model", but __init__ creates self.embeddings, not self.model

Adding these two methods fixes this.