Apply engram repair to weights: bit-identical outputs, trainable n-gram memory for downstream distill/SFT

README.md

@@ -106,3 +106,16 @@ If you use this model, please cite:
 }
 ```
 <!-- CITE_END -->
+
+## Update: engram repair (behavior-preserving)
+
+The n-gram Engram memory in the original weights was degenerate: with the frozen
+LSH compressor at init scale, every token hashed to bucket 0, so only one table
+row ever received gradient. This revision rescales the (frozen) compressor and
+broadcasts the learned bucket-0 vector across all table rows.
+
+**Outputs are bit-identical to the previous revision** (verified: max logit
+difference 0.0 across a prompt battery). The only change: the Engram's hash now
+spreads across the full table and every bucket is independently trainable — so
+if you distill or SFT on top of this base, the n-gram memory will actually learn
+instead of staying a constant bias.

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4f94cdd89c549c8ca6407bfc37522f55a112be3817dcaae8ce8e7e8f346cb7cb
+oid sha256:ce10eed160fd9adbcd1a8682dd962f533faed86cde45e6941399e7616704b2ca
 size 387815772