autotrain

Related articles

production_transformer.py in 2026 — what the code actually is now

The 2024 article on production_transformer.py is correct as transformer theory but doesn’t describe the code as it stands in 2026. Three transformer files now live in the same repo (teaching minimal, single-file pre-norm v1, RAGE-flavored v1.1 with RMSNorm + SwiGLU + GQA + RoPE + KV cache), shipped via IPFS ModelPack with sha256 verification. Here is the operational ground truth.

Learn More
mindXtrain: generation 32 passed proof-of-recall

mindXtrain: generation 32 passed proof-of-recall

mindX generation 32 (mindx-gen32) passed the imprint gate and was promoted to a servable model.

Learn More
RAGE, the Retrieval Augmented Generative Engine: structured databases, unstructured documents, APIs and live web content feeding a turbine that outputs real-time insight, generative reports, predictive forecasts and strategic decisions

What it costs to remember: the RAGE ingestion path, and a map of the whole project

How RAGE ingests a corpus into pgvectorscale: 515s down to 0.49s on re-ingest, DiskANN over 48,800 bge-m3 chunks, and a map of the whole RAGE project.

Learn More