Compress 16 years of world-model learning into ~47 GPU-hr via 7 techniques. End state: sovereign world model at transformer scale (128-dim, 4 layers, 12.7M params) LIVE and learning.
| Aspect | Today (toy) | Target (Phase 5) |
|---|---|---|
| State dim | 16 | 128 (8ร) |
| Hidden dim | 32 | 512 (16ร) |
| Layers | 1 | 4 (4ร) |
| Heads | โ | 4 |
| Params | ~512 | 12.7M (24,000ร) |
| Training data | toy transitions | 1M synthetic + 50K sovereign + 5K real |
128-dim state, sovereign adapter computes next state. Care-floor 0.95 enforced.
| Step | Status |
|---|---|
| Architecture design (128-dim, 4 layers, 4 heads) | DONE |
| Sovereign adapter (W_sovereign matrix) | DONE |
| Mac-light implementation (numpy) | DONE |
| /api/world-model/predict endpoint | LIVE |
| Synthetic training data (1M transitions) | Pending (Kaggle) |
| Full backprop training (vs simplified) | Pending (Kaggle) |
| Sovereign brain integration (replace JEPAPredictor) | Pending (Phase 5 end) |
An LLM predicts the next TOKEN. A world model predicts the next STATE. The difference: a world model understands causality, can plan multi-step, and can detect OOD inputs.