I built a Qwen-House prototype (Hybrid SSM+MoE, ~3B active params) on RTX 5070 (12GB VRAM). I have implemented Medusa speculative decoding and early exit mechanisms — all working on CPU with dim=64. RLP (NVIDIA ADLR, ICLR 2026) brings RL into pretraining instead of post-training only.