Masked Diffusion Language Model (MDLM) pretraining in PyTorch with FSDP2, Muon optimizer, and Hugging Face Jobs support.
Need help?
Contact usMasked Diffusion Language Model (MDLM) pretraining in PyTorch with FSDP2, Muon optimizer, and Hugging Face Jobs support.