Differential Privacy for Hugging Face Trainers – Without Rewriting Your Training Loop

It is a well-known problem by now that training LLMs on sensitive data raises serious privacy concerns. In a recent blog post, we talked about membership inference attacks and our research on mitigating them. At JetBrains Research, we are deeply concerned about user privacy and continually developing new methods and tools to improve privacy protection.