Changing entity type from List to Set in manytomany causes spring app to throw concurrentModificationException

I am attempting to correct a mistake in how a ManyToMany relationship is set up and change the Lists over to Sets as I’ve read. But when I change each side of the relationship to a set, it breaks the jpa repository it seems. Any query to to the repository will throw the concurrentModificationException.