You won't be able to get rid of fireflies "that's what they are called"...if you are not using Mila shaders, that's the only way to clean those highlights.
You can try to disable the specular on all your lights since you are getting true specular from the HDR and that causes an extra specular on top of the HDR specular.
Are these Mia shaders?