Could your factory crimp die be bumping up the neck just behind the neck?

Try chambering before applying the factory crimp and after, to see if there is any difference?