Hi again Tony,
As you said the hole in the roller assembly has to be slightly oversize so that the angle of the adjuster shaft can be accommodated in its full length of travel. I have seen efforts made to eliminate this by slightly bending the threaded shaft but as I see it and you've picked up on, the weight of the mower on a smooth surface will take up the slight slack and no noticeable edges will be cut into the grass when mowing.
Cheers,
BB.