I worked out that if I put a 0.8 mm thick shim (washer) between the Crankshaft and the bearing on the NDE (Magneto end) and pulled up all the crankcase bolts then the end float was eliminated. I used a set of feeler gauges between the crankcase halves to determine the shim thickness. All good now. I guess Victa's manufacturing tolerances were to blame but its a pit the subject wasn't covered in their repair manual that Bruce kindly sent me. If i seize the bottom end on start then I'll repost.
P.S: The end float variation between TDC and BDC may have been due to me not having the crank case bolts not fully torqued.