When to your honing tool are using a ridged hone? You also should using 280 or 320 grit stones. And yes plenty of honing oil and cleaning several times during the process as the oil and aluminum dust will build up throwing off your measurements.
Ridged hone removes both taper and ovaling of the cylinder where a flex just magnify these.