Hi speedy,
you want the holes fairly close to the shaft to get maximum pressure on the taper. The further out you go the greater the risk splitting the wheel