No, you definitely don't replace the primer bulb on these things. Out it all goes! I have actually kept one of those previously unwanted plain grey caps without the primer because, at least you know you will get a perfect fit around the edges, even if you need to give your right arm more of a workout.
Also, there was the version with the remote primer, which can be replaced, if you can find them these days.
