If it's not a stream of fuel, it's ok to drive it. I've had my lift pump off when I had a problem like yours and I thought it was a bad lift pump. It wasn't bad afterall. It's not too bad a job to replace it. When you put the new one on make sure that the cam lobe is on a low spot so you don't have to compress the push rod spring too much. I have no idea what they cost because I have never had to buy one. Take the fuel filter, starter, and front drive shaft off to give yourself room to work.