You can remove the solenoid and will probably find a bunch of metal slivers stuck to it. This is your fuel pump coming apart, and the metal is holding the solenoid open. If you can get a wrench on the solenoid but it is really stuck bad, take a punch and hammer and smack the flats in direction of rotation , this will help free it up. Generally you can clean the metal off and it will shut down fine for a while. It may run a long time like this or may not.
A johnson