Take a look at a fan blade-- It rotates a certain direction to push air out. If you push the air thru backwards, it will rotate backwards. If you had 2 fans plugged in facing each other and unplugged one, it would stop pretty quickly and reverse its rotation.
atmosphere does push, but it's because the piston is creating a vacuum