If it's an early '04, a vacuum leak is a definite possiblity.
The '03 and early '04 automatics have a small electric vacuum pump mounted on the passenger fender, between the battery & firewall.
I think the vacuum line is a small black plastic tube that runs from there to the driver's side along the top edge of the firewall.
If you don't know whether it's an '04 or '04. 5, check out the label on the driver's side of the valve cover. An '04. 5 will say 325 hp. Anything less and it's an '04.
Bob