This is normal and is the reason that '97 and later trucks have a hydraulic booster system. When the engine is idling the vacuum pump is not keeping up with demand. Pause and let it catch up or just use more pedal pressure for a while. Some people have added additional vacuum storage. The catch22 with that is that it takes longer to run out of vacuum but it also takes longer to recover when you do.