In the injection pump industry, this is known as "droop". Most pumps have a "droop" screw to put just a
little more tension on the governor springs. This also raises your idle at the same time.
I know that right on the back of my pump, there an acorn nut and beneath that is a little adjustment rod with a stop and a lock nut.
My engine was doing this when I first got it, but not since I adjusted it.
http://www.picturetrail.com/turbokid
1984 3/4 ton Chevy
6BD1TA Isuzu Turbo Diesel (Straight six, 5. 8 Liter, Direct Injected, custom intercooler, Chrome liners, replaceable valve guides and seats, tuftrided crankshaft, big injectors, inline pump, etc. )
With an Allison AT542 and an NP208 TC behind it.
Straightpiped 3" with 4" tip.