I haven't found a negative side to my anti-sway bar, I think the truck drives much better empty. I didn't notice it following the road anymore than without, and certainly not as much as tire changes do.
The only roads that I notice it on are the side roads that don't have good pavement or foundation and are not consistently flat. I drive one every day for about 4 miles that is like this and it is particularly bad, so that's why I noticed it. I don't notice it on the highways.