I suppose it could be the filter, but I'd rather suspect a loose connection somewhere that is allowing it to get a bit of entrained air in the fuel system when it's sitting. Once that little bubble goes through, it runs fine, but while it's there it will make it run rough until it clears.