Removing a specific buff without affecting other buffs?

Let’s say you give a character a +1 speed buff. Is there a way to remove that buff without affecting other buffs that the character might have. Kind of like how the bone bearer applies his buff and then removes it when he dies.