If you press F5 after you create the rule, it gets properly removed on the first try afterwards.
So it seems in your practice the first reload after removal is basically seen as the first reload after creation, regardless of whether you reconsidered and already tried to remove it.
The second removal is the first "proper" removal after that first reload, and thus it sticks.
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:57.0) Gecko/20100101 Firefox/57.0