Remove this item when it is no longer applied