Purge unused values in Filters


I've created a filter. When I try to select which values I want to display the list shows values that are no longer in use. I've deleted all rows with this value. The list is getting quite long and I'd like to purge unused values. I've tried refreshing and saving but no luck.