You should be able to find and select the object(s) in the Name Gallery.

Then just apply a different color to that object and you should be able to delete the named color.