Learn how to remove marks from your stainless steel appliances using olive oil. 1 Apply a little bit of olive oil to a clean rag and rub the olive oil all over your stainless steel appliance. 2 Fold the rag in half. Make sure that there is no olive oil on the exposed part of the rag. 3 Pour white vinegar onto the rag. 4 Rub the white vinegar soaked rag onto the appliance to remove the olive oil. 5 Using a clean rag, remove all residue from the appliance and let dry.