How to Remove Sticky Residue - Cleanipedia Peel off the label Most of the label should now slide off as the glue will have mainly dissolved. Use a sponge or washing up brush to remove the rest. If the label is still resisting, try dipping the sponge in nail varnish remover. Tackle tricky residue If any stickiness remains, soak the glass in diluted vinegar overnight.