Believe it or not rust residue does build up in glass vases. This is due to the fact that oxygen combined with water gives way to oxidation. If rust finds its way to your glass vase, there is steps that you can take to remove the unsightly brown tinge.