Glycosaminoglycans (GAGs) are natural, linear and negatively charged heteropolysaccharides which are incident in every mammalian tissue. They consist of repeating disaccharide units, which are composed of either sulfated or non-sulfated monosaccharides. Depending on tissue types, GAGs exhibit structural heterogeneity such as the position and degree of sulfation or within their disaccharide units composition being heparin, heparan sulfate, chondroitine sulfate, dermatan sulfate, keratan sulfate, and hyaluronic acid. They are covalently linked to a core protein (proteoglycans) or as free chains (hyaluronan). GAGs affect cell properties and functions either by direct interaction with cell receptors or by sequestration of growth factors. These evidences of divert biological roles of GAGs make their characterization at cell and tissue levels of importance. Thus, non-invasive techniques are interesting to investigate, to qualitatively and quantitatively characterize GAGs in vitro in order to use them as diagnostic biomarkers and/or as therapeutic targets in several human diseases including cancer. Infrared and Raman microspectroscopies and imaging are sensitive enough to differentiate and classify GAG types and subtypes in spite of their close molecular structures. Spectroscopic markers characteristic of reference GAG molecules were identified. Beyond these investigations of the standard GAG spectral signature, infrared and Raman spectral signatures of GAG were searched in complex biological systems like cells. The aim of the present review is to describe the implementation of these complementary vibrational spectroscopy techniques, and to discuss their potentials, advantages and disadvantages for GAG analysis. In addition, this review presents new data as we show for the first time GAG infrared and Raman spectral signatures from conditioned media and live cells, respectively.