Recent measurements of cosmic rays by various experiments have found that the energy spectrum of cosmic rays is harder in the TeV region than at GeV energies. The origin of the spectral hardening is not clearly understood. In this paper, we discuss the possibility that the spectral hardening might be due to the effect of re-acceleration of cosmic rays by weak shocks associated with old supernova remnants in the Galaxy.