Let H be a Hilbert space of distributions on R-d which contains at least one non-zero element of the Feichtinger algebra S-0 and is continuously embedded in D'. If H is translation and modulation invariant, also in the sense of its norm, then we prove that H = L-2, with the same norm apart from a multiplicative constant.