Brown adipose tissue helps to maintain body temperature in hibernators, rodents and neonatal mammals by converting lipids and glucose into heat, thereby increasing energy expenditure. In addition to classical brown adipocytes, adult rodents—like adult humans—harbour brown-like adipocytes in the predominantly white adipose tissue. The formation of these brite (brown-in-white) adipocytes is a physiological response to chronic cold and their cellular origin is under debate. We show here that cold-induced formation of brite adipocytes in mice is reversed within 5 weeks of warm adaptation, but the brite adipocytes formed by cold stimulation are not eliminated. Genetic tracing and transcriptional characterization of isolated adipocytes demonstrates that they are converted into cells with the morphology and gene expression pattern of white adipocytes. Moreover, these white-typical adipocytes can convert into brite adipocytes on additional cold stimulation. Shifting the balance of this interconversion from the white towards the brite phenotype might provide a new means of counteracting obesity by increasing energy expenditure.