Adipose tissue fibrosis development blocks adipocyte hypertrophy and favors ectopic lipid accumulation. Here, we show that adipose tissue fibrosis is associated with obesity and insulin resistance in humans and mice. Kinetic studies in C3H mice fed a high-fat diet show activation of macrophages and progression of fibrosis along with adipocyte metabolic dysfunction and death. Adipose tissue fibrosis is attenuated by macrophage depletion. Impairment of Toll-like receptor 4 signaling protects mice from obesity-induced fibrosis. The presence of a functional Toll-like receptor 4 on adipose tissue hematopoietic cells is necessary for the initiation of adipose tissue fibrosis. Continuous low-dose infusion of the Toll-like receptor 4 ligand, lipopolysaccharide, promotes adipose tissue fibrosis. Ex vivo, lipopolysaccharide-mediated induction of fibrosis is prevented by antibodies against the profibrotic factor TGFβ1. Together, these results indicate that obesity and endotoxemia favor the development of adipose tissue fibrosis, a condition associated with insulin resistance, through immune cell Toll-like receptor 4.