Interferon regulatory factors (IRFs) play functionally diverse roles in the transcriptional regulation of the immune system. We have previously shown that several IRFs are regulators of adipogenesis and that IRF4 is a critical transcriptional regulator of adipocyte lipid handling. However, the functional role of IRF4 in adipose tissue macrophages (ATMs) remains unclear, despite high expression there. Here we show that IRF4 expression is regulated in primary macrophages and in ATMs of high-fat diet–induced obese mice. Irf4^−/− macrophages produce higher levels of proinflammatory cytokines, including interleukin-1β and tumor necrosis factor-α, in response to fatty acids. In coculture experiments, IRF4 deletion in macrophages leads to reduced insulin signaling and glucose uptake in 3T3-L1 adipocytes. To determine the macrophage-specific function of IRF4 in the context of obesity, we generated myeloid cell–specific IRF4 knockout mice, which develop significant insulin resistance on a high-fat diet, despite no difference in adiposity. This phenotype is associated with increased expression of inflammatory genes and decreased insulin signaling in adipose tissue, skeletal muscle, and liver. Furthermore, Irf4^−/− ATMs express markers suggestive of enhanced M1 polarization. These findings indicate that IRF4 is a negative regulator of inflammation in diet-induced obesity, in part through regulation of macrophage polarization.