Viral replication and latently infected cellular reservoirs persist in HIV-infected patients achieving undetectable plasma virus levels with potent antiretroviral therapy. We exploited a predictable drug resistance mutation in the HIV reverse transcriptase to label and track cells infected during defined intervals of treatment and to identify cells replenished by ongoing replication. Decay rates of subsets of latently HIV-infected cells paradoxically decreased with time since establishment, reflecting heterogeneous lymphocyte activation and clearance. Residual low-level replication can replenish cellular reservoirs; however, it does not account for prolonged clearance rates in patients without detectable viremia. In patients receiving potent antiretroviral therapy, the latent pool has a heterogeneous and dynamic composition that comprises a progressively increasing proportion of stable lymphocytes. Eradication will not be achieved with complete inhibition of viral replication alone.