Effects of 1 MeV electron irradiation on Xe precipitates in Al, formed by ion implantation, have been observed in situ by high-voltage transmission electron microscopy. Individual Xe precipitates undergo melting and recrystallization, migration which leads to coalescence, and shape changes. These processes are driven by the production of defects without either cascade defect production or the introduction of additional Xe atoms. Precipitate migration is due to an irradiation-induced surface diffusion process on the Xe/Al interfaces. Coalescence of close precipitates is enhanced by directed motion as a result of the net displacement of Al atoms out of the volume between them.