The 1982 Alcalde notes the Health and Physical Education (HPE) Complex was originally planned for an area west of the coliseum, where the Randel, Spivey, and Vick Houses currently stand.  Containing basketball courts, gymnasiums, an indoor track, and other recreational areas, the building was planned as the modern successor to the two gymnasiums – the Women’s, torn down in 1983, and the Men’s, which the 1984 Alcalde said would be removed shortly after creation of the HPE (it wasn't).

Construction began in 2003 on the Recreational Sports addition, a 26,000 square foot expansion on the western side of the existing building. The new structure, built at a cost of $6.7 Million, houses a larger weight room, indoor climbing wall, and outdoor heated swimming pool, as well as direct access to the original building.