Background: Data describing patients hospitalized in medical rehabilitation wards after the acute phase of COVID-19 could help to better understand the rehabilitation needs in the current pandemic situation. Methods: Cohort including all patients with COVID-19 hospitalized in a single, large university hospital in Northeast France from 25 February to 30 April 2020. Results: 479 patients were admitted with COVID-19 during the study period, of whom 128 died (26.7%). Among the 351 survivors, 111 were referred to rehabilitation units, including 63 (17.9%) referred to physical and rehabilitation medicine (PRM) units. The median age of patients referred to rehabilitation units was 72 years. Patients who had been in intensive care, or who had had a long hospital stay, required referral to PRM units. Two biomarkers were associated with referral to rehabilitation units, namely, elevated troponin (p = 0.03) and impaired renal function (p = 0.03). Age was associated with referral to PRM units (p = 0.001). Conclusions: Almost one-third of COVID-19 patients required post-acute care, but only one-fifth had access to PRM units. The optimal strategy for post-acute management of COVID-19 patients remains to be determined. The need for rehabilitation wards during a pandemic is a primary concern in enabling the long-term functioning of infected patients.