Signaling for medical residencies: the first few years

Two papers report on signaling in Otolaryngology and Orthopaedic surgery.

 The Otolaryngology societies have a summary of the current state of affairs that's worth hearing. A number of specialties (including Oto) allow many signals, and these seem to be acting as a soft cap on applications, rather than as a signal of special interest as in specialties that (like Economics) allow only a small number of signals.

Preference Signaling in Otolaryngology—Past, Present, and Future: A Comment From the Society of University Otolaryngologists (SUO), Association of Academic Departments in Otolaryngology (AADO), and the Otolaryngology Program Directors Organization (OPDO)  by Steven D. Pletcher MD, Bradley F. Marple MD, David J. Brown MD, The Laryngoscope Early View,  First published: 04 July 2024  https://doi.org/10.1002/lary.31613

"The year 2020 was a year of change. The residency application process, already suffering from spiraling application numbers,1 now faced the COVID-19 pandemic with a loss of away rotations and apprehension about virtual interviews. In the face of change, the Otolaryngology Program Directors Organization Council (OPDO) approached the leadership of the Association of Academic Departments in Otolaryngology (AADO) and the Society of University Otolaryngologists (SUO) with a recommendation to implement preference signaling. This system, originally described in the economics PhD marketplace,2 allows students a set number of signals (Otolaryngology used 5 in its inaugural year) to send to programs of particular interest. 

...

"Following the lead of Otolaryngology, Urology, General Surgery, Internal Medicine, and Dermatology implemented preference signaling the following year. Since that time, signaling has grown exponentially and is now utilized in the residency application process of nearly every specialty. 

...

"In the 2024-2025 residency application cycle, the evolution of preference signaling continues. Building on Otolaryngology's experience, in the 2023 application cycle Orthopaedic Surgery implemented a high-signal approach, providing applicants with 30 signals. This transition shows promise for reversing the vexing problem of spiraling application numbers—“Big Signaling” has now been adopted by Otolaryngology and four additional specialties the majority of whom have shown a 25%–30% decrease in applications submitted per student saving students a combined $2.5 million in application fees alone. Obstetrics and Gynecology has piloted a tiered signaling system, providing three gold and 15 silver signals to their students. 

...

"Because the number of signals received by programs is not publicized, students are unable to reliably target programs where their signals are less likely to be diluted by competing signals. Specialties should consider providing voluntary “signal cohort” (i.e., my program received between 75 and 100 signals in the 2024 application cycle) data to help applicants make more informed signal decisions and programs with low signal numbers will likely attract additional candidates. 

...

"One of the key statistics to guide applicants in high signal specialties is the interview offer rate for non-signal applications: this helps define the value of applications beyond the set number of signals."

########

Preference Signaling in the Orthopaedic Surgery Match: Applicant and Residency Program Attitudes, Behaviors, and Outcomes, by Guthrie, Stuart Trent MD, FAOA1,a; Dagher, Tanios BSE2; Essey-Stapleton, Jodi MS, MEd3; Balach, Tessa MD, FAOA2,  JBJS Open Access 9(2):e23.00146, April-June 2024. | DOI: 10.2106/JBJS.OA.23.00146

"In the first year of preference signaling, applicants reported applying to 16% fewer programs than if preference signaling had not been available. These results align with AAMC data, which report applications per program dropping 17.4% (from an average of 639.6 to 774.6), and applications per applicant dropping to 76.9 from 86.07,8. Further changes could occur in future cycles as students become more accustomed to the influence of signaling on their application."