From applying for jobs, to signaling for interviews, through interviews, flyouts, offers and the scramble, John Cawley, the chair of the American Economic Association's Committee on the Job Market has measured advice in this video. If you're on the market this year, do yourself a favor (pour a stiff drink) and listen, not just to the beginning discussion of disruptions in demand thisyear, but to the whole thing.
Friday, October 10, 2025
Thursday, May 23, 2024
Social Media and Job Market Success: A Field Experiment on Twitter, by Qiu, Chen, Cohn, and Roth
Here's a new working paper on SSRN:
Social Media and Job Market Success: A Field Experiment on Twitter, by Jingyi Qiu, Yan Chen, Alain Cohn, and Alvin E. Roth, May 20, 2024
"Abstract: We conducted a field experiment on Twitter to examine the impact of social media promotion on job market outcomes in economics. Half of the 519 job market papers tweeted from our research account were randomly assigned to be quote-tweeted by prominent economists. Papers assigned to be quote-tweeted received 442% more views and 303% more likes. Moreover, candidates in the treatment group received one additional flyout, with women receiving 0.9 more job offers. These findings suggest that social media promotion can improve the visibility and success of job market candidates, especially for underrepresented groups in economics such as women."
I gather that our paper has gone somewhat viral on twitter, with discussion about whether field experiments on job markets are ethical. That's not a bad discussion to have, and of course we discussed that in the course of planning this experiment. (A similar discussion can and should be be had about any intervention in a market, not just an experiment.*)
Here is what we had to say about that in the paper.
"Despite the positive outcomes, one might question the ethics of our intervention, which randomly promotes a subset of JMPs on social media. However, we observe that senior economists naturally promote their own students and coauthors on Twitter. In comparison, we tweeted every JMP in our sample from our dedicated research account. Furthermore, while 80% of the influencers in our sample come from top 30 institutions, they quote-tweeted JMPs from a broader spectrum of academic institutions, thus allocating attention more equitably. Given that 92% of the JMCs in both the treatment and control groups accepted a job, it is unlikely that our treatment displaced those in the control group. The current focus on diversity, equity, and inclusion suggests that highlighting suitable candidates could potentially expand the number of job openings, making the job market for economists not entirely zero-sum. Lastly, the differential benefit of our treatment for women contributes to fostering a more inclusive economics profession. In summary, we argue that the knowledge gained from our experiment outweighs the potential cost."
*I've been involved in several operational (i.e. not experimental) interventions in job markets, including the job market for new Econ Ph.D.s (e.g. signaling and the scramble): see
Coles, Peter, John H. Cawley, Phillip B. Levine, Muriel Niederle, Alvin E. Roth, and John J. Siegfried, “The Job Market for New Economists: A Market Design Perspective,” Journal of Economic Perspectives, 24,4, Fall 2010, 187-206. https://www.aeaweb.org/articles?id=10.1257/jep.24.4.187
Wednesday, January 5, 2022
The Professional Psychology Match and post-match scramble
Here's an article that (among other things) describes the APPIC Match, and the more recently organized (and regularized) post-Match scramble for unfilled positions.
JenniferA.Erickson Cornish and Jeff Baker
"A Brief History of the Association of Psychology Postdoctoral and Internship Centers: Trends and Directions for the Education and Training of Health Service Psychologists," Training and Education in Professional Psychology
(2021,December20) http://dx.doi.org/10.1037/tep0000401
Abstract: The Association of Psychology Postdoctoral and Internship Centers (APPIC) is the largest health service psychology education and training council in the U.S. and Canada, with approximately 787 internships, 238 postdoctoral programs, and 431 doctoral program associates. APPIC regularly interacts with the other major training councils over the entire developmental graduate sequence from doctoral education through postdoctoral fellowships. All psychology doctoral students in accredited clinical, counseling, and school programs are required to complete an internship in health service psychology, with a significant majority of those students (3,684 in 2021) obtaining those internships via the APPIC match. Although there is no current similar APPIC match for postdoctoral training, APPIC provides selection guidelines for such training and hosts a list of over 1,600 positions available each year.
"A computerized national match began with the 1998–1999selection process (10 years after a less than successful trial led tothe board deciding to discontinue it) in which 2,923 students applied for 2,631 positions, and 83% were matched (Keilin, 2000). This match, overseen by NMS, used an algorithm based on the NationalResidency Match Program (Roth & Peranson, 1999) and was deemed a success in a subsequent survey, although applicants and directors of clinical training were more satisfied than internship training directors (Keilin, 2000). In 2010, due to the leadership of then chair Sharon Berry, Phase II of the match was launched. Phase II brought about significant changes since it allowed applicants additional time to review and apply to another program if unsuccessful in Phase I, gave internship programs additional time to review Phase II applicants in a more thorough manner, and removed much of the fairly chaotic process that was frantic for both applicants and training directors (some of whom had to replace their fax machines due to overload). The former clearinghouse became the PMVS in 2011. The PMVS currently does not include a match but rather lists postings of positions that are still available on the APPIC website, allowing candidates and sites to participate in an informal selection process as needed. The PMVS will become part of the AAPI process in 2022 and will bring some additional order for those programs that still have openings and for trainees who haveeither not matched or were recently able to participate in the match. In2012, the Nobel Prize for Economics was given for the Roth–Peranson Algorithm used in the match by NMS. The match became limited to students from doctoral programs accredited by the APA or Canadian Psychological Association (including those with a site visit scheduled) and in 2021 to APPIC member internship programs. Previously, nonmember programs could participate in the match with the development of“ Provisional” membership; all programs would now have undergone review by the APPIC membership committee prior to participating in the match.
**********
Some historical background:
Roth, A.E. and X. Xing, "Turnaround Time and Bottlenecks in Market Clearing: Decentralized Matching in the Market for Clinical Psychologists," Journal of Political Economy, 105, April 1997, 284-329.
Wednesday, May 13, 2020
College admissions, late in the season
COLLEGE OPENINGS UPDATE: OPTIONS FOR QUALIFIED STUDENTS
"NACAC’s annual College Openings Update: Options for Qualified Students (formerly the Space Availability Survey) is a voluntary listing of NACAC member postsecondary institutions that are still accepting applications from prospective freshman and/or transfer students for the upcoming fall term. Now in its 33rd year, the College Openings Update is designed as a tool for counselors, parents and others assisting students who have not yet completed the college admission process. Typically, colleges will continue to join the update after the May 5 public release date, so check back periodically to see additional colleges still accepting applications."
Wednesday, March 15, 2017
AEA Econ job market scramble is open
Good luck to those on the job market. If you are still looking (for jobs or for economists to hire) this is the week to enter the Scramble.
Economics Job Market "Scramble" for new Ph.D.s
2017 Job Market Scramble Timeline:
The Scramble will open for viewing by registered participants only on March 24, 2017. Scramble viewing will close on April 10, 2017.
Brief Description:
Thursday, August 4, 2016
Reverse college admissions scramble in British clearing
The Telegraph has the story: What are my options if I do better than expected at A-level?
Friday, May 6, 2016
The college admissions scramble is now open: many colleges still accepting applications
College Openings Update 2016
Friday, May 9, 2014
The college admissions scramble
NACAC College Openings Update: Space, Financial Aid and Housing Still Available For Fall 2014
The Update can be viewed at:
These secondary markets, sometimes called scrambles, have a big role to play in matching markets in which participants can only consider a relatively short list of the many participants on the other side of the market. (Fuhito Kojima and Parag Pathak and I showed in passing here that it is to be expected that such markets will have empty positions and unmatched applicants at the end of the initial matching phase...this observation is actually within a proof, see p12 of the online appendix)
Thursday, August 15, 2013
Clearing: the scramble for British university admissions begins today
Clearing 2013: How to play the system
If you don’t get the A-level grades you want on Thursday, don’t panic. Let Andrew Marszal and the Telegraph guide you through clearing and beyond
And even those who have gained or exceeded the required grades will want to keep an eye on clearing – there is still the option of switching to a more competitive course through the parallel “adjustment” process, which carries the advantage of not having to give up your existing offer while you shop around for a better course.
So that’s why, with hundreds of thousands of teenagers making potentially life-altering decisions in the space of just a few days or even hours after receiving their results, the Telegraph has put together a range of exclusive tools to help you negotiate your application. As the exclusive media partner of Ucas, all course vacancy listings will be available only with this newspaper in England and Wales, starting from the morning of A-level results day. There will be further listings published free with your newspaper on August 16, 17 and 29 and September 5.
But bear in mind that clearing places will come and go across the clearing period until September 30, as people turn down offers and universities fill places.
**************
Here's a helpful graphic of whhere the vacant places are: http://www.telegraph.co.uk/education/universityeducation/clearing/10242726/Clearing-2013-graphic-which-universities-have-places.html
Monday, June 3, 2013
2013 Results and Data Book from NRMP’s Main Residency Match
The data book also reports on the second year of the new SOAP scramble, but not in the same detail as last year's report. Last year I predicted that more of the visible action would move to the first round (reflecting more action before the beginning of the official scramble), but this year's data book doesn't give that information.
Here's the press release, though, which gives a good overview of the data, which seem to reflect a successful match year.
- 40,335 registrants (1,958 more)
- 34,355 active applicants (3,000 more)
- 17,487 U.S. allopathic medical school seniors (960 more)
- 2,677 osteopathic medical school students/graduates (317 more, highest ever)
- 5,095 U.S. citizen international medical school students/graduates (U.S. IMGs) (816 more)
- 7,568 non-U.S. citizen international medical school students/graduates (IMGs) (740 more)
- 74.1 percent of all applicants were matched to PGY-1 positions
- 93.7 percent of U.S. allopathic seniors matched to PGY-1 positions; of those, 78.8 percent matched to one of their top three choices
- 53.1 percent of U.S. IMGs were matched to PGY-1 positions, up from 49.1 percent in 2012 and the highest Match rate for this applicant group since 2005
- 47.6 percent PGY-1 Match rate for IMGs, an increase of seven percentage points from 2012
Available residency positions increased to 29,171, 2,399 (9 percent) more than in 2012, when 26,772 positions were offered. The increase is due primarily to implementation of the All In Policy, which resulted in some specialties offering significantly more positions in 2013. Internal Medicine offered 1,000 more positions, Family Medicine offered 297 more, and Pediatrics offered 141 more than the prior year.
Often Match results can be an indicator of competitiveness. This year, several specialties and specialty tracks had 100 percent fill rates:
- Medicine Emergency Medicine
- Pediatrics Primary
- Pediatrics/Psychiatry/Child Psychiatry
- Physical Medicine and Rehabilitation – Post graduate year one (PGY-1)
- Plastic Surgery – Post graduate year two (PGY-2)
- Psychiatry Family Medicine
- Radiation Oncology (PGY-1)
- Thoracic Surgery
- Plastic Surgery: 95.7 percent
- Otolaryngology: 94.5 percent
- Neurological Surgery: 93.1 percent
- Orthopedic Surgery: 91.8 percent
In 2013, a record 1,870 applicants (935 couples) participated in the 2013 Match. They continued to enjoy great success with a match rate of 95.2 percent. Couples have been able to participate together in The Match since 1984. The two partners identify themselves as a couple to the NRMP and submit rank order lists of identical length. The algorithm treats their lists as a unit, matching the couple to the highest linked program choices where both partners match.
The NRMP launched the Match Week SOAP in 2012 to replace the "Scramble" and to streamline the process for unmatched applicants and the directors of unfilled programs. During SOAP, eligible applicants use ERAS® to apply to programs with unfilled positions and offers are extended to applicants based upon the number of unfilled positions remaining in the program.
Conducted annually by the NRMP, The Match uses a computerized mathematical algorithm to align the preferences of applicants with the preferences of residency program directors in order to fill the training positions available at U.S. teaching hospitals. Research on the NRMP algorithm was a basis for Dr. Alvin Roth’s receipt of the 2012 Nobel Prize in Economics.
The National Resident Matching Program® (NRMP®) is a private, non-profit organization established in 1952 at the request of medical students to provide an orderly and fair mechanism for matching the preferences of applicants for U.S. residency positions with the preferences of residency program directors. In addition to the Main Residency Match, the NRMP conducts matches for more than 40 subspecialties. For more information, contact NRMP at 1-866-653-NRMP (6767) or visit http://www.nrmp.org. For interviews, please email cherbert@nrmp.org.
Read more: http://www.digitaljournal.com/pr/1278215#ixzz2V7ttPAqX
Friday, March 15, 2013
Match Day today for new doctors
Here's the Wall Street Journal's anticipatory story: New Doctors Eagerly Await 'Match Day'
"The National Resident Matching Program, the nonprofit group that pairs applicants with openings, expects this year's match to be the largest ever, surpassing last year when 31,355 U.S. and foreign applicants vied for 24,035 first-year residency openings."
Here's the NRMP's press release:
Here's the schedule:
March 15, 2013
|
Match Day! Match results for applicants are posted to Web site at 1:00 p.m. eastern time.
Supplemental Offer and Acceptance Program (SOAP) concludes at 5:00 p.m. eastern time.
|
March 16, 2013
|
Hospitals begin sending letters of appointment to matched applicants after this date.
|
Monday, June 4, 2012
First year of the new medical residency scramble, SOAP
There were 1,100 unfilled first year positions at the end of the main match, and 815 unmatched seniors graduating from U.S. medical schools (and many more unmatched applicants when foreign medical schools are included). Most of the unmatched positions were in family medicine and in "preliminary" rotations in surgery and internal medicine.
After the first day of the SOAP exploding offer process (i.e. after two rounds of exploding offers), only 267 positions remained, and 98 of these remained unfilled. So, most of the action happened the first day.
Medical schools complained that students were asked to "commit" to programs prior to receiving an offer, and thought that rounds should be longer. Residency programs thought rounds should be shorter.
In line with the criticisms of the design offered earlier (see here), I anticipate that next year more students will be asked to "commit" before receiving an offer (even though it's against the rules), and that even more of the action will be concentrated in the first day and the first round, with more of the market shifting out of the formal scramble, either officially or de facto, through the offline "commitment" process....
As I was quoted saying last year (see here), "If it's really, really tempting for people on both sides to break the rules," says Roth, "often the rules get broken."
HT: Nikhil Agarwal
Monday, March 19, 2012
Economics job market scramble opens March 21, 2012
Economics Job Market "Scramble" for new Ph.D.s
The 2012 Job Economics Job Market Scramble registration will open on March 21, 2012.
March 21-28: Registration Period.
March 30-April 10: Scramble Website will open for viewing by registered participants only.
April 11: Scramble Viewing will close.
See the Scramble Guide for more detailed information.
Verified registrants received an email on April 1st with instructions for viewing the prospective Employer and Candidate lists.
Brief Description:
Occasionally prospective employers of new Ph.D. economists exhaust their candidates before hiring someone during the winter/spring "job market" period. Similarly, new economics Ph.D.s seeking a job sometimes find that all of the prospective employers with whom they have interviewed have hired someone else before they have secured an appointment.
To address these problems, the AEA has established a "Job Market Scramble" web site to facilitate communication between employers and job seekers in late spring. In March, employers that continue to have an open position previously listed in Job Openings for Economists (JOE) may post a short notice of its availability (with a link to the JOE listing). Similarly, new or recent economics Ph.D. job seekers still looking for a position may post a short announcement of their continued availability, with a link to their application materials (C.V., papers, references). The web site will open for viewing to those who have listed a position or availability soon after listings close. There is no charge for the "Job Market Scramble."
See the Scramble Guide for more detailed information.
Saturday, October 15, 2011
Online dating, later in life
"If you think online dating is the domain of the young, maybe it’s time to check in with your mother. Now, people 55 and older are visiting American dating sites more than any other age group — up 39 percent in the last three years, according to the Internet tracking firm Experian Hitwise. The No. 2 group? Singles 45 to 54. According to IBISWorld, a market research firm, and the United States Census Bureau, about 37 percent of people 50 and older are unmarried. And the divorce rate among the 50-plus demographic is high. With so many older Americans unattached, living independently into their later years, and increasingly comfortable using the Internet, they, too, are logging on for love.
"And they may be better at finding it than their younger cohorts. Dating industry professionals say that singles in their 20s and 30s are typically focused on marriage and starting a family, while older singles (many of whom have been married before) have a more relaxed approach and are careful to pick companions who share their interests.
“Baby boomers have been one of the fastest-growing demographics for a lot of online dating companies,” said Caitlin Moldvay, an analyst for IBISWorld. The growth comes at the same time that some younger singles (18 to 34) are moving away from dating sites to social networking sites like Facebook as “a proxy for online dating,” said Bill Tancer, the general manager of global research for Experian Marketing Services.
"Greg Liberman, the president and chief executive of Spark Networks — which owns specialty dating sites including JDate, ChristianMingle, BlackSingles, SilverSingles — said that for the first eight months of this year, Spark had a 93 percent increase in new members 50 and older across all of its dating sites, compared with the same span of time last year. “We’re seeing significant growth,” Mr. Liberman said.
"He’s also observed that, while it’s been common for parents to buy dating site memberships for their adult children, now adult children have begun buying memberships for their widowed and divorced parents. Gone is the heyday of personal ads in The New York Review of Books."
Friday, July 15, 2011
The job market in gastrointestinal endoscopy
******
"At 12pm EDT on July 15th, all program directors will send out an email to their top
choice. The fellow will then have 1 hour to decide if they wish to take that position or
wait for other offers. Please send a return email confirming that you got the offer.
You may respond at any time during that hour, ideally as soon as you make your
decision. If you do not respond within that hour, the program director may move on to
their second choice, so please respond within the hour.
"One of 2 things will then happen once you respond:
1. If you have chosen the offer, and send an affirmative email, the program
director will then send an email ASAP to all of its other applicants to
alert them that the spot has been filled, so that other applicants will be
aware that that position at that particular institution is no longer
available.
2. If you chose to reject the offer, please alert the program director via email
ASAP, so that the program director can then make an offer to the next
applicant on the list.
"If after the 15th (and the weekend of the 16th-17th) you do not have a position, please
go to the ASGE AEF website, and a list of programs with open positions will be
posted so that you may contact any of them if you like.
"I know that this non-electronic “match” is not ideal, but until we adopt an electronic
match (hopefully next year) we hope this format works without too many glitches."
******
Note that this is a system of "exploding offers", so one can expect some communication between participants before the appointed hour... (See also the discussion of similar problems I anticipate in the proposed new rules for the residency scramble (SOAP)).
Gastroenterology fellowships enjoy a successful match, so it seems reasonable to speculate that the fellowship in advanced endoscopy will turn to one after trying this.
Tuesday, June 21, 2011
Report of the economics Job Market Committee in the May AER
I. Signaling;
"The number of participating job candidates held steady at roughly 1,000 signalers per year. About two-thirds of those in the job market signal each year."
...
"We note that at least a small number of ads in JOE this season solicit signals (e.g., “Candidates will be interviewed at ASSA (Denver) and are encouraged to use AEA signaling”).
II. Scramble;
"Survey results indicate that about half of the employers who register for the scramble initiate an interview as a result of the scramble. It is difficult to count the number of job placements initiated by the scramble. For the 2009–2010 job market, it appears that there were at least 15 job placements facilitated by the scramble."
III. Letters of Reference;
"The Committee is keeping an eye on the proliferation of websites to which letters of reference for new PhDs have to be uploaded, with many universities having their own sites."
...
"The Job Market Committee has considered whether the AEA ought to recommend a short list of application service providers and suggest that departments use one of just a few Internet portals, eschewing the unique url approach that is so costly. However, economics departments may not always be in a position to override their human resources departments, which seek other advantages by having all the jobs offered by their university handled on the same software. In this case it might be useful to press for common interfaces, so that centralized job market services that provide efficiencies to letter writers could upload letters to centralized university-specific services (many of which depend on only a small numberof software providers).
IV. Applications to Ph.D. programs
"There is a related issue not pertaining to the job market that affects a broader group of economics departments than just those that produce PhDs. It is the PhD admission process.
...
"The problem, even more than in the job market, is that the graduate school admission process usually is not under the control of the economics department. Often the platform and application apply to all PhD programs in the graduate school. The process stands in contrast to law schools and medical schools, which have centralized admissions forms and recommendation procedures. It is ironic that electronic processing of graduate school and job applications has increased the time required to apply and write letters in support of applicants."
***********
Here's our original report:
Peter Coles, John Cawley, Phillip B. Levine, Muriel Niederle, Alvin E. Roth, and John J. Siegfried , " The Job Market for New Economists: A Market Design Perspective," Journal of Economic Perspectives, 24,4 (Fall) 2010, 187-206.
Tuesday, April 12, 2011
Medical residency scramble
"Roth predicts that the rules of the SOAP will be subverted by both programs and applicants eager to match. "If it's really, really tempting for people on both sides to break the rules," says Roth, "often the rules get broken."
Roth suggests that instead of the SOAP, the NRMP and ERAS should institute a properly organized second match during Match Week.
Mona M. Signer, executive director of the NRMP, disagrees with Roth's prediction that decision-making during the SOAP will be strategic. Instead, she predicts that programs and applicants will continue to pursue their best opportunities. Additionally, as with the Match, should a program or applicant violate prescribed rules, sanctions would be imposed.
My previous posts on the residency scramble, and the proposed new rules are here.
Tuesday, March 22, 2011
2011 job market scramble for new economics Ph.D.s
The AEA's Economics job market scramble web page opens for registration tomorrow.
2011 Job Market Scramble Important Dates:
March 30: Registration Closes
April 1-12: Scramble Website will be open for viewing by registered participants only
April 12: Scramble Viewing will close.
And good luck to all still on the market.
Tuesday, November 16, 2010
The Job Market for New Economists: timely JEP article
The Job Market for New Economists: A Market Design Perspective, by Peter Coles, John Cawley, Phillip B. Levine, Muriel Niederle, Alvin E. Roth, and John J. Siegfried (Journal of Economic Perspectives—Volume 24, Number 4—Fall 2010—Pages 187–206)
Tuesday, October 19, 2010
Comment on the proposed NRMP scramble following the resident match
Comment on the NRMP’s “Supplemental Offer and Acceptance Program” Proposed to Replace the Post-Match Scramble by Peter A. Coles, Clayton R. Featherstone, John William Hatfield, Fuhito Kojima, Scott Duke Kominers, Muriel Niederle, Parag A. Pathak, and Alvin E. Roth.
Executive Summary: "Historical precedent and economic principles suggest that the Supplemental Offer and Acceptance Program (SOAP) proposed for the NRMP Scramble will lead to unsatisfactory outcomes by forcing participants to make unnecessarily difficult decisions and giving them strong incentives to break the rules laid out in the SOAP proposal. We suggest, as an alternative Scramble mechanism, that the NRMP run a “Second Match” for the Scramble participants using rules similar to those of the Main Match."
Here's my previous post: Cleaning up the scramble for medical residents with SOAP