Thursday, May 3, 2012
MIT celebrates Parag Pathak
...
In 2003, New York City schools chancellor Joel Klein, who wanted to revamp the school-choice system, approached a Harvard University professor named Alvin Roth about the problem. Roth had studied the method for matching medical students to their residencies; New York officials hoped something similar would work for their school system.
In turn, Roth asked Pathak, then a first-year PhD student in economics, to look into New York’s school-choice system: Was it a substantive and interesting problem? Pathak decided it was. A decade later, he is still producing new research on the topic, and in 2011 received tenure at MIT, in part because of his work in the area.
Moreover, that work has produced real-world results. Based on the research of Roth and his collaborators, New York City soon adopted what is known as a “deferred-acceptance algorithm” to assign places. Then, Roth’s group, now including economist Tayfun Sonmez, helped Boston review its choice system, leading the city to adopt a new method in 2005.
Using this method, schools first weigh all the students listing those schools as first-choice venues; then, the students who are rejected are essentially allowed to revise their lists, and the process repeats until every student has been matched with a school selection. The crucial difference is that students and families can simply pick the schools they most want to attend, in order.
“Our whole agenda is to try to make these systems strategy-proof,” says Pathak, now an associate professor of economics at MIT. “All these methods move in the direction of simplifying the system for students.” Complicated tactical guesses about popularity are moot; the entire process is based on the substantive merits of schools.
This positive outcome, Pathak says, is the fruit of “trying to think of economics as an engineering discipline,” in order to construct practical solutions to real-world problems.
Within economics, his growing area of specialization is known as “market design.” Beyond schools, market-design problems can be found in health care, financial markets, even the process of keyword searching on the Internet. “These allocation problems are everywhere,” says Pathak, who now also studies school-performance questions and has produced papers examining the quirks of housing markets.
What makes schools good?
"Pathak is the son of Nepalese parents who immigrated to the United States in the 1970s. He grew up in Corning, N.Y., where his father is a doctor and his mother a writer, before attending Harvard as an undergraduate. A direct line can be drawn between Pathak’s career and a class he took during his senior year at Harvard in the spring of 2002, team-taught by Roth and Paul Milgrom, two leaders in market design; Milgrom advised the Federal Communications Commission on the design of their broadcasting-spectrum auctions.
Pathak, an applied mathematics major who graduated summa cum laude from Harvard, says that class allowed him to recognize the possibility of linking game theory with practical problems. He soon enrolled in graduate school in economics at Harvard, received his PhD in 2007 and joined MIT in 2008.
Since then, Pathak’s research on school-choice issues has expanded in part because other places, including Chicago and much of England, have adopted systems similar to the ones he endorses — but due to their own initiative. “It’s as if they followed the discussion in Boston, although there is no evidence of it,” Pathak says. “It’s a great story of how markets evolve.”
Although strategy-proof systems are gaining in popularity, many cities do not employ them. And yet Pathak believes that in addition to making the selection process simpler, the new systems can lead to a virtuous circle in assessing school quality: If administrators know what students’ real preferences are — as opposed to their tactics-based selections — they can examine what makes certain schools popular and try to institute those elements of good schools in other places, too.
“If we have programs that are oversubscribed, we should figure out why and consider replicating them,” Pathak says.
To be sure, it can be very difficult for people to assess whether or not schools are good in the first place, and for what reasons. In part because of this, Pathak’s interests have developed to include measuring school performance. Along with MIT economists Joshua Angrist and David Autor, he is a founding director of the School Effectiveness &; Inequality Institute at MIT, a new center that launched this year.
Angrist, Pathak and a variety of co-authors have published multiple studies about the performance of charter schools in Massachusetts, for instance, using random samples of students from schools’ admissions lotteries. While recognizing that this can be a “politically charged” issue, Pathak says their aim is simply to shine some empirical light on the matter. So far, the results they have found are nuanced: Some charter schools in urban areas such as Boston have dramatically improved student performance, but charter schools in other parts of Massachusetts have generally performed worse than their non-charter public counterparts.
The researchers are still trying to determine exactly why this is, and aim to expand their studies geographically. But the technical expertise of Pathak and Angrist — a pioneer in developing and refining “natural experiments” in economics — makes them confident they can rigorously equitably assess thorny questions about student performance.
“Through school assignment, we have an engine to measure a lot of things about education production,” Pathak says. And now, students have a vehicle for choosing schools on their merits.
********
Let me add that, along with Atila Abdulkadiroglu and Neil Dorosin and yours truly, Parag continues to assist school districts in the design and implementation of school choice systems via the Institute for Innovation in Public School Choice (IIPSC).
Friday, April 20, 2018
Parag Pathak wins the American Economic Association's Clark Medal
Parag Pathak, Clark Medalist 2018
Parag Pathak |
See my earlier posts involving Pathak here.
Congratulations Parag, on a well deserved award!
*********
Update:
Here's MIT's celebration of Parag:
Parag Pathak wins John Bates Clark Medal
MIT economist lauded for work on education, market-design mechanisms.
*************
here's an interview with Parag in the WSJ
Q&A: How an Economist Unlocked Hidden Truths About School Choice
Parag Pathak of MIT, winner of the John Bates Clark Medal for the nation’s most impressive economist under 40, says he 'fell into the topic'
Here's the Economist's coverage:
A market-design economist wins the John Bates Clark medal
Parag Pathak’s market designs have influenced the lives of 1m schoolchildren
Here's the local angle:
Corning native wins John Bates Clark Medal
"The American Economic Association recently announced its decision to award the Clark Medal to Dr. Parag Pathak, a Corning native and graduate of Corning-Painted Post High School."
Wednesday, December 9, 2020
Top trading cycles (and recollections of New Orleans), in AER:Insights, by Abdulkadiroğlu, Che, Pathak, Roth and Tercieux
A decade ago I was part of the team that designed the new school choice system for the New Orleans Recovery School District. On the District side, the effort was led by Gabriela (Gaby) Fighetti. The design team was organized by the (then) Institute for Innovation in Public School Choice (IIPSC), led by Neil Dorosin. The heavy lifting on the design was done by Atila Abdulkadiroğlu and Parag Pathak. Until the district expanded and developed more complex requirements for expressing priorities (and we had to switch to a deferred acceptance algorithm) the design was based on a top trading cycles (TTC) mechanism. It was the first time I know of that TTC was adopted and deployed in a widely used market design. It came to be called OneApp (since it replaced the old system of applications to each school with one application followed by the matching algorithm).
Some of the data from that system make their way into this new (primarily theory) paper, about some of the distinctive virtues of top trading cycles. The paper itself is a merged effort between the New Orleans design team, and work on TTC initiated separately by various combinations of Che, Tercieux and Abdulkadiroğlu.
Efficiency, Justified Envy, and Incentives in Priority-Based Matching†
By Atila Abdulkadiroğlu, Yeon-Koo Che, Parag A. Pathak, Alvin E. Roth and Olivier Tercieux,
American Economic Review: Insights, December, 2020, 2, (4), 425–442.
Abstract: Top Trading cycles (TTC) is Pareto efficient and strategy-proof in priority-based matching, but so are other mechanisms including serial dictatorship. We show that TTC minimizes justified envy among all Pareto-efficient and strategy-proof mechanisms in one-to-one matching. In many-to-one matching, TTC admits less justified envy than serial dictatorship in an average sense. Empirical evidence from New Orleans OneApp and Boston Public Schools shows that TTC has significantly less justified envy than serial dictatorship.
The first footnote of the paper suggests something of it's long history, and says in part:
"This paper supersedes “The Role of Priorities in Assigning Indivisible Objects: A Characterization of Top Trading Cycles,” cited by others as Abdulkadiroglu, Atila, and ˇ Yeon-Koo Che (2010) or Abdulkadiroglu, Atila, ˇ Yeon-Koo Che, and Olivier Tercieux (2010), and “Minimizing Justified Envy in School Choice: The Design of New Orleans’ OneApp” (2017) by Abdulkadiroglu, Atila, ˇ Yeon-Koo Che, Parag A. Pathak, Alvin E. Roth, and Olivier Tercieux. Roth is a member of the scientific advisory board of the Institute for Innovation in Public School Choice (IIPSC). IIPSC was involved in designing OneApp in New Orleans. Abdulkadiroglu, Pathak, and Roth also advised Boston Public Schools and New York City’s Department of Education on designing their student assignment systems, discussed herein. This article does not represent the views of the New Orleans Recovery School District or any other school district."
And here's a paragraph that offers a different kind of historical context:
"In 2011–2012, the New Orleans Recovery School District pioneered a unified enrollment process called OneApp, integrating admissions to all types of schools under a single offer system. Officials identified three major priority groups: sibling, applying from a closing school, and geography. The discussion about mechanism centered on the trade-off between efficiency and eliminating justified envy, and eventually TTC was selected based on the desire for “as many students as possible to get into their top choice school” (New Orleans Recovery School District 2012a). Vanacore (2011) and Vanacore (2012) provide additional details."
In conclusion:
"In the field, there is growing momentum for DA over TTC (see Abdulkadiroglu 2013 and Pathak 2017). This trend may be driven by a first-mover advantage of DA and its use in other contexts. New York City and Boston adopted DA in 2003 and 2005, and DA is widely used in residency matching (Roth and Peranson 1999). In 2013, New Orleans also switched from TTC to DA. One of the most important reasons for this switch involved challenges in explaining how TTC handles priorities. Under DA, officials could explain that an applicant did not obtain an assignment at a higher ranked seat because another applicant with higher priority was assigned to that seat. At the time of the change, a clear explanation of how TTC reflects priorities was not available.
"It remains to be seen whether TTC will be used in the field again. But policymakers cannot ignore efficiency, which TTC delivers but DA does not. For this reason, TTC should remain a serious policy option. Our formal results may make it easier to explain how TTC incorporates priorities. It’s possible that TTC would have been chosen in some settings with knowledge of this result, and at the very least, advocates now have a new argument in its favor."
************
Some long ago posts on school choice in New Orleans:
Saturday, November 19, 2011
Thursday, February 2, 2012
Tuesday, February 7, 2012
New Orleans launches its new school choice process
Tuesday, April 17, 2012
School Choice in New Orleans with top trading cycles
Friday, May 11, 2012
Thursday, September 27, 2012
Friday, February 15, 2013
Sunday, May 12, 2013
Looking back at the first year of New Orleans' One App school choice system
Tuesday, October 1, 2013
Tuesday, August 18, 2015
A look back at school choice in New Orleans
Tuesday, February 6, 2018
A landmark market design paper, on school choice in NYC, by Abdulkadiroglu, Agarwal, and Pathak
So I find myself thinking again about this paper from the December AER that I already blogged about:
Abdulkadiroglu, Atila, Nikhil Agarwal, and Parag A. Pathak, “The WelfareEffects of Coordinated Assignment: Evidence from the New York City High SchoolMatch,”American Economic Review, 107(12), December 2017, 3635–3689.
I think of it as the third of three papers: the first two were about the engineering aspects of the NYC high school match, the first school choice design of its kind:
Now, in this third paper, two of the original designers (Abdulkadiroglu and Pathak) together with one of the new generation of market design investigators (Agarwal) evaluate the impact on students of the current centralized school choice system (it uses a deferred acceptance algorithm) in comparison to the decentralized ("uncoordinated") system it replaced.
The new system produces a stable matching, which good evidence suggests is helpful in keeping the system healthy in the long term in a school system like NYC, in which the school principals are also strategic players. But aside from being long lasting, how good is the system for students?
Using the (ordinal) rank order lists submitted by students in the new system, the paper measures welfare by estimating a cardinal random utility model, with (cardinal) tradeoffs among school attributes being measured in terms of the additional distance a student is willing to travel to be at a more preferred school.
The uncoordinated system suffered from congestion, with many students having to be placed administratively in a school for which they had expressed no preference. They find that these schools were by and large significantly less desirable.
They find that the new system improves welfare over the old by 80% of the gains that could be achieved by a utility-maximizing allocation made independent of other constraints. They further find that changes in the algorithm (e.g. choosing a different stable matching, among the multiple that arise from random tie-breaking) would have very little effect on welfare.
The biggest difference is that under the old system, only about half the students were placed in the "main round" (now occupied by the deferred acceptance algorithm), whereas in the new system this number immediately climbed to over 80% (with some additional subsequent gains). So students who used to be administratively assigned are now largely assigned instead to a school over which they have expressed a preference. That turns out to be very good for them.
Market design is coming of age...
###########
* Of course, not all steps in the market design process have to be accomplished by the same individuals, but in this case that's an extra plus. And of course other school choice markets have been investigated by these and other investigators, but in most cases those markets were not designed by economists, so that's another extra bonus here too, especially since features of the design (which encourage truthful reporting of preferences) add to the ability to estimate welfare gains.
Friday, August 4, 2017
Data access makes research on schools (and school choice) hard
Who Gets Access to School Data? A Case Study in How Privacy, Politics & Budget Pressures Can Affect Education Research by Matt Barnum
"Just who gets access to education data? A case study in La. after a critical early study on school vouchers"
"In the early days of 2016, a study by MIT and Duke University researchers showing the first year of Louisiana’s school voucher program led to marked decreases in student achievement landed in the press and policy worlds with a degree of attention that went beyond the usual wonky provinces of education research.
...
"John White, the state’s high-profile schools superintendent whose pro-school choice policies had long been scrutinized, publicly accused the Duke and MIT researchers of improperly rushing to publish their results and The Wall Street Journal condemned them for similar reasons in an editorial.
The Chutzpah of Abdulkadiroglu, Pathak, and Walters
A comment by Christopher Walters points to this reply by Abdulkadiroglu, Pathak, and Walters:
Statement on Allegations of Academic Fraud by Jay P. Greene
Atila Abdulkadiroglu, Duke; Parag Pathak, MIT; Christopher Walters, UC Berkeley
August 5, 2017
Sunday, October 22, 2017
Matching and more: Continuing Education at the AEA meetings in Philadelphia
2018 Continuing Education, January 7-9, 2018, Sheraton Philadelphia Downtown
Matching Market Design
Machine Learning and Econometrics
DSGE Models and the Role of Finance
Sunday, December 6, 2015
Improving Schools in MA: conference in Boston tomorrow
Leveraging Research and Policy to Improve K-12 Education in Massachusetts
600 Atlantic Ave #100
Boston, MA 02210
Mary Burke, Federal Reserve Bank of Boston
Robert Triest, Federal Reserve Bank of Boston
Joshua Angrist, MIT and SEII
Parag Pathak, MIT and SEII
Friday, June 8, 2018
Parag Pathak interview on designing theories for the real world
Designing theories for the real world
The AEA interviews 2018 John Bates Clark Medalist Parag Pathak.
by Chris Fleisher
Thursday, May 12, 2016
NBER Market Design: 2016 Methods Lectures, Tuesday July 26 (Abdulkadiroglu, Agarwal, Ashlagi, Pathak, and Roth)
The program for the whole week is here, and below is the Tuesday afternoon Market Design program.
NBER Market Design: 2016 Methods Lectures
| ||
1:15 pm
|
Welcome
| |
1:20 pm
|
Al Roth: Game Theory and Market Design
| |
2:05 pm
|
Parag Pathak and Atila Abdulkadiroglu: Design of Matching Markets
| |
2:50 pm
|
Break
| |
3:00 pm
|
Atila Abdulkadiroglu and Parag Pathak: Research Design meets Market Design
| |
3:45 pm
|
Nikhil Agarwal: Revealed Preference Analysis in Matching Markets
| |
4:30 pm
|
Break
| |
4:40 pm
|
Itai Ashlagi: Matching Dynamics and Computation
| |
5:30 pm
|
Adjourn
|
Thursday, October 3, 2019
Parag Pathak celebrated in Science News
Parag Pathak uses data and algorithms to make public education fairer
After designing school choice systems, he’s studying student performance
(https://www.sciencenews.org/article/parag-pathak-sn-10-scientists-to-watch)
"If he could be granted one wish, he says he would design a school system from scratch. How, he asks, would you set up that system to be as equitable as possible?"
Friday, January 2, 2015
The effect of charter schools in New Orleans and Boston: Abdulkadiroglu, Angrist, Hull and Pathak
CHARTERS WITHOUT LOTTERIES: TESTING TAKEOVERS IN NEW ORLEANS AND BOSTON
Atila Abdulkadiroğlu, Joshua D. Angrist, Peter D. Hull, and Parag A. Pathak
Working Paper 20792
http://www.nber.org/papers/w20792
ABSTRACT
Lottery estimates suggest oversubscribed urban charter schools boost student achievement markedly. But these estimates needn’t capture treatment effects for students who haven’t applied to charter schools or for students attending charters for which demand is weak. This paper reports estimates of the effect of charter school attendance on middle-schoolers in charter takeovers in New Orleans and Boston. Takeovers are traditional public schools that close and then re-open as charter schools. Students enrolled in the schools designated for closure are eligible for “grandfathering” into the new schools; that is, they are guaranteed seats. We use this fact to construct instrumental variables estimates of the effects of passive charter attendance: the grandfathering instrument compares students at schools designated for takeover with students who appear similar at baseline and who were attending similar schools not yet closed, while adjusting for possible violations of the exclusion restriction in such comparisons. Estimates for a large sample of takeover schools in the New Orleans Recovery School District show substantial gains from takeover enrollment. In Boston, where we can compare grandfathering and lottery estimates for a middle school, grandfathered students see achievement gains at least as large as the gains for students assigned seats in lotteries. Larger reading gains for grandfathering compliers are explained by a worse non-charter fallback.
*************
School choice in New Orleans is one of the design projects undertaken by the Institute for Innovation in Public School Choice (IIPSC).
The design of Boston's school choice system predated IIPSC; here's an early paper on that: The Boston Public School Match.
Thursday, September 8, 2016
The NBER market design lectures from the 2016 Summer Institute (Videos)
Summer Institute 2016 Methods Lectures
Lecturers: Al Roth, Parag Pathak, Atila Abdulkadiroglu, Nikhil Agarwal, Itai Ashlagi
Reading List
Al Roth
Game Theory and Market Design
You can download this video from here
Parag Pathak
Design of Matching Markets
You can download this video from here
Atila Abdulkadiroglu
Research Design meets Market Design
You can download this video from here
Nikhil Agarwal
Revealed Preference Analysis in Matching Markets
You can download this video from here
Itai Ashlagi
Matching Dynamics and Computation
You can download this video from here And you can see a short introductory video in which I am interviewed about market design here (and for the time being on the NBER home page, http://nber.org/).