Followup on school choice in San Francisco

My previous post on how school choice is faring in San Francisco was called  School choice in San Francisco: a promise of transparency.  That promise still hasn't been fulfilled.

The idea was that, after the adoption by the school board of a New school choice system in San Francisco, SFUSD decided to implement the new, strategy-proof  "assignment with transfers" choice system itself (San Francisco school choice goes in-house).

School Board member Rachel Norton wrote in a November 9, 2010 blog post that
"Staff did pledge to make the documentation of the algorithm requirements and process flows public by February; I will continue to push to make the assignment algorithm itself open source."

While SFUSD has prepared a number of documents since then, none of them seem to contain a description of the SF school choice algorithm as actually implemented by the staff. All I can find are descriptions of the priorities used for tie-breaking if more children than can be accommodated by a school would otherwise have been assigned there, but no description of the process by which they would have been assigned before tie breaking has to be invoked.

The latest document of that sort, via Rachel Norton's June 1 blog post, is here: Board of Education Policy.
On page 7, under the heading "Method of Allocating Seats," the document states "The SFUSD will replace the diversity index lottery system with an assignment with transfers algorithm that uses school requests from families and the preferences outlined in this student assignment policy."
However the document doesn't describe the assignment with transfers algorithm at all, just the tie breaking priorities.

So...I'm still in the dark about whether SFUSD has actually implemented the choice system the Board adopted, and I bet SF parents and board members are too.
**************

Read more »

San Francisco school choice goes in-house

Those of you who have been following school choice developments here know that, for the past year,  Atila Abdulkadiroglu, Clayton Featherstone, Muriel Niederle, Parag Pathak and I have been helping the San Francisco Unified School District design a new school choice system, which was adopted by the SF School Board last March.

The original plan was that we would continue to offer our services free of charge to implement the software, and then help monitor the effects of the new choice system.

Last week we heard from SFUSD staff that, because of concerns about sharing confidential data for monitoring the effects of the new system, they have decided to do further development in-house, and so will develop software to implement the new design on their own.

The SFUSD staff  have  been left with a sufficiently detailed description of the "assignment with transfers" design the Board  approved to move ahead with it if they wish. But it will take a good deal of care in implementing the new algorithm in software if its desirable properties--strategic simplicity and non wastefulness--are to be realized. (Both of these features were lacking in the old SFUSD assignment system, the one to be replaced.)

Below are links to some of the key developments before last week.

Here is a post with a link to the video of Muriel Niederle presenting the new design that the Board ultimately voted to adopt: SF School Board Meeting, Feb 17: new choice system.
And here is a link to the slides she presented, giving a description (with examples) of the new choice algorithm: Assignment in the SFUSD, and discussions of the features that make it strategically simple, non wasteful, and flexible.

In March 2010 the San Francisco Board of Education unanimously approved the new system. In their March 2010 press release (now here), the SFUSD reported (emphasis added):

"The choice algorithm was designed with the help of a volunteer team of market design experts who have previously been involved in designing choice algorithms for school choice in Boston and New York City. Volunteers from four prominent universities contributed to the effort, including Clayton Featherstone and Muriel Niederle of Stanford University, Atila Abdulkadiroglu of Duke University, Parag Pathak of MIT, and Alvin Roth of Harvard.
“We are pleased that the district has decided to adopt a choice architecture that makes it safe for parents to concentrate their effort on determining which schools they prefer, with confidence that they won’t hurt their chances by listing their preferences truthfully,” said Niederle and Featherstone, the Stanford research team."

A very simple description of the basic assignment with transfer algorithm is given on page 370 of this paper (where it is called "top trading cycles"). Much of the SFUSD school Board debate has focused on what priorities to implement. What is described on page 370 is a simple version of the underlying choice engine into which the priorities go (with a somewhat different description than in Muriel's slides). The priorities can depend on any characteristics of the students (e.g. previous schools, or siblings, or home zip code) or of the school (e.g. neighborhood or historical student composition). But to keep the process strategically simple--to make it safe for families to rank schools according to their true preferences--the priority of a student at a school cannot depend on how that student ranked that school. (If you happen to be the programmer asked to implement this, drop me a line if you run into trouble:)

Some related developments can be followed on the blog of SF Board of Education member Rachel Norton, including this September 15 post on delay in the implementation of the middle school assignment plan: Recap: Assignment committee recommends delay

General background on the theory and practice of designing school choice algorithms can be found here, and my earlier posts on San Francisco schools are here.

Update, 9/30/10: many comments followed the link to this post at The SF K Files
Update 10/2/10: Rachel Norton, the SF Board member/blogger gets emails asking if the new system will be strategy proof, and she says it will be: Reader mail: questions on student assignment

Lowell High School principal resigns in San Francisco, in latest setback for elite high school

Elite public schools, which admit students by exam, are under attack in many places.

In San Francisco, that would be Lowell high school, whose principal has just resigned.  SFGate has the story.

Principal at Lowell High School abruptly resigns, rebuking SFUSD in resignation email  by Joshua Bote

"The principal of Lowell High School — the highly selective, highly controversial school at the center of this year’s San Francisco school board recalls — has resigned, rebuking the school district in a farewell email sent Wednesday.

...

“While I deeply appreciate you all for the community and support I have received in the last three years, the decision to leave SFUSD is solely based on my desire to apply my passion for education in a district that values its students and staff through well organized systems, fiscal responsibility and sound instructional practices as the path towards equity,” Dominguez wrote in the email.

"Statewide budget cuts, due in large part to decreasing student attendance, have hit San Francisco Unified hard this year, with Lowell being affected by a pause of funding to its Advanced Placement program — perhaps where the allusion to “fiscal responsibility” in Dominguez’s email comes from.

"In the past year, Lowell made national headlines when the decision to replace its GPA- and test score-based admissions policy with a districtwide lottery was approved by the previous school board, receiving criticism from parents who said that they were “caught off guard” by the decision. The move, intended to increase racial equity and diversity on campus, was put on hold by a San Francisco court in November 2021."

**************

Here are some earlier related stories about the troubles at Lowell and in SF:

More School Board Drama Looming, as Lowell High Sticks to Lottery-Based Admissions Another Year  2 DECEMBER 2021

"The SFUSD superintendent says there’s not enough time to implement a court order to re-vote on admissions changes at Lowell. That’s likely to further infuriate the alumni groups that sued the district to win that court order."

 ------------

The SF Chronicle covered the first act of this play in three acts:

S.F.'s elite Lowell High School would permanently switch to lottery admission under fast-track proposal  by Jill Tucker  Jan. 30, 2021

"San Francisco’s elite academic public high school would no longer admit students based on top grades and test scores, and instead use a random lottery system for admission, if the school board approves a measure fast-tracked for a vote."

^^^^^^^^^^^^^^^

And here's an earlier post that touches on similar developments in Boston and NYC:

Monday, March 22, 2021

Elite public schools move away from exams

Congestion in SF public school choice

One thing that computerized school choice is supposed to do is reduce congestion that sometimes stops school districts from matching students to schools in a timely way. San Francisco has a computerized system, but they are nevertheless running into congestion this year. SFGate has the story:
High anxiety as SF public school assignments run late, By Nanette Asimov

"A school district glitch has parents biting their nails in San Francisco this week.
Thousands of dollars are on the line for families that are prepared to lay out hefty deposits for private schools by this week’s deadlines — but hope they won’t have to if they can get into a public school of their choice.
The trouble is, the San Francisco Unified School District may not be able to tell them about their public school options, from elementary through high school, before private-school down payments are due Wednesday through Friday. The district missed its March 17 deadline for sending out school-assignment letters because of “unforeseen staffing emergencies,” said spokeswoman Gentle Blythe.
“We have people who haven’t slept in days” trying to make sure that 83,000 school options for 14,000 students are all correct, Blythe said, adding that she can’t reveal more about the problem because of employee confidentiality.
...
"The deadline for private high school deposits is Wednesday at noon for parents applying for financial aid and Friday at noon for those paying full price. Private elementary and middle schools have a Thursday deadline. And although most private schools coordinated their deposit due dates with the public school district this year, the district’s glitch has thrown the careful planning into disarray."
****************

Update: SF school-assignment letters to be mailed out Monday night  By Nanette Asimov Updated 4:19 pm, Monday, March 20, 2017

"The San Francisco district sends out public-school assignments by U.S. mail because “the letters provide the documentation families need to register at school sites and serves to further verify their address,” spokeswoman Gentle Blythe said.
However, parents facing an imminent private-school deadline who haven’t gotten a letter by Tuesday can email enrollinschool@sfusd.edu.
“We will do what we can to help you after March 21,” says a notice on the district’s website."

School choice in San Francisco faces ongoing problems (and not just school choice)

The SF Chronicle has the story:

Why San Francisco needs a full-time school board
By Gail Cornwall, May 17, 2017  

"Ever wonder why the pace of change in public education falls somewhere between inching and crawling in arguably the most progressive, innovative city in the world? San Francisco Unified School District’s red tape and lack of resources are to blame, but there’s also a story of unpaid workers, organizational mutiny and missed opportunity.

Here’s an example: In 2009 the school board set out to redesign its method for assigning students to schools. Though the topic sounds dry, matching thousands of children to seats at more than a hundred programs — while taking into consideration parental preference, geography, diversity and more — involves the sexiest corner of economics: game theory.

Luckily, the board had the assistance of a group representing Harvard, Stanford, Duke and MIT. Nobel Prize winner Alvin Roth, Muriel Niederle, Clayton Featherstone and others proposed helping to create, monitor and adjust a cutting-edge algorithm for free. In March 2010, the board voted unanimously to take the offer.

But that September, district staff sent Roth’s team an email amounting to “Thank you, goodbye.” District officials had decided to instead “develop software to implement the new design on their own,” Roth reported.

Today, the state of the district’s homegrown assignment algorithm, known to parents as “the lottery,” is described by board member Mark Sanchez as “broken” and “untenable,” and by board member Rachel Norton as “probably the biggest policy issue that our community engages with us on.”

Neil Dorosin directs the Institute for Innovation in Public School Choice, a nonprofit Roth and his team formed. When I recently asked Dorosin what kind of personnel would be needed to create an effective school assignment algorithm, he said, “Either a mathematician or an economist who knows about algorithms, and … a software engineer who could operationalize it. I would be stunned if they have that.”

Those who shared these concerns back in 2010 called on district staff to explain themselves. Despite making a pledge to the board to disclose the algorithm developed in-house, by March 2012 staff still hadn’t issued “a complete enough description to [know] … if they in fact implemented the plan … the board adopted,” said Roth.

Lack of compliance with board directives sounds crazy, but Sanchez, who served on the board from 2001 to 2009 and won re-election in November, said it happens all the time. “There are so many examples,” he said.

How could that be possible? Because board members each receive “about $6K a year — and everyone has a full-time job doing something else — they’re just too busy to check in and cajole, Sanchez said. The only thing the board really can do, he said, is fire the superintendent when “a lot of that piles up.”

That’s why Sanchez and San Francisco Supervisor Jane Kim have discussed putting forward a ballot measure to increase school board member compensation. Sanchez said it would give board members “the average beginning pay for a teacher in the Bay Area ... probably ending up at around $45,000” (drawn from the city’s budget, rather than the school district’s). Following the model adopted by Los Angeles in 2006, the full amount would be available only to those who forsake other employment, he said.

Meanwhile, parents fret over the lottery. The long, complex application process — where paperwork is submitted in person in January and decisions are issued in March, then again in May, through three more rounds of supplication and the first two weeks of school — fails low-income families who lack the time or bureaucratic savvy to effectively engage. Those who do manage to navigate the process, one emotional parent told the school board committee Monday night, often find the experience “time-consuming, frustrating and stressful.” Raman Khanna, a member of the Ulloa Elementary School PTA, referred to another outcome: professional “flight.” Because of the lottery, he said, “a lot of the colleagues that I talk to … leave the city or they go to private school.”

Roth’s and Dorosin’s organization has worked with cities across the country to use data and technology to improve school assignment. Dorosin said the nonprofit’s modest fees are often covered by outside grants and other funding. This March they invited SFUSD board members and district officials to reach out again.

The response? The board committee announced Monday it would “not be taking action,” and district staff proposed two timelines for reform: one would give the board two years to articulate a new direction for the assignment system; the other, labeled “if policy development moves quickly,” would still give them a full year to do so and then another 18 months for district staff to implement it. Tommy Williams, a parent who works for the U.S. Army Corps of Engineers, said: “The fact that we’re talking about the 202[0] or 2021 school year is very frustrating.”

Board members could start meeting with national experts with just days’ notice to hash out a broad-strokes plan, but that won’t happen until the fall. “It’s clearly an urgent issue,” Sanchez said, “but it’s one of many, many things that we have to deal with. ... We had to hire a superintendent, and now we’re involved in negotiations for the contract so we wanted to focus on that.”

Rionda Batiste, co-chair of the district’s African American Parent Advisory Council, won many approving head nods at Monday’s meeting when she said: “I don’t understand why this is something that cannot happen simultaneously.”

“If we really wanted to speed things along,” Sanchez told me, “we’d have more meetings. Intuitively, we all know [paying board members] would make things move faster.”


Nationally, school board compensation is all over the board. Connecticut pays nothing, while Florida’s lowest paying county, as of 2014 reportedly offered $24,290 a year. According to the National School Boards Association, approximately 75 percent of small-district school board members serve as volunteers while around 40 percent of large-district ones receive a “modest salary.”

This divide makes sense, because there’s much more work to be done in a district with 50,000 students than one with only a few hundred. When being an effective board member requires a full-time commitment from someone who must already work full-time elsewhere, “it’s a structural problem,” Sanchez said.

A second one resurfaced at Monday’s meeting. Orla O’Keefe, the district’s chief of policy and operations, told the board: “We need a larger number of staff with the technical skills and knowledge needed to complete assignment runs,” including to “[e]xplore leveraging district ... online registration functionality with a potential online application pilot.” In other words, while the board takes its time deciding what major changes to make, district staff propose once again building in-house. Meanwhile, a Nobel Prize-winning economist — and the tools his team has honed — wait in the wings.

Maybe instituting board salaries can buy our elected representatives the time they need to pursue public-private partnerships that bring expertise and manpower to the task of matching students with schools. Hopefully, this time it will be with the support of district staff, such as newly anointed Superintendent Vincent Matthews who, calling the meeting “democracy in action,” said Monday he’s “looking forward to moving this forward.”

Until then, Sanchez said, “It’s in a holding pattern.”

San Francisco's Lowell High School admissions will return to merit-based system

 The SF Chronicle has the latest twist in this involved story over San Francisco's elite Lowell High School.

Lowell High School admissions will return to merit-based system after S.F. school board vote  by Jill Tucker

"After nearly two years of intense and bitter debate, test scores and grades will once again determine which San Francisco students are admitted to Lowell High School after the city’s school board decided to return to the merit-based admission system Wednesday.

"In a 4-3 vote, the school board decided to restore the previous merit process after two years of using a lottery-based system. The vote will now apply to freshman entering in the fall of 2023 as well as future classes, unless the board takes further action in the future to change the admission process.

...

"The board’s decision was the latest inflection point in the nearly two-year saga featuring feuding public officials, a lawsuit and accusations of racism over which students are eligible to attend Lowell, long considered one of the highest-performing public high schools in the country.

"The board first approved a switch to a lottery system in October 2020, citing a lack of academic data given the switch to distance learning earlier that year.

"A board majority then made that decision permanent four months later, citing a lack of diversity and racism at the elite academic schools. But the hurried vote sparked a lawsuit and then a judge’s ruling that the district violated laws related to the Brown Act, which regulate public meetings.

"The board then had to backpedal, reversing the decision before extending the lottery process for another year."

***********

Earlier:

Sunday, April 17, 2022

Lowell High School principal resigns in San Francisco, in latest setback for elite high school

School districts face a multitude of problems

My colleagues and I mostly interact with municipal school districts regarding questions of school choice. But of course school boards and districts have to deal with a whole multitude of problems, some of which sometimes impact their school choice decisions (either directly, or just because some problems are even more pressing).

In NY, Class Sizes Grew in City Despite ’07 Deal to Cut Them.
And here's a story, that in discussing opposition to Mayor Bloomberg's newly nominated schools Chancellor, also provides a good summary of the size of the changes he and Chancellor Joel Klein tackled: Frustrations With Mayor Are Backdrop to Nominee Uproar
     "Mr. Klein took office soon after the State Legislature handed the mayor control of the school system — no one yet knew how it would play out, and few would have imagined the scope of the overhaul that the mayor has since engineered. Mr. Bloomberg had yet to dissolve the 32 school districts that were a bedrock of the system and that, while chronically corrupt in some places, were also a crucial lifeline for parents with questions and concerns.
     "Sure, people who follow such things knew that the Board of Education, once a hotbed of political squabbling, would be replaced by a panel whose majority would be appointed by the mayor. But no one foresaw that if the mayor’s appointees disagreed with his policies they would be fired, as two were on the eve of a controversial panel vote in 2004, rendering the panel toothless. Now that it is clear that mayoral control really means mayoral control, the question of who would execute the mayor’s wishes has taken on more importance. "

Boston also has serious budget problems, which directly affect school choice: School officials in Hub urge closings
"The scenarios following Superintendent Carol R. Johnson’s recommendations last month to close several schools represent the stark realities confronting the school system as it prepares for its fourth consecutive year of budget cutting. The district is projecting a $63 million shortfall for the school year beginning September 2011. Last night, officials said the 2012-13 school year could be even worse, with an anticipated $91 million shortfall...
"The 40-minute financial presentation last night did little to quell the protests from the schools recommended for closure: the East Zone Learning Center, Emerson Elementary, Clap Elementary, Social Justice Academy, and the Engineering School in Hyde Park....
"In January, the school district is expected to raise once again the divisive issue of changing the way the district assigns students to schools after a similar attempt failed two years ago amid public uproar. The effort is intended to reduce busing costs by shrinking the geographic regions from which families can choose schools. If the district comes up with a palatable plan, any savings are not expected to be realized for at least two years."

and
More schools targeted to close in Hub
"The School Committee is slated to vote Dec. 15 on Johnson’s proposal. The committee needs to act quickly because next month parents start submitting their choices of where they want to send their children to school next fall.
...
"But some of those buildings might not sit empty for long. In a separate announcement late yesterday afternoon, Johnson and Mayor Thomas M. Menino said some buildings may be leased to charter schools, which are planning an aggressive expansion in the city."

In San Francisco, there are problems on the school district staff: San Francisco School Administrators Schemed to Take Money, Documents Say
"A group of San Francisco Unified School District administrators, including an associate superintendent, engaged in a long-running scheme to funnel district money into their personal bank accounts via nonprofit community organizations, according to internal documents. "
In short, market design takes place, when it does, amidst a noisy, difficult background, particularly in tough financial times.

Is algebra for 8th graders repugnant because it leads to calculus?

 The tide is shifting back towards teaching algebra in San Francisco middle schools.

The WSJ has the story:

In the Battle Over Early Algebra, Parents Are Winning. After schools prevented students from taking algebra before high school to reduce racial inequities, parents in San Francisco and Cambridge, Mass., pushed back. By Sara Randazzo

"San Francisco’s public school district set off a yearslong fight with parents when it decided to prevent students from taking algebra until high school, an attempt to combat racial inequities in math by waiting until more students were ready.

"Parents in favor of letting students start in middle school launched petitions, a ballot measure and a lawsuit, sparring with school officials over questions of equity and privilege.

"Now, it appears the parents who are pushing for eighth-grade algebra are winning.

"The San Francisco Unified School District said Friday that it would reverse its decade-old policy, a move that comes after a similar recent change by the school system in Cambridge, Mass., home to Harvard University.

"When to start students on algebra is a contentious topic because the subject is the gateway to a series of math classes culminating in calculus, which many see as crucial for STEM careers and selective college admissions. Students aspiring to take calculus before graduating have traditionally begun this sequence in eighth grade.

“A lot of the attention to eighth-grade algebra is based upon the feeling that that’s the point at which the race is won,” said Thurston Domina, an education professor at the University of North Carolina.

"In San Francisco, the district long argued that the policy of restricting algebra to high school wasn’t done to hold children back, but to reduce the inequities that result from sorting students by math ability at too young an age.

...

"Nationally, 48% of Asian students reach calculus before graduation, compared with 22% of white students, 14% of Latino students and 11% of Black students.

...

"Last year, California passed a new math framework that de-emphasizes early algebra access. Earlier drafts discouraged any eighth-grade algebra, citing the San Francisco school district’s policy as a more equitable approach. After hundreds of public comments and rounds of revisions, the final framework says students should accelerate in math if they are ready."

#########

I'm reminded of the wisecrack that says that fundamentalists disapprove of pre-marital sex because it leads to dancing, and they don't like dancing.

In this case, education reformers disapproved of 8th grade algebra because it leads to calculus...

Gail Cornwall responds to the recent NY Times story on SF schools

Gail Cornwall, who follows San Francisco schools, replies to a recent article in the NY Times:

A cautionary tale about linking school choice and segregation

"Late last month, New York Times’ national education reporter Dana Goldstein wrote about public school choice and segregated schools in San Francisco. Headlined San Francisco Had an Ambitious Plan to Tackle School Segregation. It Made It Worse, the story hits several nails squarely on the head.

...

"But there are several important weaknesses in Goldstein’s article that could mislead parents, readers, and policymakers.

"The piece lays blame for segregation at the feet of San Francisco’s citywide public school choice system. It oversimplifies the views and priorities of lower-income non-white families. And, though Goldstein told me it wasn’t meant to, the article seems to endorse a controversial return to a restriction of choice in favor of a form of neighborhood attendance zones."

**********
Here's my earlier post on the NY Times article:

Tuesday, May 7, 2019

School choice in San Francisco--update in the NYT

I've blogged about other articles by Ms. Cornwall.

San Francisco may re-emphasize neighborhood schools in their school choice plan

From the SF Chronicle: Plan's goal: Get S.F. families into neighborhood school

"Unlike families who live in the suburbs, San Francisco residents don't automatically get assigned to the school near their homes.

"The system is built on decades of desegregation efforts and the idea of equal access to all schools.

"It requires families to submit a list of schools that they want their children to attend. If a school has enough spots for the families who want in, there are no issues. But if a school has fewer seats than families who listed it, a complicated tie-breaker system kicks in.

"Siblings of students get the first available seats. Then, families living in census tracts where students post the lowest test scores - which the district calls CTIP, for Census Tract Integration Preference - get second priority. Those in the school's attendance area are third, followed by everyone else.

"Schools like Clarendon, with high test scores, low student poverty and experienced teachers, fill up with siblings and CTIP families, leaving few or no seats for students who live in the neighborhood.

"Norton and Fewer want to flip things so attendance area comes before CTIP, giving higher priority to families who live nearby than to those living in presumably disadvantaged neighborhoods.

"The CTIP tie-breaker, introduced three years ago, was supposed to help diversify schools without specifically using race.

"It didn't work.

"All the board members appreciate diversity and want to eliminate racial isolation in our schools," Fewer said. "We just don't know if the CTIP preference is doing this. It's time to revisit it."


"Data from the past three years show 28 schools - a quarter of all campuses - are still racially isolated, meaning that 60 percent of enrollment is a single ethnic group.

"Instead of creating a big melting pot in schools, a CTIP address has become a golden ticket for families who wanted to attend the city's most popular schools, Norton said. It has also created demand for housing in CTIP areas, with real estate agents promoting those neighborhoods and people lying about their address to get an advantage.

"And even if a family living in a CTIP area were wealthy, it would not matter - they would still get the same high-priority status as someone living in poverty.

"There was no means test, said McCarthy, whose children were assigned to Sanchez Elementary, more than 2 miles from home.

"Someone that makes half a million a year that just bought a $2 million home in the Mission" has a better chance at Clarendon, she said. "That's unfair that they can kind of trump us."

"The CTIP wasn't intended to give an unfair advantage or attract people to buy or rent in certain neighborhoods, Norton said.

"People are making really big life decisions so they can be in a CTIP zone," she added. "That makes me very uneasy."

"In addition, African American and Latino families are less likely to participate in the first round of the school assignment lottery than white or Asian families, which again raises the question of whom the CTIP preference is serving."
*********

Background material: from SFUSD (San Francisco Public Schools).  Student Assignment and Enrollment Reports

School choice in San Francisco--update in the NYT

Here's the NY Times story: San Francisco Had an Ambitious Plan to Tackle School Segregation. It Made It Worse.

“Our current system is broken,” said Stevon Cook, president of the district Board of Education, which, late last year, passed a resolution to overhaul the process. “We’ve inadvertently made the schools more segregated.”
...
"About a quarter of the city’s children are enrolled in private school, a higher percentage than in some other major cities, like New York, where it is around 20 percent. The lottery system is thought to be a major reason wealthy parents here opt out of public schools, further worsening segregation."
**********

The San Francisco Unified School District interacted with market designers some years ago, but ultimately turned down their (our) help and decided to deal with the existing problems in-house.  Here are some old blog posts...

Thursday, September 23, 2010

San Francisco school choice goes in-house

And

Thursday, June 2, 2011

Followup on school choice in San Francisco

School choice in San Francisco, Chicago, and Cambridge MA

Changes in school assignment procedures are being discussed in San Francisco, Chicago, and even Cambridge, MA.

In San Francisco, the redesign is well under way, and the school board has a link to the redesign process: What Have We Done So Far.

An impresssive parent-organized blog outlines the San Francisco Student Assignment system, and the current process intended to reform it, initiated by the San Francisco Unified School District. One of the early posts assembles some of the relevant materials, including the SFUSD page about the Student Assignment Redesign (including some history and legal context), and the
SFUSD technical description of the current Student Assignment Process (which can now be found here).

Chicago has begun to rethink its school choice system; see New Proposed Admission Policy Information


In Cambridge, Parag Pathak proposed that a strategy-proof mechanism replace the old Boston-style mechanism (no longer used in Boston); see School Assigning Process Criticized--MIT professor presents a possible solution to the problem

Interview concerning San Francisco school choice

The San Francisco Briefing Room carries an audio interview by Stan Goldberg with Attila Abdulkadiroglu and me (about 30 minutes): Assignment System at Risk.
Here's his blurb: "With the deadline for submitting applications for school assignment in the San Francisco Unified School District rapidly approaching the school district has advised its independent advisors who were scheduled to program the assignment system for free that their services were not needed. Does this action imperil the implementation of the system on time? Has school district transparency moved back to the dark ages? Here’s the story from the design team’s perspective."


(Here are my previous posts on San Francisco school choice.)

Further followup on school choice in San Francisco

My Thursday post, Followup on school choice in San Francisco, has generated some followup on its own, in the form of an audio interview yesterday of School Board member Rachel Norton by Stan Goldberg who follows the SF school system under the name Senior Dad.  He summarizes the interview as "Straight answers from Commissioner Norton “because people have a right to know”."

The issue is whether the algorithm adopted by the board last year was in fact implemented correctly by the district staff. It's an important question because the correctly implemented algorithm would be strategy proof, and if parents had confidence in this it would vastly simplify the school choice system from parents' point of view.

Here is my very incomplete and possibly imperfect transcript to give the flavor of the last 5 minutes of the interview (starting just after minute 39) in which Stan Goldberg (SG) raises this issue, and Rachel Norton (RN) replies. It's worth listening to.

SG “The school district was supposed to release the algorithm they were assigning students on, and so far they have not released that algorithm.”

RN “you’ve been reading Al Roth’s blog” ...“I’ve advocated for that, and will continue to advocate for that. I don’t think the staff right now wants to do that. [laughter] But short of 5 votes, 4 votes, they don’t have to.

…

SG ‘why should the public trust the school district?  “I’ve had the deputy Superintendent say ‘you guys shouldn’t trust us, we haven’t been reliable’. He said that; I believed him.”

RN “I don’t know what to tell you Sam, I think we should release the algorithm, and I’ve said that to staff, I’ve said that to the Superintendent”…short of 3 other board members joining with me and demanding that it be released the superintendent can do what he thinks is best,  unless he’s ordered by the board to do something else…”

SG “not releasing the algorithm makes everybody think something funny is going on…”

RN” well, not everyone…”

SF School Board Meeting, Feb 17: new choice system

At the latest public meeting of the San Francisco Board of Education (last night, Wednesday, Feb. 17), the commissioners and the public were engaged in a detailed discussion of the algorithms and priorities being proposed for the new school choice system.

Muriel Niederle explains and answers questions about the new Assignment with Transfers school choice plans being proposed (with variations for elementary school, middle school, and high schools). She comes on just after minute 36 of this video of the 3 hour meeting, and her presentation, interspersed with questions and answers, continues for a little over an hour (to minute 1:39), although she's back answering questions at the end again. Also presenting the general plan and answering questions is Orla O'Keefe, the SFUSD official leading the effort to design the new school choice system.

There's something very encouraging about seeing the public policy discussion focusing on choice systems that are non-wasteful (Pareto efficient, for you economists), strategically simple for parents (so that truthful preference revelation is a dominant strategy), and flexible (so that the school board can tweak the system in years to come without harming the first two properties). The 'political' issues are the priorities that different children have at different schools.

Another attractive aspect of the proposal (discussed by Ms. O'Keefe following Muriel's presentation) is that data would be collected each year for continual monitoring of how the choice and assignment system is working.

The discussion touches on a number of interesting questions. (Even if the algorithm makes truthful preference revelation the best strategy, there are still issues of checking e.g. addresses in any system in which priorities at schools depend on home address...). But it looks like SF is well launched on adopting a sensible, workable, well thought out and flexible framework.

School choice in San Francisco, reports on first year

I've written before about school choice in San Francisco, and about how Muriel Niederle and Clayton Featherstone led the effort by a group of our colleagues to design a strategy-proof choice algorithm (explained here at a Board meeting in 2010), based on transfer cycles ("top trading cycles" to game theorists...). The school board adopted the plan, but then the staff of the school district decided to implement it themselves, without making the details public. Fast forward to 2012, when the first children have been assigned by the new plan.

Rachel Norton's blog has a post about it here: They're out! School Assignment Letter 2012, and an earlier one here, with a link to a March 5, 2012 SFUSD report on Student Assignment. As in the previous SFUSD reports, this does not describe the choice algorithm, it only describes the "tie breakers" that are used whenever the algorithm would otherwise try to assign more students to a school than it has room for.

This outraged Stan Goldberg (who reports about SF schools as "Senior Dad"), and he posted a video about the lack of transparency called Assignment System Fraud?

He must be an influential guy, because this prompted SFUSD to post some new information, including this "fact sheet" dated March 23, called How does the student assignment computer program work?  It still doesn't come close to explaining the actual algorithm they use, but it does include a diagram of "transfer cycles."

Which raises a question. If they in fact implemented the plan we proposed and the Board adopted, you would think they would want to make this clear. The benefits of a strategy-proof assignment procedure can only be realized if parents know that they can safely list their true preferences.

On the other hand, if the algorithm isn't correctly implemented, or if some other assignment algorithm is implemented (whether or not it includes some use of transfer cycles) then it would most likely not be strategy-proof, that is, it might not be safe for parents to reveal their true preferences, and it might be in the interest of some to "game the system" in some way. That might account for a desire to keep the algorithm secret. (So might a desire to avoid revealing any inadvertent mistakes in implementation...)

I should say that SFUSD's brief description of their algorithm doesn't look to me like it describes one that is strategy-proof...:(On the contrary, it looks like it might be patched together from something like Boston's old immediate acceptance algorithm followed by some trading...but then again, it isn't a complete enough description to make me confident that it is a description of whatever they are in fact doing...)

Anyway, one point of this post is to say that, unlike the case of the systems in New York and Boston and the work that IIPSC is doing around the country, my colleagues and I don't know what algorithm SFUSD is using, even though we know what we proposed and the Board adopted. So...this post is a bit like the ads that sometimes appeared in the financial sections of newspapers when I was young, which, following a divorce, would announce that Mr John Doe was henceforth no longer responsible for any debts incurred by the former Mrs John Doe...

School choice in SF moves forward

Yesterday Muriel Niederle and Clayton Featherstone were among the presenters to the San Francisco Board of Education, speaking about possible designs for a new school choice system there. It seems that they are well on the way to a good outcome.

One of the Board members, Rachel Norton, has a blog on which she posted before and after accounts of the meeting:
Tonight’s student assignment meeting should be interesting!
Recap: Closing in on a student assignment policy

Here is a video of the whole meeting (but you can navigate a bit so you don't have to watch the full 3 hours: Muriel's testimony, from her slide presentation through answering of questions from the board is from 1:09 to 2:09 on the video).

For the technically inclined, papers about our prior work on school choice systems in NYC and Boston are here.

It has been mentioned in the SF discussions that our team of market designers has worked on a number of problems aside from school choice, so here are background links on some of them for SF readers who are interested:
National Resident Matching Program and related medical labor markets
Gastroenterologists, Orthopaedic surgeons
Kidney Exchange
AEA market for new economists

Return to previous school assignment policies (in some respects) under New York City's new mayor

 In NYC, the pendulum is still swinging between inclusive admissions as measured by demographics and determined by lottery, and meritocratic admissions as measured by tests and grades.

The NYT has the story:

In a Reversal, New York City Tightens Admissions to Some Top Schools. The city loosened selection criteria during the pandemic, policies some parents protested as unfair and others hoped would reduce racial disparities. By Troy Closson

"New York City’s selective middle schools can once again use grades to choose which students to admit, the school chancellor, David C. Banks, announced on Thursday, rolling back a pandemic-era moratorium that had opened the doors of some of the city’s most elite schools to more low-income students.

...

"New York City has used selective admissions for public schools more than any school district in the country. About a third of the city’s 900 or so middle and high schools had some kind of admissions requirement before the pandemic disrupted many measures to sort students by academic performance.

...

"Selective high schools will also be able to prioritize top-performing students.

"The sweeping move will end the random lottery for middle schools, a major shift after the previous administration ended the use of grades and test scores two years ago. At the city’s competitive high schools, where changes widened the pool of eligible applicants, priority for seats will be limited to top students whose grades are an A average.

...

"The announcement came as New York City’s education officials are confronting multiple crises in the wake of the pandemic, complicating a dilemma that has bedeviled previous administrations: how to create more equitable schools, while trying to prevent middle-class families from abandoning the system.

"State standardized test scores released Wednesday showed that many students fell behind, particularly in math, and that many Hispanic, Black and low-income students continue to lag far behind their white, Asian and higher-income peers. At the same time, the district is bleeding students: Roughly 120,000 families have left traditional public schools over the past five years. Some have left the system, and others have gone to charter schools."

*****

And here's the Washington Post:

New York City, embracing merit, rolls back diversity plan for schools By Laura Meckler

"New York City schools announced Thursday they would allow middle schools to consider academics in admitting students to some of the city’s most sought-after programs, unraveling pandemic-era rules aimed at injecting racial and economic diversity into a segregated system.

"High schools would also rely more heavily on merit and less on the luck of a lottery under the new plan, reversing the previous administration’s direction as a new mayor takes command of the nation’s largest school system.

...

"In San Francisco, admissions into the elite Lowell High School were converted from merit-based into a lottery system. As in New York, though, the change was reversed — in this case, after several school board members were recalled, in part over this issue.

"In Northern Virginia, Thomas Jefferson High School for Science and Technology also shifted from an admissions test to a “holistic review” that considers several factors, a move that is being challenged in court and has faced resistance from the Republican governor and his administration.

...

"In New York, the debate is particularly fiery because students are required to apply to middle and high school, and before the pandemic, about a third of the city’s 900 middle and high schools included requirements for admission — such as grades, test scores, attendance and behavior records. 

...

"That system was largely converted into a lottery under Mayor Bill de Blasio.

"For high school, applicants were put into tiers based on their grades. But the top tier included about 60 percent of all students, who had the first crack at the top schools. Competitive schools drew acceptances randomly from this group.

...

"Now, under the new system announced Thursday, it will be harder to get into the top tier, though once in that group, it will still be a lottery. To get into the top tier, students must be in the top 15 percent of their school or of the city overall, and they must have at least a 90 percent on grades.

"Test scores, which had been used for years but also criticized as biased, will not be considered. Banks said exam scores are a flawed measure but grades are “still a very solid indicator of how you are showing up as a student,” even for students who face hardships at home."

New school choice system in San Francisco

Board Approves New Student Assignment System for San Francisco Schools (now here)

Most of the last minute discussion was about what priorities different kinds of students will have at different kinds of schools. That is something that is likely to be adjusted from year to year. But the nice thing is that the underlying choice architecture will make it safe for parents to state their true preferences however the priorities are adjusted.

From the press release: "The choice algorithm was designed with the help of a volunteer team of market design experts who have previously been involved in designing choice algorithms for school choice in Boston and New York City. Volunteers from four prominent universities contributed to the effort, including Clayton Featherstone and Muriel Niederle of Stanford University, Atila Abdulkadiroglu of Duke University, Parag Pathak of MIT, and Alvin Roth of Harvard.
“We are pleased that the district has decided to adopt a choice architecture that makes it safe for parents to concentrate their effort on determining which schools they prefer, with confidence that they won’t hurt their chances by listing their preferences truthfully,” said Niederle and Featherstone, the Stanford research team."

Here are Rachel Norton's comments (she's a school board member with a blog), and here's the story from the SF Chronicle. Here are some of my recent posts on school choice; many of the recent ones tell the SF story as it unfolded.

Now, on to implementation.

New fellows of the Econometric Society

Congratulations to the 42 newly elected Fellows of the Econometric Society. That's up from 29 new Fellows elected in 2023, which is a step towards the goal (about which I blogged last year*) of electing more Fellows.  But elections depend on recognition that isn't equally available to every specialty and geography, so there are still many nominees and others who would be jewels in the crown of the Society.

"The Society is pleased to announce the election of 42 new Fellows of the Econometric Society. The 2024 Fellows of the Econometric Society follow.

Jerome Adda, Bocconi University 

Cristina Arellano, Federal Reserve Bank of Minneapolis (Secondary affiliation: Latin America)

Costas Arkolakis, Yale University

John Asker, University of California, Los Angeles (Secondary affiliation: Australasia)

David Atkin, Massachusetts Institute of Technology

Paul Beaudry, University of British Columbia

Sascha O. Becker, University of Warwick and Monash University

Sandra E. Black, Columbia University

Estelle Cantillon, Universite Libre de Bruxelles

Alessandra Casella, Columbia University

Thomas Chaney, University of Southern California

David Dorn, University of Zurich

Janice Eberly, Northwestern University, Kellogg School of Management

Kfir Eliaz, Tel Aviv University

Erica Field, Duke University

Andrea Galeotti, London Business School

Francisco Gallego, Pontificia Universidad Caatolica de Chile

Maitreesh Ghatak, London School of Economics (Secondary affiliation: Asia)

Olivier Gossner, CNRS - CREST; London School of Economics

Ayşe Ökten İmrohoroğlu, University of Southern California

Henrik Kleven, Princeton University

Kala Krishna, The Pennsylvania State University

Jeanne Lafortune, Pontificia Universidad Catolica de Chile

Francesco Lippi, LUISS University; Einaudi Institute for Economics and Finance

Deborah J. Lucas, Massachusetts Institute of Technology

Annamaria Lusardi, Stanford University

N. Gregory Mankiw, Harvard University

Kalina Manova, University College London

Elena Manresa, New York University

Enrique G. Mendoza, University of Pennsylvania (Secondary affiliation: Latin America)

Ismael Y. Mourifie, Washington University in St Louis (Secondary affiliation: Africa)

Barry Nalebuff, Yale School of Management

Andrew Newman, Boston University

Efe A. Ok, New York University

Guillermo Ordonez, University of Pennsylvania

Maria Petrova, Universitat Pompeu Fabra

Mar Reguant, IAE-CSIC; Northwestern University

Diego Restuccia, University of Toronto

Andrés Rodríguez-Clare, University of California, Berkeley (Secondary affiliation: Latin America)

Andrea Weber, Central European University

Luigi Zingales, University of Chicago Booth School of Business

Gabriel Zucman, Paris School of Economics; University of California, Berkeley

Finally, the Society would like to express its gratitude to the members of the 2024 Fellows Nominating Committee: Jan Eeckhout (chair), Mariacristina De Nardi, Marcela Eslava, Richard Holden, Yuichi Kitamura, Yaw Nyarko, and Nathan Nunn."

 

As I wrote last year, Congratulations again to the new Fellows, who have received the carefully considered and frugally awarded applause of their peers. 

##########

*Last year:

Tuesday, October 10, 2023

Econometric Society Fellows (2023), procedures, and some thoughts on prizes in general