Online labor markets, as an experimental lab

There are a growing number of online labor markets (for a description of a wide range, see Work the New Digital Sweatshops By Jonathan Zittrain).


A recent paper explores their use for conducting experiments: The Online Laboratory: Conducting Experiments in a Real Labor Market by John Horton, David Rand and Richard Zeckhauser . They suggest that Amazon's Mechanical Turk is a convenient venue to do experiments, with some natural advantages (e.g. it's possible to recruit large numbers of participants, who don't need to know they are in an experiment), in which adequate control is possible.


"Abstract: "Online labor markets have great potential as platforms for conducting experiments, as they provide immediate access to a large and diverse subject pool and allow researchers to conduct randomized controlled trials. We argue that online experiments can be just as valid – both internally and externally – as laboratory and field experiments, while requiring far less money and time to design and to conduct. In this paper, we first describe the benefits of conducting experiments in online labor markets; we then use one such market to replicate three classic experiments and confirm their results. We confirm that subjects (1) reverse decisions in response to how a decision-problem is framed, (2) have pro-social preferences (value payoffs to others positively), and (3) respond to priming by altering their choices. We also conduct a labor supply field experiment in which we confirm that workers have upward sloping labor supply curves. In addition to reporting these results, we discuss the unique threats to validity in an online setting and propose methods for coping with these threats. We also discuss the external validity of results from online domains and explain why online results can have external validity equal to or even better than that of traditional methods, depending on the research question. We conclude with our views on the potential role that online experiments can play within the social sciences, and then recommend software development priorities and best practices. "

Renting art at Brandeis

Can a university profit from artwork it owns (that has been donated to it)? Last year Brandeis University raised a storm by proposing to close its museum and sell its art (see my posts here and here.) Now it has proposed renting some of its art (here's the story from the Brandeis student newspaper, The Justice), and that too has generated some criticism. But the Globe thinks renting rather than selling is supportable, here's their editorial:Brandeis: Renting out art for art’s sake

"Brandeis University is raising eyebrows in the museum world with its plans to lend out artworks for money, but exploring this option is a reasonable way to preserve the financially strapped school’s collection.
"Last year, Brandeis considered closing the renowned Rose Art Museum and selling off some of its 7,500 objects. Had that happened, both the school and the region would have been worse off for it. Now, the Globe recently reported, the school is hiring auction house Sotheby’s as a lending broker. Collecting fees from institutions that might want to display some of the museum’s works could generate badly needed funding and might even increase awareness of the Rose as well."

Update: [6:14:18 AM] Bettina Klaus writes "saw your blogpost on renting art and remembered that my Maastricht neighbors are renting some http://www.bonnefanten.nl/en/art_lease (Bonnefanten Art Lease Contemporary art at your home)

The market for shorthand

When I was in high school in New York City in the 1960's, there was a department called Secretarial Studies that taught typing and shorthand (in two flavors, Gregg and Pitman). The students were mostly girls planning on looking for work as secretaries.

Well, recording machines changed the way people dictated letters (and computers of course changed it again), and nowadays the WSJ reports that you need a translator to recover the contents of old shorthand notes:Do You Know, Offhand, Anyone Who Knows Shorthand?As a Skill Fades, Translators Are in Demand; Ms. Sanders Charges 20.5 Cents a Word

It's probably also hard to find someone to repair buggy whips, not to mention recovering files stored in WordPerfect on floppy disks...

If anyone needs someone who once mastered Scribe (since displaced by TeX), let me know.

Heart transplant pro golfer

Until I read the story, I wasn't sure how to parse this AP headline: Heart Transplant Survivor Gets Shot at US Open

It turns out the headline means the golfer Erik Compton got _a_ shot at playing in the Open. He's a survivor of two heart transplants who wants to make a living playing golf. He's one of 156 players in possession of what he calls a Golden Ticket -- a tee time this week at Pebble Beach to play in the U.S. Open."

Universities and culture

A Campus Where Unlearning Is First reports on the challenges facing the American University in Cairo in its quest to offer an American style education to Egyptian students. It starts with what the university president calls "disorientation."

"During disorientation, the students — 85 percent of them Egyptians — are taught to learn in ways quite at odds with the traditional method of teaching in this country, where instructors lecture, students memorize and tests are exercises in regurgitation."


See this earlier post touching on university culture and national culture: Worldwide university rankings, compared to GNP .

Live Liver donation tragedy

The Boston Globe reports: At the Lahey, a stunning, rare tragedy--Donor dies in liver transplant attempt.

"A man who agreed to donate part of his liver to help a sick relative died while undergoing the transplant procedure at Lahey Clinic in Burlington two weeks ago, the hospital said yesterday.

"It was only the third death of an adult living liver donor in the United States in the two decades since the first procedure was done, according to two leading transplant surgeons. A total of 4,036 have been performed.

"While any surgery carries risks, specialists said the death of a living donor is especially upsetting because they are generally young and healthy and are undergoing an operation they do not need for the benefit of a family member or close friend."

..."“The safety of the donor is foremost in everyone’s mind,’’ said Dr. James Markmann, chief of transplant surgery at Massachusetts General Hospital. “It is a very safe operation, but the risk is not zero. If you do enough [of these operations], it will happen. Our thoughts go out to the donor’s family. They did a wonderful thing, and it’s tragic that it ended up this way.’’

"Markmann put the risk of death at one or two in 1,000 operations and said the risks to donors are like those for any type of major surgery, including infection, but generally are less because patients are healthy. He said these risks are weighed against the benefits to recipients: 10 to 15 percent of people waiting for a liver donation die each year because of a shortage of cadaver donors. About 1,500 liver transplant candidates died last year across the United States."

"Dr. Giuliano Testa, director of liver transplantation at the University of Chicago Medical Center, said there have been just three deaths of adult liver donors, the last in 2002 at Mount Sinai Medical Center in New York. He called the Lahey team one of the most “experienced and most expert’’ in the country."

..."Until 2001, the number of liver transplants from living donors in the United States had been growing, reaching a peak of 524 that year. Since then the number has declined, with 219 operations performed last year. Of those, 24 were done at Lahey.

"Surgeons said that the Mount Sinai death may have had a chilling effect on living liver donor transplants, but that in 2002 the cadaver liver allocation system was reorganized so that organs went to the sickest patients. This change reduced the need for living donors.

"Of the 323 living donor liver transplants done in Massachusetts since 1994, 215 were performed at Lahey. This is the first donor death since the program began in 1999, the hospital said."

Organs for sale? Repugnance as controversy to sell magazines

Mohammad Mahdian points out this ad for the Economist magazine, entitled
"Trading Human Organs Should Be Allowed"

Dating sites that limit your options

A new paper by my HBS colleagues Hanna Halaburda and Misiek Piskorski discusses why a dating/matrimony site that limits your options (like eHarmony) might be attractive. Their paper is called Platforms and Limits to Network Effects

The idea is that, even if you would prefer to have lots of options yourself, you might prefer to be one of a small set of options your dating partners are considering.

Abstract:We model conditions under which agents in two-sided matching markets would rationally prefer a platform limiting choice. We show that platforms that offer a limited set of matching candidates are attractive by reducing the competition among agents on the same side of the market. An agent who sees fewer candidates knows that these candidates also see fewer potential matches, and so are more likely to accept the match. As agents on both sides have access to more candidates, initially positive indirect network effects decrease in strength, reach their limit and eventually turn negative. The limit to network effects is different for different types of agents. For agents with low outside option the limit to network effects is reached relatively quickly, and those agents choose the platform with restricted number of candidates. This is because those agents value the higher rate of acceptance more than access to more candidates. Agents with higher outside option choose the market with larger number of candidates. The model helps explain why platforms offering restricted number of candidates coexist alongside those offering larger number of candidates, even though the existing literature on network effects suggests that the latter should always dominate the former.

College admissions and "demonstrated interest"

Signaling is important, says a recent article in the Chronicle of Higher Ed: The Dynamics of Demonstrated Interest

"This year, American University received a record 17,000 admissions applications, a 13 percent increase over last year.

.... as colleges become more selective, they often find themselves competing with institutions a rung or two higher on the ladders of selectivity and desirability, at least for the top students.

Although there's prestige in this kind of association, there's also uncertainty. How many applicants would turn down a super-selective, big-name college to attend a somewhat less-selective, less-famous one? How do you know whether a student considers your college a top choice or a "safety school"? How does an applicant's sense of "fit" with a college relate not only to matriculation, but also retention?

"In recent years, such questions have prompted American's admissions team to look more closely at "demonstrated interest," the popular term for the contact students make with a college during the application process, such as by visiting the campus, participating in an interview, or e-mailing an admissions representative. In theory, it's a way to measure the likelihood that an applicant will matriculate—and succeed if they do.

"The practice is not new, but its importance has grown at some selective colleges in this era of ballooning applications and economic uncertainty. From 2003 to 2006, the percentage of colleges rating demonstrated interest as a "considerably important" factor increased to 21 percent from 7 percent, according to an annual survey by the National Association for College Admission Counseling. Since then, that number has held steady (another 27 percent of colleges now deem it "moderately important"). ...

"Recently, American has created more opportunities for students to do just that. The admissions office has broadened its recruitment strategies to include online chats for prospective applicants. Participation is noted in each student's file. ...

"Demonstrated interest often dovetails with another strategy for managing uncertainty: the waiting list. This year, American offered a spot on its waiting list to about 2,000 students, a seemingly large number considering that the university had accepted approximately 7,300 students for its freshman enrollment target of 1,450.

"Applicants who received waiting-list invitations from American fit a range of descriptions. Some were less competitive than the applicants the university accepted, but others were top-notch students who did not seem like a good fit for the university. In some cases, the reason was a lack of demonstrated interest, Ms. Alston says."

Teachers who tamper with standardized test scores

"John Fremer, a specialist in data forensics who was hired by an independent panel to dig deeper into the Atlanta schools, and who investigated earlier scandals in Texas and elsewhere, said educator cheating was rising. “Every time you increase the stakes associated with any testing program, you get more cheating,” he said."

From the NY Times story: Under Pressure, Teachers Tamper With Test Scores, reporting that "investigations in Georgia, Indiana, Massachusetts, Nevada, Virginia and elsewhere this year have pointed to cheating by educators. Experts say the phenomenon is increasing as the stakes over standardized testing ratchet higher — including, most recently, taking student progress on tests into consideration in teachers’ performance reviews."

Afghan child weddings

The NY Times writes about the floggings administered to twp runaway child brides, in a story that also includes some interesting background: Child Brides Escape Marriage, but Not Lashes.

The case of Khadija Rasoul, 13, and Basgol Sakhi, 14, from the village of Gardan-i-Top, in the Dulina district of Ghor Province, central Afghanistan, was notable for the failure of the authorities to do anything to protect the girls, despite opportunities to do so.Forced into a so-called marriage exchange, where each girl was given to an elderly man in the other’s family, Khadija and Basgol later complained that their husbands beat them when they tried to resist consummating the unions. "

Super duper

Duper of Harvard Got Into Stanford
Student Accused of Lying to Harvard Was Admitted to Stanford, Too

"Adam Wheeler, the Delaware man charged with lying about his credentials to get into Harvard and to secure nearly $50,000 in financial aid and prizes, was later admitted to Stanford as a transfer student, Massachusetts prosecutors said in court documents released Wednesday."
"Cara O’Brien, a spokeswoman for Middlesex Superior Court in Massachusetts, told my colleague Abby Goodnough that the documents reveal that Mr. Wheeler was admitted to Stanford this year as a transfer student for the 2010-11 school year. Massachusetts authorities have said that Mr. Wheeler left Harvard last fall after university officials confronted him with allegations that much of his application for a Rhodes Scholarship had been plagiarized."

See my earlier post for the background: College admissions fraud, at Harvard

Update: and here's the Dec. 16, 2010 Globe story covering his guilty plea and sentencing.

Personal data for sale

Web Start-Ups Offer Bargains for Users’ Data

The budgeting Web site Mint.com, for example, displays discount offers from cable companies or banks to users who reveal their personal financial data, including bank and credit card information. The clothing retailerBluefly could send offers for sunglasses to consumers who disclose that they just bought a swimsuit. And location-based services like Foursquare and Gowalla ask users to volunteer their location in return for rewards like discounts on Pepsi drinks or Starbucks coffee.

These early efforts are predicated on a shift in the relationship between consumer and company. Influenced by consumers’ willingness to trade data online, the sites are pushing to see how much information people will turn over."...

"New companies including WeShop, Aprizi, Blippy and Dopplr are trying to exploit the data that people seem so willing to give up. Some are even allowing shoppers to set what terms they want — free shipping, half-price discounts, only fair-trade products. They can also list what they are shopping for, like a gray cashmere sweater under $100, for instance, and let the retailers fight it out for the right to make a sale.

“The whole privacy debate has grown up around people using your data without your permission,” said Antony Lee, chief executive of WeShop. “If you want to use your data to your benefit, that’s for you to do,” Mr. Lee said."

Experimental economics and market design

As I prepare my chapter on that subject for volume 2 of the Handbook of Experimental Economics, I've belatedly posted a related paper, which has a section on experiments in market design from which I'll cheerfully borrow:

Roth, Alvin E. " Is Experimental Economics Living Up to Its Promise? , in Frechette, Guillaume and Andrew Schotter (editors), in The Methods of Modern Experimental Economics , Oxford University Press, forthcoming.

Outsourcing online courtship

The Washington Post has a story about services (like Virtual Dating Assistants) that allow online courtship to be outsourced: Online dating assistants help the lonely and busy

"Last June, Valdez, now 25, founded Virtual Dating Assistants -- a company that "specializes in making the dating dreams of busy individuals come true."

"Author Timothy Ferriss popularized the concept when he wrote about outsourcing his online dating accounts to teams of competing writers in his 2007 book, "The 4-Hour Work Week."

"Valdez's Atlanta-based firm is hardly the only outfit to offer such services. Dozens of profile-writing shops such as Arlington County-based TargetLove have popped up in the past few years, and dating coaches are increasingly managing their clients' online pursuits. Not to mention the well-intentioned friends and relatives who have taken over the process for the hapless singles in their lives.

"But Valdez and his team of 45 freelance writers, including Hartshorn, do it all: write a client's profile, pick out potential matches, send introductory e-mails and message back and forth until a date is confirmed. Then they turn over the correspondence and tell the lucky fellow where and when he's meeting Madame X. (And it's almost always that gender dynamic; 80 percent of the firm's clients are men.)...

"Mark Brooks, founder of Online Personals Watch, a site that tracks Internet dating trends, says this type of outsourcing is an ethically questionable form of "misrepresentation." Still, he expects the field to grow.

"Professional matchmakers often charge $5,000 or more a year and have a limited pool of matches. Online dating sites are populated with countless singles but can require more attention than some users are willing to devote. "It may look like instant gratification, like you dive into the pool and instantly come up with a fish, but it doesn't really work like that," Brooks says. "You've got to tap, tap, tap on the keyboard quite a lot to get anywhere."

The market for young soccer players

The NY Times Sunday Magazine reports on How a Soccer Star Is Made . (Shades of both Harry Potter and Ender's Game...)


"The youth academy of the famed dutch soccer club Ajax is grandiosely called De Toekomst — The Future. ...Ajax once fielded one of the top professional teams in Europe. With the increasing globalization of the sport, which has driven the best players to richer leagues in England, Germany, Italy and Spain, the club has become a different kind of enterprise — a talent factory. It manufactures players and then sells them, often for immense fees, on the world market.
...
"Like other professional clubs in Europe and around the world, Ajax operates something similar to a big-league baseball team’s minor-league system — but one that reaches into early childhood. ... for some families, the first time they realize their boys are under serious consideration is when a letter arrives from Ajax requesting that they bring their sons in for a closer look, an invitation that is almost never declined.
...
"Ajax puts young players into a competitive caldron, a culture of constant improvement in which they either survive and advance or are discarded. It is not what most would regard as a child-friendly environment, but it is one that sorts out the real prodigies — those capable of playing at an elite international level — from the merely gifted.
...
"About 200 players train at De Toekomst at any given time, from ages 7 to 19. (All are male; Ajax has no girls’ program.) Every year, some in each age group are told they cannot return the following year — they are said to have been “sent away” — and new prospects are enrolled in their place.
...
"I asked Martin Jol, the coach of Ajax’s first team, if it was difficult for him to nurture young players knowing he would lose them just as their talent blossomed. “I think that is the purpose of Ajax, to develop players and bring them up to the first team as young as possible,” he answered. “And then we sell them, not for peanuts but for a lot of money.”
...
"In the U.S., we think of money as corrupting sport, especially youth sport. At Ajax, it is clarifying. With the stakes so high — so much invested and the potential for so much in return — De Toekomst is a laboratory for turning young boys into high-impact performers in the world’s most popular game. "
...
"Parents pay nothing except a nominal insurance fee of 12 euros a year, and the club covers the rest — salaries for 24 coaches, travel to tournaments, uniforms and gear for the players and all other costs associated with running a vast facility. Promising young players outside the Ajax catchment area usually attend academies run by other Dutch professional clubs, where the training is also free, as it is in much of the rest of the soccer-playing world for youths with pro potential. (The U.S., where the dominant model is “pay to play” — the better an athlete, the more money a parent shells out — is the outlier.)
" How the U.S. develops its most promising young players is not just different from what the Netherlands and most elite soccer nations do — on fundamental levels, it is diametrically opposed.
Americans like to put together teams, even at the Pee Wee level, that are meant to win. The best soccer-playing nations build individual players, ones with superior technical skills who later come together on teams the U.S. struggles to beat. In a way, it is a reversal of type. Americans tend to think of Europeans as collectivists and themselves as individualists. But in sports, it is the opposite. The Europeans build up the assets of individual players. Americans underdevelop the individual, although most of the volunteers who coach at the youngest level would not be cognizant of that.
...
"De Toekomst is not where you come to hear a romantic view of sport. No one pretends that its business is other than what it is. “We sold Wesley Sneijder for a ridiculous amount of money,” Versloot said. “We can go on for years based on what he was sold for.”
...
"Versloot said that, on average, one and a half products of De Toekomst per season will rise to the first team and go on to a significant, well-compensated pro career. Some of the others will gravitate to second- or third-tier pro circuits or the high amateur ranks in the Netherlands, where the best players make “black money,” under-the-table payments. The pressure to emerge from the academy as one of its top products — and to produce them — is immense. “It is always a very tense atmosphere here, for everyone,” Versloot said. “You have to just get used to it.”
...
"Fulham, like Ajax, is often a seller of talent. It recently sold a 20-year-old to Manchester United for seven million pounds, or more than $10 million. “It’s a little ugly talking about the financial terms,” Jennings said. “I don’t like to do it. It feels not too far off from the slave trade."

"Everyone draws the line somewhere. Jennings told me that he recently received a call from a rival club asking if it could schedule a game against his “elite 5s” — 5-year-olds. He replied, “We don’t have elite 5s, but we’ll play your expectant mothers.”
...

"Ronald de Jong invited me to go scouting with him one Saturday. He had his eye on a specific target — “a 2004,” he said, referring to a birth year. A 5-year-old whom he had seen and was checking in with every month or so. This boy might not even be in school yet, I pointed out. “I don’t think he is,” de Jong said with a slight smile, as if he recognized the absurdity. “I believe he’s in day care.”

Auction design patents

My market design colleagues and I have tried to put our algorithms for school choice, kidney exchange, and labor market clearinghouses in the public domain. But in one very competitive commercial area of market design, involving auction rules, it is not uncommon for designers to seek patents.

System and method for a hybrid clock and proxy auction is a patent issued on June 1, 2010 to Larry Ausubel, Peter Cramton, and Paul Milgrom. (Here is a link to other auction patents by Ausubel et al.)

National Kidney Foundation: End the Wait

Here's a press release from the NKF: NKF Names Co-Chairs for END THE WAIT! Exec Committee

"Transplant surgeon Dr. Francis L. Delmonico and non-directed kidney donor Bill Singleton were named the first co-Chairs of the END THE WAIT! Executive Committee, the National Kidney Foundation (NKF) announced June 4.

NKF launched the END THE WAIT! initiative at the start of 2009 to address the urgent need to increase the number of organs available for transplantation in the United States.

"The END THE WAIT! initiative is a virtual call-to-arms that the current system of organ donation and transplantation is not sustainable to fulfill the needs of our patients. In collaboration with other major organizations in the kidney care, donation and transplant communities, we are leading this charge to address the inconsistent practices across the United States that are no longer acceptable," said John Davis, National Kidney Foundation CEO. “We know that Dr. Delmonico's vast professional experience as one of the nation's preeminent transplant experts and Mr. Singleton's personal experience as a living donor will help provide the knowledge and perspective needed to move our ambitious agenda forward and implement our END THE WAIT! recommendations.”

END THE WAIT! recommendations focus on improving the donation process, eliminating barriers to donation, instituting best practices and increasing living and deceased donation.

The recently-passed Healthcare Reform Bill prohibits insurance companies from denying medical coverage to those with pre-existing conditions. In the past, living kidney donors had been viewed as having a pre-existing medical condition by some insurance companies and denied medical coverage. Certainly, such practices constitute barriers to donation and eliminating that was one of the END THE WAIT! recommendations," Davis added.

“We will continue to fight for patients to receive comparable care from one region of the country to another, for example by maximizing programs such as paired kidney donation that are not currently accessible to all patients,” said Dr. Delmonico, transplant surgeon at Massachusetts General Hospital and Professor of Surgery at Harvard Medical School. “Others priorities will focus on removing disincentives to living donation, including covering all donation-related expenses.”

“The list of Americans now waiting for organs continues to increase each day,” said Singleton, a long-time NKF volunteer and former board member who became a kidney donor in December 2009 as part of the largest kidney exchange in the world to date. “I'm committed to helping other potential donors learn more about the process. I know we can help educate people and remove barriers through END THE WAIT!”

Market design at 9am

A former student, Abe Othman, endorses our market design course even though it was held early Friday mornings: Foundational Paper: The Economist as Engineer

College waiting lists and double depositing

An article on congestion in college admissions: The Dirty College Admissions Trick.

"Why are waitlists so long this year? Marc Zawel on the increasingly common practice of "double depositing," and how a few bad apples could land you in waitlist limbo all summer long."
HT: Steve Leider