Compensation for donors: it's not just kidneys

I'll be speaking later this year about deceased donation at a conference of the International Society for Heart & Lung Transplantation. When I went to their website to arrange some hotel details, I saw this announcement about the Society's position that "the sale of organs from both live and deceased donors is unethical and violates the Universal Declaration of Human Rights."

NEW: ISHLT Position on the Trafficking of Donor Organs
"Tales from the Organ Trade” and similar documentaries are reminders that organ trafficking remains an important international problem. In line with the previously stated ISHLT position and in concert with other national and international transplantation societies, the ISHLT strongly and emphatically endorses the Declaration of Istanbul which seeks to abolish the illegal and immoral trade in donor organs which is supported in part by so called “transplant tourism”. As a corollary of which,  the Society values and supports every effort to improve the availability of donor organs by legitimate process thereby providing community access to these life sustaining therapies.


They link to their 2007 position statement, reproduced here:

International Society for Heart and Lung Transplantation
Statement on Transplant Ethics
Approved April 2007

Thoracic organ transplantation improves the length and quality of life of patients with severe
heart or lung disease. It is a societal endeavour bound by ethical principles. The donation of
organs from a deceased patient must always be made freely and without coercion. The gift
of an organ by a live donor, such as a pulmonary lobe transplant, must be made in the same
fashion and with informed consent. To ensure that these principles are adhered to, the
transplant process must be transparent, legally regulated and open to both national and
international scrutiny.

The ISHLT endorses the view of the World Medical Association that the sale of organs from
both live and deceased donors is unethical and violates the Universal Declaration of Human
Rights.

Obtaining organs for transplantation from the bodies of executed prisoners contravenes the
principle of voluntary donation. A condemned prisoner and his relatives cannot consent
freely. Furthermore, such practices provide a perverse incentive to increase the number of
executions and it lays the judicial process open to corruption.

ISHLT members should discourage patients from seeking transplantation in countries where
transplantation is not open to external scrutiny and the ethical standards of the ISHLT
cannot be assured, regardless of whether payment for organs is involved. ISHLT members
should work with their own governments to ensure that such ‘transplant tourism’ that
contravenes these ethical principles is made illegal.

Members of the ISHLT should not participate in or support the transplantation of organs
from prisoners or the sale of organs for transplantation. Any ISHLT member who has been
found to have contravened this ethical principle may have their rights and privileges as a
member suspended or removed by the ISHLT Board.

Individuals submitting data about clinical transplantation, or the use of human tissue, for
presentation at any of the ISHLT’s meetings, to the Society’s Registry or for publication in
the Journal of Heart and Lung Transplantation will be asked to sign a personal statement
confirming that the principles of both the Declaration of Helsinki formulated by the World
Medical Association and of this ethical statement by the ISHLT have been adhered to.

References
Rothman DJ, Rose E, Awaya T, Cohen B, Daar A, Dzemeshkevich SL, Lee CJ, Munro R,
Reyes H, Rothman SM, Schoen KF, Scheper-Hughes N, Shapira Z, Smit H. The Bellagio Task
Force report on transplantation, bodily integrity, and the International Traffic in Organs.
Transplant Proceedings 1997; 29: 2739-45. Also available at the International Committee of
the Red Cross web-site:
http://www.icrc.org/Web/Eng/siteeng0.nsf/iwpList302/87DC95FCA3C3D63EC1256B66005B3
F6C (accessed 1st May 2007)
Declaration of Helsinki. http://www.wma.net/e/policy/pdf/17c.pdf (accessed 1st May 2007)

Horse meat served in an Israeli restaurant, with subsequent apologies

Here's the story from Haaretz: Psst! That's horse you're eating, Tel Aviv waiter admits
Turkiz serves horse regularly but didn't mention it in the dish description; waiter tells the couple what the menu didn't.

apparently the restaurant has horse meat on its menu, but left it out of the description of at least one dish.

(Many Israelis may share the American repugnance for eating horse, but an additional complication there is that horses don't have split hooves nor chew their cud and so are not kosher.  Apparently the sale of horse meat for human consumption is legal there, unlike here in California...)

HT: Ran Shorrer

An investigative journalist at the Telegraph is offered a kidney for sale

Britons being sold illegal kidneys for surgery in Sri Lanka
Patients awaiting kidney transplants in the UK are being offered illegal organs which are then used in operations at a Ski Lankan hospital

George Dantzig's math library is available for "private treaty sale"

Here is the sale site, and here is Michael Trick's blog post on the sale, Own a Ton of Operations Research History.

That post ends with this observation: " I suspect in the future, there will be far fewer libraries from great researchers.  I know that my own “library” is really nothing more than the hard drive on whatever computer I am using."

High pay isn't repugnant in Switzerland after all, at least not to 65%

Here's the story from Bloomberg: Swiss Voters Reject Strict CEO Pay Limits in Referendum

"Swiss voters rejected a proposal to limit executives’ pay to 12 times that of junior employees yesterday, a measure that would have gone further than any other developed nation.
The measure was opposed by 65 percent of voters, the government in Bern said yesterday.
...
"“It’s a big relief,” Valentin Vogt, president of the Swiss Employers’ Association, said in an interview on Swiss national television SRF. “It’s a signal that it’s not up to the state to have a say in pay.”
Switzerland is the home to at least five of Europe’s 20 best-paid chief executive officers. Opposition to excessive pay has stiffened among the traditionally pro-business Swiss following the government bailout of UBS AG (UBSN), Switzerland’s biggest bank, in 2008 and a plan -- later scrapped -- by Novartis AG (NOVN) to pay outgoing Chairman Daniel Vasella as much as $78 million.
In March, Swiss voters approved the so-called fat-cat initiative that gave company shareholders a binding vote on managers’ pay and blocked golden handshakes and severance packages."
*******************

But sometimes high pay strikes some people as repugnant, and it's not just hedge fund managers: take a look at this story from the NY Daily News.

Top 16 NYC charter school executives earn more than Chancellor Dennis Walcott

What happens when Big Data meets human resources?

That's the question asked by this recent article in the Atlantic by Don Peck, which focuses on using nontraditional data to match workers to jobs, either for hiring new workers or for assigning workers to tasks within a firm.

One of the companies they mention (and one I'm interested in) is Knack, which has created video games which generate apparently useful kinds of data about individuals.

In general, there's a question of what should the inputs be for a matching algorithm, and for many purposes economists have focused on preferences, but 'big data' offers some possibilities for informing preferences and identifying good matches.

(See an earlier related post with links to other articles here: New sources of data for selecting who to hire )

School choice in New Orleans: schools have big strategy sets

In New Orleans (as in New York City), some schools have big strategy sets. The Times-Picayune reports: Two New Orleans high schools said they were 'full' -- then enrolled more students


"the data raises troubling questions about whether these two schools are truly "open admission" campuses or are secretly cherry-picking students. "I think it's a fact that school leaders of certain schools are deciding who gets a seat, and I don't think that's serving students well," said Caroline Roemer Shirley, head of the Louisiana Association of Public Charter Schools.

McMain Principal Bridgette Frick admitted taking in more freshmen after officially declaring the class full. She said she let in students who came to sign up at the school in July, after McMain was freed from OneApp.

So, too, did McDonogh 35 Principal Gerald DeBose. He said the school independently boosted ninth-grade enrollment beyond its initial number to offset an unexpected loss of students in 10th and 11th grade.

The Orleans Parish School Board allowed the schools to fill any open seats on their own over the summer. However, Recovery School District data show they were overenrolled well before then."

...

"In most parts of the country, charters run their own application lotteries. But suspicions arose in New Orleans that the lack of oversight left room for individual schools to prioritize some applicants over others, even though almost all are "open admission," meaning they have no stated entry requirements. 

...

"The state Recovery School District introduced OneApp in 2012 to address these and other issues. It applies to all New Orleans public schools in both the state-run district and about half of those overseen by the separate Orleans Parish School Board. The exceptions, for now, are Orleans Parish School Board charters that choose not to participate until their charters come up for renewal.

Celebrate Marilda Sotomayor at her 70th birthday conference in Brazil, July 25-31, 2014

Here's the conference website, which says in part:

It is a great pleasure to invite you to participate in the SÃO PAULO SCHOOL OF ADVANCED SCIENCES ON GAME THEORY – INTERNATIONAL WORKSHOP ON GAME THEORY AND ECONOMIC APPLICATIONS OF THE GAME THEORY SOCIETY, to celebrate the 70th birthday of Marilda Sotomayor. It will be held at the University of São Paulo, from July 25 to July 31, 2014.

The workshop will offer the participants the opportunity to interact with some of the most productive researchers in Game Theory. The week-long event will consist of mini-courses, conferences and contributed papers sessions, which will be complemented with a round table for discussions on themes of interest of the participants. The courses will start at the introductory level and will reach the frontiers of current research.

...

Mini-Courses

• MARKET DESIGN - ALVIN ROTH (University Stanford)
• SOCIAL CHOICE AND FAIR DIVISION - HERVÉ MOULIN (University of Glasgow)
• INFORMATION THEORY - DAVID PEREZ-CASTRILLO (University Autonoma de Barcelona)
• COOPERATIVE GAMES - ROBERTO SERRANO (Brown University)
• STOCHASTIC GAMES: ALGORITHMS AND EXISTENCE - T. E. S. RAGHAVAN (University Chicago)
• INTRODUCTION TO AUCTION THEORY - Vijay Krishna (Pennsylvania State Univ.)
  • CLUBS, COALITIONS AND NETWORKS - Myrna Wooders (Vanderbilt Univ.)

All the courses will be ministered in parallel, except for “Market Design”.

Plenary Lecturers

• AUMANN, ROBERT: Hebrew University of Jerusalem, Israel and State University of New York at Stony Brook, USA.
• HART, SERGIU: Hebrew University of Jerusalem, Israel.
• MASKIN, ERIC: Princeton University, USA
• NASH, JOHN: Princeton University, USA
• ROTH, ALVIN: Stanford University, USA.
• SCHMEIDLER, DAVID: Interdisciplinary Center in Herzliya, Israel.
• SOTOMAYOR, MARILDA: Universidade de São Paulo, Brazil.

N.Y.C. turns to open data to help with high school choice

Here's an encouraging development: New York City is making data available to third party app developers to help families compare schools:  N.Y.C. turns to open data to help with high school choice

Deceased donor registration versus transplantation in Malaysia

The National News Agency of Malaysia (BERNAMA) has the following disheartening report on the difference between deceased organ donor registration and subsequent transplantation:

Sarawak News

---

November 16, 2013 19:10 PM

Organ Transfer Conducted From Only 435 Of 237,395 Registered Organ Donors - Lee Lam Thye

SIBU, 16 Nov (Bernama)- The Organ Donation Public Awareness Action Committee revealed that only 435 of the 237,395 registered organ donors had donated their organs after their death so far.

Its chairman, Tan Sri Lee Lam Thye, said the number was very small compared with the number of those who had registered to donate their organs upon their death.

He attributed this to, among others, the family members or next-of kin of the registered organ donors not allowing the organ transfer to be conducted when the former died.

"This happens because the registered donors did not inform their family members of their pledge to donate their organs upon their death.

"Hence, we advised those who have pledged to donate their organs upon their death to inform their family members of their decision," he told a media conference after an organ donation campaign here Saturday.

Eating horsemeat is good for horses, says Britain's Princess Anne

The Telegraph has the story (and a video):
Princess Anne: why Britain should consider eating horsemeat
"The Princess Royal, who is President of World Horse Welfare, says that Britain should consider eating horsemeat because it would improve standards of care for the animals"

 "Princess Anne was speaking at the World Horse Welfare Organisation annual meeting when she made the comments:
"Our attitudes to the horsemeat trade may have to change" she said, because those in the trade "value their horses and look after them well" and therefore "should we be considering a real market for horsemeat and would that reduce the number of welfare case?
"I think this need a debate," the Princess Royal added."

D.C.plans a single school choice system that includes both traditional and charter schools

Here's the story from the Washington Post:
D.C. rolls out unified enrollment lottery for traditional, charter schools

The story even includes a link to IIPSC.

And here's a link to the DC school choice site, My School DC

Seminar on modern matching, by Scott Kominers

If you are at loose ends in Cambridge MA this noon...

Scott Kominers: "Theory, Practice, and Engineering in (Generalized) Matching Market Design"

Date: Wednesday, November 20, 2013
Time: 12:00pm – 1:30pm
Place: Maxwell Dworkin 119

Speaker: Scott Kominers, Harvard Society of Fellows, Harvard Program for Evolutionary Dynamics, and Harvard CRCS

Title: Theory, Practice, and Engineering in (Generalized) Matching Market Design

Abstract:
In recent years, matching theory has been widely applied in the design of centralized labor markets and school choice programs. At the same time, new theoretical discoveries have shown how to generalize matching algorithms to incorporate contract negotiation and complex market structures. I will survey the history of matching, from the marriage problem, through "marriage with dowries," to generalized matching with contracts. Then, I will discuss applications of generalized matching algorithms to the design of affirmative action and cadet--branch matching systems. I will conclude by showing how these results have recently contributed to the elimination of "walk-zones" in the Boston public schools match.

Bio:Scott Duke Kominers is a Junior Fellow at the Harvard Society of Fellows, a Research Scientist at the Harvard Program for Evolutionary Dynamics, and an Associate of the Harvard Center for Research on Computation and Society. From 2011-2013, he was the inaugural Research Scholar at the Becker Friedman Institute for Research in Economics at the University of Chicago.

Kominers received his A.B. in Mathematics and Ph.D. in Business Economics from Harvard University, in 2009 and 2011, respectively. His research focuses on market design and its interactions with law and computer science. His specific research interests include matching theory, mechanism design, law and economics, privacy, and quadratic form representation theory.

Location: 

Maxwell Dworkin 119

More on the law and politics of compensating bone marrow donors

The legal battle is shaping up over the decision of the department of Health and Human Services to circumvent the decision of the ninth circuit court of appeals that it is legal to compensate bone marrow donors.  The Institute for Justice, which was a successful litigant in the court ruling, has outlined their current thoughts here:
Federal Officials Move to Block Life-Saving Research
HHS’ Proposed Rules Would Undo Court Ruling Legalizing Bone Marrow Compensation

They say in part:
"The proposed regulation would ban marrow compensation just when empirical research has begun into the effects of compensating donors.  A team of economists—Nicola Lacetera of the University of Toronto, Mario Macis of Johns Hopkins University, and Robert Slonim of the University of Sydney—were in the process of finalizing a research proposal that would have investigated the effects of donor compensation when they learned of the new rule.

“These new regulations make it impossible for researchers to obtain the necessary evidence to inform policy.  Our proposed studies would be made illegal by these new provisions,” explained Macis, who, along with Lacetera and Slonim, has published some of the leading work showing that economic incentives can be effectively used to increase blood donations without affecting blood supply safety.  “Properly designed compensation for bone marrow donors could similarly lead to significant increases in donations, thus giving potentially hundreds or thousands of people in need of a transplant every year a greater chance of survival.  At a minimum, the federal government should not make it illegal for researchers to find out whether incentives can help address the shortage of bone marrow donors.”

“I don’t think that anybody should go to jail just for trying to save somebody’s life,” added Doreen Flynn, who has three children with Fanconi anemia, a blood disease that frequently requires a bone marrow transplant and who was the lead plaintiff in the original lawsuit.  “If paying donors results in more marrow donations, we should pay them.  And it shouldn’t be a crime to investigate it.”
“We know what doesn’t work,” said Robert McNamara, also a senior attorney with the Institute and co-lead counsel in the case.  “We have 30 years of experience with an altruism-only marrow-donor program, and we know that has not succeeded in recruiting enough donors.  The only question is whether offering compensation can achieve better results.  We will not allow the federal government to make it a felony to find out the answer.  Hopefully, we will do that by persuading the government not to adopt this rule, but if we have to, we will sue them again.  And we will win—again.”

The proposed regulation is currently open for a period of public comment through December 2, 2013.  Individuals who have been impacted by blood-borne cancer or bone marrow donations are encouraged to leave comments on the Department of Health and Human Services’ website:  http://www.regulations.gov/#!submitComment;D=HRSA_FRDOC_0001-0115."
****************

You can follow some of the story in my earlier posts on bone marrow and compensation.

AEA Registry for Randomized Control Trials

This just in...

Dear AEA member:

The AEA has launched a new site to register randomized control trials (RCTs). The AEA encourages all investigators to register new and existing RCTs. Registration is entirely voluntary and is not currently linked to or required for submission and publication in the AEA journals.

The site is available at https://www.socialscienceregistry.org

On this site, you can register your forthcoming, ongoing, or even completed RCTs, with as little or as many details as you wish. The site will also permit you to store and make publicly-available additional information on your RCTs (reports, articles, data, and code). We believe that this will prove to be a very valuable resource for investigators to share their work and the site will be widely used by those who wish to find out about on-going and completed studies.

The registry is characterized by:

1) Simplicity and flexibility: Registering a trial is straightforward with only a minimal number of required fields. There is considerable flexibility to provide additional material at the time of registration or at any point in the life of the study. Materials can also be hidden from public view until completion of the study, or be made accessible only with the permission of the PI.

2) Adjustability and memory: Any registry entry can be amended by the PI at any point, but the registry keeps track of all versions.

3) Ability to work as a research portal for your RCTs: The registry can serve as an access point for collaborators, other scholars, students, and the general public providing links to data sets, survey instruments, experimental findings, and experimental protocols.

To register a trial, the PI simply needs to enter the following information: PI name, project title, study location, project status, keyword(s), abstract, trial start and end dates, intervention start and end dates, proposed outcome(s), experimental design, whether the treatment is clustered, planned number of clusters, planned number of observations, and IRB information. Optional fields allowing the PI to customize and enhance the information made available include details on sponsors and partners, survey instruments, an analysis plan, and other supporting documents. Help is available if the PI encounters any problem.

The AEA registry system will provide the PI with reminders to update the registration of an RCT at appropriate points in the trial's lifecycle. For example, the submitted end date will trigger an email asking the PI to enter post-trial information. If the trial has been extended, the PI can update the trial with the new end date.

We encourage you to explore the registry and to register your RCTs.

The committee on the registry for social experiments
Larry Katz (chair)
Esther Duflo
Pinelopi Goldberg
Duncan Thomas

Ohio execution stay for Ronald Phillips for possible organ donations

This will complicate my discussions in China...

Ohio execution stay for Ronald Phillips for possible organ donations

November 14, 2013 (COLUMBUS, Ohio) -- Ohio's governor delayed the execution of a condemned child killer to consider the inmate's unprecedented organ donation request, acknowledging that it's ''uncharted territory'' but expressing hope that the man might help save a life before losing his own.

Ronald Phillips, 40, was scheduled to be put to death Thursday with a lethal injection of a two-drug combination not yet tried in the U.S., but Gov. John Kasich issued a stay of execution Wednesday. The execution date has been reset for July 2.

"I realize this is a bit of uncharted territory for Ohio, but if another life can be saved by his willingness to donate his organs and tissues then we should allow for that to happen," Kasich said in a statement. He said he wanted to allow time for medical experts to study whether Phillips could donate non-vital organs, such as a kidney, before being executed.

Related Content

STORY: Organ-donor request delays Ohio killer's execution

Phillips, who was sentenced for raping and killing a 3-year-old girl in Akron in 1993, asked this week to donate a kidney to his mother and his heart to his sister. His attorney said it was an attempt to do good, not a delay tactic.

Ohio's prison medical policy accommodates organ donations, but prison officials rejected the request, saying it came too late to work out logistics and security concerns.

Kasich said Phillips' crime was heinous but his willingness to donate organs and tissue could save another life and the state should try to accommodate that.

Some 3,500 people in Ohio and more than 120,000 nationally are awaiting organ donations, said Marilyn Pongonis, a spokeswoman for the Lifeline of Ohio organ donation program.

If Phillips is a viable donor for his mother, who has kidney disease and is on dialysis, or for others awaiting live transplants of non-vital organs, the stay would allow time for those procedures to be performed, Kasich said.

Phillips' sister suffers from a heart ailment and he also wants to donate his heart to her.

Richard Dieter, executive director of the Death Penalty Information Center, said a Delaware death row inmate was permitted in 1995 to donate a kidney to his mother while in prison, though he was not facing imminent execution like Phillips.

"This step by the governor puts it into a more normal discussion of (how) an inmate, without any security problems, can help save another person and is that the right thing to do," he said. "With 24 hours to go before an operation had to be carried out, it definitely gets in the way of that process."

Vital organ donations raise larger ethical issues and have not been allowed during U.S. executions but have occurred in China, Deiter said.

Dieter, whose group opposes the death penalty, added: "If the whole idea is to save a life, there's one life to be saved simply by not executing the person at all."

Phillips made his request after the governor denied him mercy and Phillips had exhausted his other legal options. The state had left it up to Phillips' family whether the organs would be harvested after his death.

HT: Bernadette Keller

Saudi comedians mock the ban on women drivers with a video song

The NY Times has the story

"Their video, a play on the Bob Marley classic “No Woman, No Cry,” has gone viral, receiving more than 6.5 million views on YouTube since it was posted on Saturday. The catchy a cappella tune mocks the country’s restrictions, as well as the assertion by one Saudi cleric that driving would harm women’s ovaries."

Repugnant transaction watch: Saudi women drivers

The NY Times has the latest on a demonstration by Saudi women who wish to be allowed to drive in the Kingdom, and the reaction it has drawn: Saudi Women Rise Up, Quietly, and Slide Into the Driver’s Seat

"The public call for women nationwide to drive on Saturday was the latest push in a decades-old effort by a small group of activists to exercise what they see as a fundamental human right. Saudi Arabia, a hereditary monarchy, is the only country in the world where women are not allowed to drive."

Is the Common App still doing what it was designed to do?

The letters to the editor of the NY Times, following a recent article on the Common App and its troubles, include one (the second letter) from one of the founders of the Common App. It says in part:

"The unavoidable standardization of the Common Application, not to mention the online debacle for students trying to use it this year, causes serious questions regarding its service to both the candidate and the college.

As co-founder of the Common Application some 40 years ago (with Jack Osander of Princeton and Fred Jewett of Harvard), I sense that the Common App’s time is up. The sole original goal of the Common Application was to make applying to highly selective colleges easier for nontraditional, less advantaged but deserving students. Clearly, it worked early on.

Now it seems that the ease of applying via the Common App has transferred from the poorest to the most affluent students, whose families have no problem paying a dozen or more application fees — the more apps, the better the chance of admission somewhere special. This phenomenon also creates thousands more “ghost applications” (from students unlikely to enroll) for the colleges."

HT: Eric Budish

Earlier posts on the common app.

Is published economics research credible?

Not so much, is the answer given in the article below by Doucouliago and Ioannidis in the December issue of J of Economic Surveys (see, even the date isn't credible:). John Ioannidis is quite well known for his critiques of the reliability of published medical research.

Ioannidis, J. and Doucouliagos, C. (2013), WHAT'S TO KNOW ABOUT THE CREDIBILITY OF EMPIRICAL ECONOMICS?. Journal of Economic Surveys, 27: 997–1004. doi: 10.1111/joes.12032

Abstract
The scientific credibility of economics is itself a scientific question that can be addressed with both theoretical speculations and empirical data. In this review, we examine the major parameters that are expected to affect the credibility of empirical economics: sample size, magnitude of pursued effects, number and pre-selection of tested relationships, flexibility and lack of standardization in designs, definitions, outcomes and analyses, financial and other interests and prejudices, and the multiplicity and fragmentation of efforts. We summarize and discuss the empirical evidence on the lack of a robust reproducibility culture in economics and business research, the prevalence of potential publication and other selective reporting biases, and other failures and biases in the market of scientific information. Overall, the credibility of the economics literature is likely to be modest or even low.
...

4. Conclusions: Unanswered Questions and Possibilities for Improvement
Despite the aforementioned empirical evidence, much remains unknown. How credible is economics research in different subfields? Is credibility rising or falling over time? How can this market be improved? What is the impact of corporate and institutional interests, journals, funding agencies, and other stakeholders and how can we utilize this potential impact to improve the credibility of economics?

However some paths forward seem clear: strengthen the reproducibility culture with emphasis on independent replication; conduct larger, better studies; promote collaborative efforts rather than siloed, one-investigator research; and reduce biases and conflicts. The exact interventions, which might achieve these changes are not clear, and perhaps there is room for conducting experimental studies on different potential interventions. Progress may be difficult to achieve unless the rewards and incentives system of conducting and publishing research is modified. Little progress is likely if investigators get rewarded and promoted for publishing significant results and for perpetuating theories and claims even when they are wrong. Conversely, one might expect better outcomes, if replication research is encouraged, reproducibility is rewarded, and/or irreproducibility is penalized.


Answering these questions requires more meta-research (i.e. empirical research on research). Empirical studies that have been performed in other scientific disciplines may be extrapolated and conducted in economics. Tests for bias may also be adapted for economics and embraced by leading journals. Of course, meta-research is also susceptible to bias and errors of its own. The extent of bias and possible errors needs to be evaluated also for emerging meta-research tools. Nonetheless, tests for small-study effects and publication or selective reporting biases need to be applied increasingly, further developed and evaluated (Stanley and Doucouliagos, 2012).
************

See also
Why Most Published Research Findings Are False
John P. A. Ioannidis
Published: Aug 30, 2005DOI: 10.1371/journal.pmed.0020124