New York state officials allowed thousands of students to graduate from high school last month even though the seniors had failed a requisite mathematics exam, because the test may not have been fair.

Since 1979, a growing number of states have required high-school students to pass exit examinations before they can receive diplomas. For nearly as long, scholars and policy makers have debated ...