School Quality

Test Scores Are Important But I Wish Fordham Would Have Looked at What Else Matters to Parents and Community Members

One of the most important questions in education is: How will students and schools—district and chartered—be evaluated? While well intentioned, the Thomas B. Fordham Institute’s recent report, Three Signs that a Proposed Charter School is at Risk of Failing , risks being a step backward for the charter movement and for public education. The study’s design misses several important aspects of the public’s preferences for school goals, predictors of adult success and advances in currently available tools to assess a school’s impact. Fordham’s report judges new chartered public schools in four states solely on “school-level student growth and academic proficiency data” on standardized tests. If we’re serious about measuring what matters to families, employers and the broader society, this is an unwise, short-sighted approach. Policymakers and authorizers should be asking at least four key questions as they assess currently operating, and proposed new chartered public schools. State policymakers should be asking similar questions as they develop ways to assess all public schools, as required by the Every Student Succeeds Act (ESSA).

Some Background

From the beginning,   Minnesota and many charter laws have included as one of their purposes to, as Minnesota puts it: “measure learning outcomes and create different and innovative forms of measuring outcomes.” But as noted above, Fordham researchers judged quality solely on the basis of standardized test scores. They found that “student-centered” schools, such as those using a Waldorf or Montessori model, tend to struggle on these measures in their early years. Other forms of impact on students were not included. The report acknowledges that child-centered schools “aren’t ‘failing’ in the eyes of...parents who choose them [and] may not care if they have low ‘value added’ on test scores.” And it cautions that any use of its results “to automatically reject or fast-track an application” is a “misuse.” That’s critical. Ignoring that caution would severely limit the quality and range of the schools that are opened and permitted to continue. Serving students well means using, gathering and sharing a variety of information about schools and students, not just how well they score on standardized tests. Multiple measures, available now, can provide a more comprehensive view of what schools are helping young people accomplish. Here are four key questions for policymakers and authorizers to consider.
  1. First, and most importantly, shouldn’t they recognize that the public wisely cares about much more than a school’s “value added” on standardized tests? The 2016 PDK Education Survey, for example, found that more than 75 percent of the public rated several things as “extremely/very important for schools,” including “developing good work habits, providing factual information, enhancing critical thinking, preparing (students) to be good citizens and preparing students to work well in groups.”

    These are also the skills that America’s employers are seeking in recent college graduates, according to a 2016 study. More than 80 percent said they look for “evidence of leadership skills on the candidate's resume, and nearly as many seek out indications that the candidate is able to work in a team. Employers also cited written communication skills, problem-solving skills, verbal communication skills, and a strong work ethic as important candidate attributes.”

  2. Second, what are the best measures to predict success as an adult? One of the most powerful studies I’ve read in my 45-year career was published by ACT. Their researchers asked which of four factors best predicted success as an adult: high grades in high school, high grades in college, high scores on their test, and participation in debate, speech, drama and student government.
  3. ACT  found that participation in those extracurriculars best predicted success in adulthood as they defined it.  Part of a secondary school’s evaluation should therefore be the percentage of students involved in these programs.

  4. Third, given that schools in a democratic society are not just places to prepare students for work, don’t we want young people to graduate schools with the tools and attitudes needed to be active citizens.
  5. A recent Education Commission of the States (ECS) report, Mapping Opportunities for Civic Education, describes many benefits for preparing students, “not just for college and career, but also for citizenship and full participation in democratic life.” ECS documents that well developed engagement and service learning programs lowered dropout rates, reduced achievement gaps, improved school climate, and strengthened relationships between schools, students, parents, families, civic organizations, and community partners.

  6. Finally, policymakers, educators and authorizers should ask: “Do strong assessments exist beyond standardized tests that could help assess what’s happening with students in a school?” Fortunately, the answer is “yes.”   For example:
Fordham wisely urged authorizers not to reject certain educational models outright. Still, by focusing on test scores alone, the analysis sends the message that it is acceptable to continue relying on standardized tests as the central way of measuring a school’s quality. Strong reading, writing, and math skills are vital.  But Americans wisely want more from their schools.  Students, public education and the broader society will gain if we:
  • Recognize the importance of assessing a broad array of skills and knowledge, not just those that are measured by standardized tests.
  • Refine and encourage use by states and authorizers of valid assessments that measure an array of skills and knowledge.
  • Support and encourage development of schools, chartered and otherwise that help students develop many strong skills, and broad knowledge.
Chartering has grown in part because it builds on the fundamental American values of choice within some limits, and the belief that those creating new products/services should expect to be judged on results. We wisely don’t judge cell phones, computers, other technological innovations or fundamental freedoms like free speech on just one measure. Relying primarily on standardized tests to evaluate chartered public schools is the wrong direction for this movement. Opportunities to innovate and discover helped make the U.S. a world leader. That energy should be a central part of chartering.
An earlier version of this post appeared on Flypaper as Family and Employer Values Should Guide Charter School Evaluations.
Joe Nathan, Ph.D., helped write the nation's first charter public school law. Legislators and governors in more than 25 states have asked him to testify and provide information about chartering and other school improvement issues. Nathan has spent the last 44 years as a public school teacher, administrator, parent, researcher and advocate. Parent, student & professional groups have given him ...

Join the Movement