The National Council on Teacher Quality (NCTQ) recently put out another technical report. This technical report graded 700 teacher preparation programs across the country (Ellis, et al., 2026). However, a critical evaluation shows why this report can’t be taken seriously. It contains an abundance of misinformation, disinformation, and convenient inaccuracies. It’s not known if these were intentional on the part of the writers or a result of a lack of knowledge. If you’re looking for accessible, research-based information that slices through the endless loads of overly worded baloney, I would encourage you to subscribe to my free Substack, The Reading Instruction Show. Substack: The Reading Instruction Show https://thereadinginstructionshow.substack.com/
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
Transcript
From the show. Tap a time to play from there.
This is the Reading Instruction Show. I'm your host, as always, Dr. Andy Johnson. Topic of today's podcast, the latest NCTQ technical report does not meet basic academic standards. And it's an excerpt from my book, Making Sense of the Science of Reading, Teachers Matter, that will be published by Guilford sometime in 2028. Now the National Council on Teacher Quality, NCTQ, recently put
out another technical report. This technical report graded 700 teacher preparation programs across the country. However, a critical evaluation shows why this report can't be taken seriously. It contains an abundance of misinformation, disinformation, and convenient inaccuracies. And it's not known if these were intentional on the part of the
writers or a result of a lack of knowledge. And this chapter contains my initial analysis, but first a little context. Part one, the necessity of analyses and critical evaluations. Academia, or the academy, refers to the community of scholars and researchers who seek new knowledge. And within the academy, members seek to maintain standards
within their respective academic fields. This means we critically evaluate each other's work. And this is an important part of the academic process. This type of critical evaluation along with accompanying academic discourse keeps our various academic fields evolving. Now academic discourse has traditionally occurred through
our books, journals, and academic conferences, but today increasingly these conversations also occur on various social media platforms. This is a healthy development as it opens up the conversation to a wider audience and more participants. However, the one thing missing on social media platforms,
as you know, is any form of peer review or checks and balances. Anybody can write things or say things. And in this sense, The conversations taking place on social media are no different from this NCTQ technical report. Literacy instruction is a field within the Academy, and I am a scholar in the field of literacy instruction. As such,
I will be analyzing and critically evaluating this technical report on its merit. Nobody gets a free ride in the academy. In the academy we must all be held accountable for our words. And I would expect that someone will do the same type of evaluation with this chapter. And that is a wonderful thing. Chapter 2, there is no
reading crisis. The first sentence of the second paragraph of this report says that, quote, 40 % of fourth graders in the United States cannot read at a basic level. The worst results in over two decades, unquote. Now this sentence would have you believe there's a reading crisis, but this would be a convenient inaccuracy. There
is no irrefutable evidence that we are experiencing a national literacy crisis. NAEP reading scores for fourth and eighth graders from 1971 to 2020 shows that there have been natural fluctuations as we would expect, but there have been no massive declines in reading test scores. In both fourth
grade and eighth grade, average scores are slightly higher than they were in 1971, up to the COVID dip in 2020. Also, pre -COVID scores are basically the same as they were 20 years ago. Because the same norm reference test versus criterion reference tests are given over time, NAP data enables comparisons
to be made between states and various subgroups and over time. Also, the populations tested are representative and large enough for the results to be generalized with a fair amount of confidence. That's why we use NAEP data and not state criterion reference tests. In both fourth and eighth grade, the 2024 scores were lower than they were before
the COVID crisis in 2019, as we would expect, and this difference is statistically significant. Statistical significance means that the differences are large enough to eliminate chance or error as the cause of the difference. By 2022, 37 states and territories had passed reading laws. We might have expected to see some impact on the national
trends of fourth grade students by 2024, but this has not been the case. As of 2026, 44 states and Washington DC have passed legislation mandating evidence -based reading instruction aligned with the science of reading. And if this news scientifically based Reading instruction works as promised. In 2028 and later, we should see NAP scores of
fourth grade students to be at least where they were in the pre -COVID era. That means 220 or higher. Check back in 2028. Part three, a basic understanding of basic level. So let's get to the crux of the matter. As stated above, the NCTQ report claims that 40 % of fourth grade students in the United States cannot read at
a basic level. And if this were even a little bit true, it would be a horrible thing. But the problem with this technical report is that it's not even a little bit true. So that means that everything that follows is based on a false premise. Let me explain. Basic level. NAEP test data shows that in general, teachers have been doing a pretty good job. So to find some failure in 1992, the
NAEP decided to add three levels of proficiency. Basic, proficient, and advanced. However, These proficiency levels were arbitrarily defined. In addressing NAEP levels, Rinking Ruby and Risco said, and I quote, who had been contracted to
advise the department of this approach, but who were overruled when they were argued against doing it at all." These NAEP proficiency levels should be given very little credence. The National Center for Educational Statistics website provides three reasons for this. They said, this is NCEES,
proficiency levels are based on expectations, meaning that these levels are aspirational, not mathematical. Two, these proficiency levels are currently being used on a trial basis, since 1992 apparently, but that's what it says on their website. And three, Further evidence is needed to determine if these proficiency levels are reasonable, valid, and informative. So let me
put it plainly. A group of people got together in 1992. They saw that the average score of fourth grade students was 217. So if that was average, they decided That basic had to be something a little below that. And a score of 208 was a little below 217. So 208 was declared to be the basic
level. It had nothing to do with basic skills. It had nothing to do with what was or wasn't learned. The sole determination of basic level was that it wasn't quite 217. Imagine that. If you arbitrarily decide that the basic level will be slightly below average, you are guaranteeing that at least 40 % of a normal population will
be reading below the basic level. In other words, if the basic level is at the 40th percentile, 40 % of the population will be below a basic level. That's how percentiles work, you see? Let me show you from another perspective. A normal population is represented by the familiar bell -shaped curve. And in any normal population,
50 % are going to be above the mean and 50 % below. This means that there always be 50 % who score below average. This is called normal. And if you arbitrarily define basic level as slightly below the mean, you'll have at least 40 % of the population reading below the basic level. Imagine that. So, final word. In this chapter,
I've addressed only the first three paragraphs of this 107 -page technical report. But based on this, one should carefully consider whether to spend time reading the next 106 pages. However, six big ideas here. Number one, literacy instruction is a field within the greater academy. Critical analyses and evaluations are an essential part
of the academy. It keeps academic fields evolving, maintaining a set of academic standards, and provides a set of checks and balances. Two, there never was a literacy crisis. Three, the basic level is an arbitrarily defined level, guaranteeing that approximately 40 % of the population will always be below the basic level. Four, the basic
level is not based on a set of skills mastered, rather it's based on a score being a little below average. Five, we should all be held accountable for our words. Nobody in the academy should get a free ride. And if the NCTQ enters into an academic field, such as literacy instruction, if they enter that discussion, they should be held to
the same academic standards as the rest of us. And number six, the misuse of endnotes in citations has not been addressed. However, it's abundantly clear after reading the first three paragraphs that this NCTQ technical report does not meet basic academic standards. In the next podcast or chapter, we'll examine this NCTQ report as
it relates to teacher preparation programs. This has been The Reading Instruction Show. I am your host, Dr. Andy Johnson.
The Science of Reading seems to refer to a general consensus related to the strategies and practices that lead to improved reading outcomes. These strategies and practices have been determined to be effective using...
Using Blanche DuBois’s tragic reliance on the "kindness of strangers" as a central metaphor, this article critiques the recurring cycle of corporate-driven reading mandates and the reduction of literacy instruction to...
If you’re looking for accessible, research-based information that slices through the endless loads of overly worded baloney, I would encourage you to subscribe to my free Substack, The Reading Instruction Show....
Purpose statement: The reader will become more effective in evaluating online sources related to reading instruction. Behavioral objective: Readers will be able to identify instances in which confirmation bias results...
If you’re looking for accessible, research-based information that slices through the endless loads of overly worded baloney, I would encourage you to subscribe to my free Substack, The Reading Instruction Show....