The What Works Clearinghouse Beginning Reading Reports and Rating of Reading Mastery: An Evaluation and Comment
| dc.contributor.author | Stockard, Jean | |
| dc.date.accessioned | 2023-04-12T18:49:08Z | |
| dc.date.available | 2023-04-12T18:49:08Z | |
| dc.date.issued | 2008-09 | |
| dc.description | 58 pages | en_US |
| dc.description.abstract | The What Works Clearinghouse is a federally funded program established in 2002 that evaluates educational interventions on the basis of the “rigor of research evidence” and provides summary ratings on its website. Ratings have appeared only since 2007, and some of the work of the Clearinghouse has already been subjected to harsh criticism. This paper adds to the body of critiques. Direct Instruction’s Reading Mastery curriculum is a comprehensive core reading program that has been found, in decades of research, to be highly effective. Yet, the WWC’s recent review of Reading Mastery concluded that no studies met their evidence standards and they were “unable to draw any conclusions based on research” regarding its effectiveness. A careful examination of the research cited by the WWC found that this conclusion was not well founded. The WWC failed to examine close to 100 research studies that were cited in other well-known reviews of the literature. In addition, reviews of studies that were included were flawed. For instance, one large, well-regarded study was rejected because training of teachers to use the curriculum was considered a “confound” to the use of the curriculum itself. Other studies were dismissed because the treatment (Reading Mastery) and control groups were unequal at baseline. Yet, these differences were statistically controlled and, in two cases, the treatment groups had lower pretest scores but equal and higher posttest scores. Examination of reviews of other curricula indicates that at least some of the material posted on the website is misleading. Summaries do not reflect the conclusions of the articles and, in at least one case, are exactly opposite to the published conclusions. Attempts have been made to communicate these concerns and recommendations for change to the WWC and Mathematica Policy Research, Inc., which administers the Clearinghouse. These concerns and suggestions, which parallel those of other researchers, have been rejected. Given the very serious problems in the review procedures and policies, the NIFDI research staff suggests extreme caution in the use of any ratings or conclusions from the WWC. | en_US |
| dc.identifier.uri | https://hdl.handle.net/1794/28183 | |
| dc.language.iso | en | en_US |
| dc.publisher | National Institute for Direct Instruction (NIFDI) | en_US |
| dc.rights | Creative Commons BY-NC-ND 4.0-US | en_US |
| dc.title | The What Works Clearinghouse Beginning Reading Reports and Rating of Reading Mastery: An Evaluation and Comment | en_US |
| dc.type | Technical Report | en_US |