Strategic Reading Assessment Systems
Types of Reading Assessments
There are three types of assessment identified by researchers that give educators the most useful information in the most efficient way (Coyne, Harn, Mckenna, Wallpole):
Reading assessments can also be skill-based or standards-based.
Skills-based assessments measure a specific foundational reading (decoding) skills or set of skills. Results inform explicit, systematic, cumulative instruction.
Standards-based assessments measure specific academic standards, which require integrated application of foundational reading skills and oral language comprehension skills. Result inform explicit, systematic, cumulative instruction in background knowledge, vocabulary, and comprehension skills improve achievement of specific complex academic standards.
Early screening is vital. The goal of universal, early literacy screening is to identify children at risk of future failure before that failure actually occurs. By doing so, we create the opportunity to intervene early when we are most likely to be more effective and efficient. The key to effective screening is maximizing the ability to predict future difficulties.
Steve Dykstra, 2013
Valid and reliable
All 4K-5th grade students
Three times a year (fall, winter, spring)
Basic reading skills
A skills-based universal screener is the most appropriate, defensible tool for identifying students that have skills deficits and informing the need for a skills-based intervention. If a skills-based universal screener is not used, districts might not identify students with underlying skills deficits or properly align interventions. Further, if districts do not use a skills-based universal screener and are unable to collect accurate data associated with a suspected area of disability, they may run the risk of violating their Child Find obligation.
Tennessee Department of Education (2018, p. 12)
Short - No longer than 30 minutes
Comprehensive - Includes phonological awareness, letter-sound knowledge, rapid naming, listening comprehension, and family history
Resourceful - Typically already part of school resources
Early - Beginning no later than kindergarten
ESL/Dialect Inclusion - All learners are assessed
Neurobiology/Genetics - Family history is examined
Evidence-based response to screening - Screening is followed by evidence-based intervention for the students identified in need
Developmentally appropriate - Developmentally appropriate for the age of the students being assessed
Skills to Assess During Screening
Kindergarten screening is most meaningful when done at least twice (fall and spring) but can also be done three times a year. There are three main areas of skill development that predict risk of later challenges with accuracy and/or automaticity in word reading: phonemic awareness, alphabetic knowledge, and rapid automatized naming.
Phonemic Awareness refers to students’ knowledge of individual sounds in language. Skills typically mastered in kindergarten include:
Identifying the first, last, and middle sound in a word
Ability to blend 2 or 3 sounds together, often comes in late kindergarten
Ability to break apart the sounds in words, a skill that is measured through phoneme segmentation tasks
Note: Phoneme segmentation is a single task that can efficiently reveal students’ larger phonological skills and their verbal working memory skills.
Alphabetic Knowledge refers to students’ familiarity with how the sounds of language are represented in letters and letter patterns. At the beginning of kindergarten, assessment should include:
Letter name and/or letter sound tasks
By the end of the year, students' risk is predicted by:
Letter sound knowledge
Ability to decode nonsense words
Nonsense word decoding requires blending a series of letter sounds together to produce a nonsense word. Using nonsense words allows us to see what a student can do to decode an unfamiliar word. (Nevills, & Wolfe, 2009; Petscher, Fien, Stanley, Gearin, Gaab, Fletcher, & Johnson, 2019; Fien, Baker, Smolkowski, Smith, Kame’enui, & Beck, 2008).
Rapid Automatized Naming (RAN) refers to students’ ability to rapidly name a limited set of repeatedly-presented familiar symbols, such as objects/colors or letters/numbers. Students’ performance on Rapid Automatized Naming tasks is highly predictive of later reading automaticity, as the brain activity involved in naming symbols is also involved in oral reading fluency (Compton, Fuchs, Fuchs, Bouton, Gilbert, Barquero, Cho, & Crouch, 2010).
RAN and letter naming tasks are often confused because both require students to produce names of letters rather than sounds. There are several differences between the two.
Letter Naming :
Measures students’ broad knowledge of the alphabet
Can be timed or untimed
Requires students to name as many upper and lower-case letters as possible
Scores represent the rate at which they are able to retrieve the names of a limited set of symbols (i.e. objects or letters)
A RAN task has several important criteria, including naming letters in order from left-to-right and sufficient familiarity with the items to be named (Compton et al., 2010). The familiarity component is why some school districts choose object or color naming rather than letter or number naming for the initial kindergarten assessment.
Screening in first grade is most effective when done three times a year: fall, winter and spring. Phonemic awareness, alphabetic knowledge and rapid naming tasks continue to be reliable predictors of future challenges with accuracy and/or automaticity. Real word identification and oral reading fluency are also introduced in first grade.
Phonemic Awareness in first grade is often measured by:
Ability to break apart all the individual sounds of a word in a phoneme segmentation task
Manipulate sounds within a word by adding, deleting, or substituting sounds (middle or end of first grade)
Weaknesses in phonemic awareness at any point in the year can inform instructional decision-making.
Alphabetic Knowledge in first grade is highly predictive of later reading achievement. Students’ knowledge of individual letter-sound correspondences and ability to decode nonsense words is essential screening information both for predicting risk and informing instruction (Speece & Ritchey, 2005).
Word Reading emerges more fully in first grade. Single word recognition is an effective screening measure, especially when timed. The timing element indicates whether a student is likely decoding most words sound-by-sound or is recognizing some of the words automatically. Along with Oral Reading Fluency, Word Reading is highly predictive of reading fluency and comprehension in later grades, including performance on standardized assessments (Baker, Smolkowski, Katz, Fien, Seeley, Kame’Enui, & Beck, 2008).
Oral Reading Fluency measures both passage reading accuracy and fluency in a timed assessment, often accompanied by comprehension questions. It also gives information about students’ skills in the areas of vocabulary and syntax knowledge, both of which contribute to overall comprehension. Oral Reading Fluency scores are highly predictive of risk (Baker et al., 2008).
RAN should be administered once at the beginning of the year to serve as a predictor for later challenges with oral reading fluency. These tasks do not need to be administered again or progress monitored because they serve as a predictor of the likelihood of a reading disability in fluency, but not an outcome measure (Norton & Wolf, 2012).
Selecting a Universal Screener
Choosing the right screening tool is critical. Rigorously validated, not brilliantly marketed, instruments are needed. Screening tools are meant to be:
Administered to all students at a particular grade level (except those with vision and/or hearing impairments)
That collect reliable, valid data about students’ risk level
To better understand their academic needs
Wisconsin Statute 118.016 mandates that all public and charter school students enrolled in four-year-old kindergarten to second grade be assessed annually for reading readiness. While the Department of Public Instruction does not require a specific screener, school districts should consider three components to any universal screening tool:
Clinical Psychologist Steve Dykstra explained these components in this way:
Predictive validity is a measure of how well the prediction of future performance matches actual performance along the entire range of performance from highest to lowest, not just at or near the cut score. It answers the question, "If we used this screener to predict how every child will perform at some point in the future, how good would those predictions be?"
Classification accuracy answers the question, "If we used this screener to divide our students into those considered at risk and those considered not to be at risk, how well would we do based on the outcome of their future performance? "(2013, p. 2)
Norm-referenced scores allow us to compare scores on multiple assessments to properly judge whether we have a consistent picture of performance, or whether some of the scores are aberrant and may need special consideration. Normative scoring also gives us better ability to track performance over time. Without normative scoring, we only know if a child scored above or below the cut score for being considered at risk. We do not know how far they may be above or below the cut score, how much that performance may have changed over time, or how it compares to other assessment data we may have on that child. (2013, p. 3)
The following resources can be used to learn more and determine which screener is best for your school or school district:
National Center on Intensive Intervention (NCII) Academic Screening Tools Chart (NCII Tools Chart) to evaluate the scientific evidence of available screeners.
Gaab Lab Early Literacy Assessment/Screener List created by the research teams at the Gaab Lab at Boston Children’s Hospital and the Gabrieli Lab at MIT. The list of screeners for dyslexia risk and early literacy milestones provided in the table is the most comprehensive list available. Gaab and Gabrieli Labs note that the table is not a list of recommended screeners, but rather an overview of ALL screeners, meant to help you compare them. Not all screeners are on the NCII Tools Chart, which only reviews screeners that were directly submitted for evaluation. The NCII Tools Chart will ultimately help you to determine a good screener for your district or school. Retrieved from https://www.gaablab.com/screening-for-reading-impairments.
Screening for Dyslexia. A Report by the National Center for Improving Literacy (Petscher, et al., 2019).
National Center on Improving Literacy (2019). Best practices in universal screening.
It is highly recommended that districts use evidence-based tools to screen for risk of dyslexia, rather than using individual tools created at the district-level. Consider that of late, many school districts are opting to use seemingly low-cost survey or questionnaire-type screeners (asking teachers a series of questions) for assessing dyslexia risk instead of assessing the child directly (Gaab, 2020). This is problematic as several research studies have shown that teacher surveys are poorly correlated with the actual performance of a child, especially at the beginning of Kindergarten (or in any grade as teachers are still getting to know the student). In Examining the Accuracy of Teachers’ Judgments of DIBELS Performance, researchers note that teachers’ judgments of students’ early literacy skills alone may be insufficient to accurately identify students at risk for reading difficulties. Dr. Nadine Gaab indicates that survey or questionnaire-type screeners are biased, often poorly designed and not rigorously validated. They may be cheaper, but are in fact “wasting resources, harming students and hurting advocacy efforts since these tools will lead to inaccurate screenings and will lead to misconceptions that screeners don’t work" (Gaab, 2020). These types of survey assessments should not be used as the sole means of identifying struggling readers in the classroom, but rather could be used to complement direct assessment (Martin and Shapiro, 2011; Graney, 2008; Cabell et al., 2009).
Sensitivity of Balanced Literacy Benchmarking Systems
Administrators really like the Fountas and Pinnell’s Benchmark Assessment System (BAS) because it generates a number that can be put on a spreadsheet. It’s not a particularly instructive number, but it’s a number.
Margaret Goldberg, The Right to Read Project
Universal Screening vs. Identifying Dyslexia
“Screening focuses on a specific set of skills that indicate reading readiness or skills that can predict future reading success, such as phonemic awareness and letter-naming fluency.
Identification or diagnosis focuses on gathering clinical evidence to make a clinical determination.
Diagnostic tests of reading examine more complex skills, such as comprehension and cognitive processes. A screener can lead to a diagnosis, but a diagnosis will need to come from a professional who is approved to diagnose dyslexia." (Pons, 2016)
Any student that scores below the benchmark on the universal screener or otherwise identified as “at risk” should be administered diagnostic assessments to determine student intervention needs. These diagnostic assessments for reading must explicitly measure foundational reading skills and characteristics of dyslexia, including:
Phonological and phonemic awareness
Sound symbol recognition
The informal diagnostic assessments can be used by classroom teachers, Title I teachers, or reading specialists to identify the specific area(s) of need for students. These differ from the formal, norm-referenced assessments school psychologist or special education teachers might use to determine special education eligibility (Hasbrouck, 2020).
There is a solid body of evidence that shows students can be screened for risk of dyslexia before receiving any formal reading instruction. Researchers have identified the brain activation patterns of dyslexia through the use of neuroimaging technology. This “neural signature” is characterized by less activity in key areas of the brain responsible for processing the sounds in language, matching up sounds with letters, and the retrieval of linguistic information (Shaywitz, Shaywitz, Pugh, Mencl, Fulbright, Skudlarski, Constable, Marchione, Fletcher, Lyon, & Gore, 2002 and Ozernov-Palchik, Yu, Wang, & Gaab, 2016). Furthermore, young children who performed poorly in the pre-reading skills of phonemic awareness, rapid automatized object naming and letter identification and were later diagnosed with dyslexia exhibited these underactive patterns before receiving any formal reading instruction (Ozernov-Palchik, Yu, Wang, & Gaab, 2016). This finding suggests that dyslexia is not a result of the daily struggle to learn to read; rather, students possess brain activation patterns that put them at risk before receiving formal instruction (Im, Raschle, Smith, Grant, & Gaab, 2016).
Screening students for the characteristics of dyslexia, as well as other reading disabilities, is an essential step in preventing reading difficulties. Early screening is critical because a dyslexia diagnosis in elementary school has historically depended on what Dr. Nadine Gaab, Harvard Medical School researcher and developmental cognitive neuroscientist, calls a “wait-to-fail-approach” (2017). This approach requires a child to struggle to learn to read over a prolonged period of time before more intensive (more frequent and higher quality) intervention strategies are instituted. So while a dyslexia diagnosis usually is not given before the end of second grade or the beginning of third grade (after the prolonged period of failing), intensive interventions are most effective in kindergarten or first grade (Wanzek & Vaughn, 2007).
There are several reasons why this “wait to fail” framework is problematic. Reading challenges can have a negative impact on the emotional well-being of struggling readers (Mugnaini, Lassi, La Malfa, & Albertini, 2009). Also, when reading interventions are initiated in third grade or after, struggling readers have tremendous difficulty meeting grade-level expectations (Wanzek & Vaughn, 2007).
In addition, schools should screen older students or students who scored at or above benchmark but perform poorly in the classroom or display other indicators for dyslexia.
Baker, S. K., Smolkowski, K., Katz, R., Fien, H., Seeley, J. R., Kame’enui, E. J., & Beck, C. T. (2008). Reading fluency as a predictor of reading proficiency in low-performing, high-poverty schools. School Psychology Review, 37(1), 18–37. https://doi.org/10.1080/02796015.2008.12087905
Bambrick-Santoyo, P. (2019). Driven by data 2.0: A practical guide to improve instruction (2nd ed.). Jossey-Bass.
Breznitz, Z. (2006). Fluency in reading: Synchronization of processes. L. Erlbaum Associates.
Cabell, S. Q., Justice, L. M., Zucker, T. A., & Kilday, C. R. (2009). Validity of teacher report for assessing the emergent literacy skills of at-risk preschoolers. Language, Speech, and Hearing Services in Schools, 40(2), 161–173. https://doi.org/10.1044/0161-1461(2009/07-0099)
Colorado Department of Education. (2020, February 25). Colorado Department of Education dyslexia handbook. Office of Special Education. https://www.cde.state.co.us/cdesped/codyslexiahandbook
Compton, D. L., Fuchs, D., Fuchs, L. S., Bouton, B., Gilbert, J. K., Barquero, L. A., Cho, E., & Crouch, R. C. (2010). Selecting at-risk first-grade readers for early intervention: Eliminating false positives and exploring the promise of a two-stage gated screening process. Journal of Educational Psychology, 102(2), 327–340. https://doi.org/10.1037/a0018448
Coyne, M. D. & Harn, B. A. (2006) Promoting beginning reading success through meaningful assessment of early literacy skills. Psychology in the Schools, 43(1), 33. http://doi.org/10.1002/pits.20127
Duty, L. (2018, November 8). Marysville Schools leading the way: Evolving best practices for learners with dyslexia. International Dyslexia Association. https://dyslexiaida.org/marysville-schools-leading-the-way-evolving-best-practices-for-learners-with-dyslexia/
Dykstra, Steven P. A Literate Nation White Paper. (2013). Selecting screening instruments: Focus on predictive validity, classification accuracy and norm reference scoring. San Francisco, CA: Literate Nation (Fall 2013). Retrieved from https://decodingdyslexianj.org/wp-content/uploads/2020/04/DDNJ_Screening-info-for-law-2014.pdf. Appendix C, pages 10-14.
Fien, H., Baker, S. K., Smolkowski, K., Smith, J. L. M., Kame’enui, E. J., & Beck, C. T. (2008). Using nonsense word fluency to predict reading proficiency in kindergarten through second grade for English learners and native English speakers. School Psychology Review, 37(3), 391–408. https://doi.org/10.1080/02796015.2008.12087885
Fletcher, J. M., Francis, D. J., Foorman, B. R., & Schatschneider, C. (2020). Early detection of dyslexia risk: Development of brief, teacher-administered screens. Learning Disability Quarterly, 073194872093187. https://doi.org/10.1177/0731948720931870
Gaab Lab. (2021, March 1). Early Literacy Screening Tools. Retrieved on January 15, 2022, from https://www.gaablab.com/screening-for-reading-impairments
Gaab, N. [@GaabLab]. (2020, January 10). Many school districts are deciding to use “survey” or “questionnaire” #screeners (asking teachers a series of questions) for assessing #dyslexia [Tweet]. Twitter. https://twitter.com/GaabLab/status/1215812491151921152?s=20
Gaab, N., Ph. D. (2017, February). It’s a myth that young children cannot be screened for dyslexia! International Dyslexia Association. https://dyslexiaida.org/its-a-myth-that-young-children-cannot-be-screened-for-dyslexia/
Goldberg, M. (2019, September 29). Fountas and Pinnell benchmark assessment system: Doesn’t look right, sound right, or make sense. [Blog post]. Reading Rockets. Retrieved January 15, 2022, from https://www.readingrockets.org/blogs/right-read/fountas-and-pinnell-benchmark-assessment-system-doesn-t-look-right-sound-right-or
Graney, S. B. (2008). General education teacher judgments of their low-performing students’ short-term reading progress. Psychology in the Schools, 45(6), 537–549. https://doi.org/10.1002/pits.20322
Habib, M., & Giraud, K. (2013). Dyslexia. In Dulac, O., Lassonde, M., Sarnat, H. B. (Eds.), Handbook of clinical neurology (Vol. 111, pp. 229–235). Elsevier. https://doi.org/10.1016/B978-0-444-52891-9.00023-3
Hasbrouck, Jan. (2020). Conquering dyslexia: A guide to early detection and intervention for teachers and families. Benchmark Education Company, NY. (121)
IDA Editorial Contributors. (2015, June 11). Testing and evaluation. International Dyslexia Association. https://dyslexiaida.org/testing-and-evaluation/
Im, K., Raschle, N. M., Smith, S. A., Ellen Grant, P., & Gaab, N. (2015). Atypical sulcal pattern in children with developmental dyslexia and at-risk kindergarteners. Cerebral Cortex, 26(3), 1138–1148. https://doi.org/10.1093/cercor/bhu305
Kilpatrick, D. A. (2015). Essentials of assessing, preventing, and overcoming reading difficulties (essentials of psychological assessment). John Wiley & Sons.
Martin, S. D., & Shapiro, E. S. (2011). Examining the accuracy of teachers' judgments of DIBELS performance. Psychology in the Schools, 48(4), 343–356. https://doi.org/10.1002/pits.20558
McKenna, M. C. & Walpole, S. (2005) How well does assessment inform our reading instruction? The Reading Teacher, 59(1), 84-86. https://doi.org/10.1598/RT.59.1.9
Moats, L. C., & Dakin, K. E. (2008). Basic facts about dyslexia and other reading problems. Baltimore, MD: The International Dyslexia Association.
Mugnaini, D., Lassi, S., La Malfa, G., & Albertini, G. (2009). Internalizing correlates of dyslexia. World Journal of Pediatrics, 5(4), 255–264. https://doi.org/10.1007/s12519-009-0049-7
National Center on Improving Literacy. (2019). Best Practices in Universal Screening. https://improvingliteracy.org/brief/best-practices-universal-screening. Washington, DC: U.S. Department of Education, Office of Elementary and Secondary Education, Office of Special Education Programs, National Center on Improving Literacy. Retrieved from improvingliteracy.org.
National Center on Intensive Intervention at American Institutes for Research. (2020, June). Academic screening tools chart. National Center on Intensive Intervention. https://charts.intensiveintervention.org/ascreening
Nevills, P. A., & Wolfe, P. A. (2009). Building the reading brain, preK-3 (Second ed.). Corwin.
Norton, E. S., & Wolf, M. (2012). Rapid automatized naming (RAN) and reading fluency: Implications for understanding and treatment of reading disabilities. Annual Review of Psychology, 63(1), 427–452. https://doi.org/10.1146/annurev-psych-120710-100431
Ohio Department of Education. (2020, January). Ohio’s plan to raise literacy achievement. http://education.ohio.gov/getattachment/Topics/Learning-in-Ohio/Literacy/Ohios-Plan-to-Raise-Literacy-Achievement.pdf.aspx?lang=en-US
Ozernov-Palchik, O., Yu, X., Wang, Y., & Gaab, N. (2016). Lessons to be learned: how a comprehensive neurobiological framework of atypical reading development can inform educational practice. Current opinion in behavioral sciences, 10, 45–58. https://doi.org/10.1016/j.cobeha.2016.05.006
Petscher, Y., Fien, H., Stanley, C., Gearin, B., Gaab, N., Fletcher, J.M., & Johnson, E. (2019). Screening for dyslexia. Washington, DC: U.S. Department of Education, Office of Elementary and Secondary Education, Office of Special Education Programs, National Center on Improving Literacy. Retrieved on January 15, 2022, from improvingliteracy.org.
Pons, Donell (2016). Dyslexia: What every educator needs to know. Retrieved from https://www.readinghorizons.com/Media/Default/Documents/Resources/Dyselxia%20E-Book.pdf
Shaywitz, B. A., Shaywitz, S. E., Pugh, K. R., Mencl, W., Fulbright, R. K., Skudlarski, P., Constable, R., Marchione, K. E., Fletcher, J. M., Lyon, G., & Gore, J. C. (2002). Disruption of posterior brain systems for reading in children with developmental dyslexia. Biological Psychiatry, 52(2), 101–110. https://doi.org/10.1016/s0006-3223(02)01365-3
Speece, D. L., & Ritchey, K. D. (2005). A longitudinal study of the development of oral reading fluency in young children at risk for reading failure. Journal of Learning Disabilities, 38(5), 387–399. https://doi.org/10.1177/00222194050380050201
Tennessee Department of Education. (2018). Dyslexia resource guide: Guidance on the "Say Dyslexia" law. https://www.tn.gov/content/dam/tn/education/special-education/dys/dyslexia_resource_guide.pdf
Torgesen, J. K. (1998). Catch them before they fall: Identification and assessment to prevent reading failure in young children. The American Educator, 22, 32–39.
Torgesen, J. K. (2004). Avoiding the devastating downward spiral: The evidence that early intervention prevents reading failure. American Educator, 28, 6–19.
Vellutino, F. R., & Fletcher, J. M. (2009). Developmental dyslexia. In M. J. Snowling & C. Hulme (Eds.), The science of reading: A handbook (pp. 362–378). Blackwell Publishing. https://doi.org/10.1002/9780470757642.ch19
Vellutino, F. R., Scanlon, D. M., Sipay, E. R., Small, S. G., Pratt, A., Chen, R., & Denckla, M. B. (1996). Cognitive profiles of difficult-to-remediate and readily remediated poor readers: Early intervention as a vehicle for distinguishing between cognitive and experiential deficits as basic causes of specific reading disability. Journal of Educational Psychology, 88(4), 601–638. https://doi.org/10.1037/0022-06188.8.131.521
Wanzek, J., & Vaughn, S. (2007). Research-based implications from extensive early reading interventions. School Psychology Review, 36(4), 541–561. https://doi.org/10.1080/02796015.2007.12087917
Wisconsin RtI Center, Wisconsin Department of Public Instruction. (2017). Wisconsin’s framework for equitable multi-level systems of supports. https://dpi.wi.gov/sites/default/files/imce/rti/pdf/rti-emlss-framework.pdf