Professional Documents
Culture Documents
READS
52
6 AUTHORS, INCLUDING:
Deborah K. Reed
Keith Smolkowski
University of Iowa
39 PUBLICATIONS 93 CITATIONS
SEE PROFILE
SEE PROFILE
523435
research-article2014
Article
Abstract
The Council for Learning Disabilities Research Committee hosted a Must Read session at the 35th Annual International
Conference in which they discussed influential articles published between August 1, 2012, and July 31, 2013. Articles were
selected in six areas relevant to learning disabilities research and practice: response to intervention, reading assessment,
math assessment, reading instruction, math instruction, and research methods. The six articles presented by the panel are
summarized and explained with respect to why they are considered a Must Read.
Keywords
response to intervention, reading, math, instruction, assessment, research methods
Part of the mission statement of the Council for Learning
Disabilities (CLD) is to enhance the education of individuals
with learning disabilities (LD). This requires not only rigorous,
evidence-based research on instructional practices, but also
scientific investigations of how to translate findings into natural school settings where they can make the greatest impact.
This concern with what is happening in schools and classrooms and how best to guide the instructional decision making
of practitioners captured the interest of the CLD Research
Committee as it prepared for the annual conference.
The committee members and authors of this article identified several categories of particular relevance to the field:
response to intervention (RTI), reading assessment, math
assessment, reading instruction, math instruction, and
research methods. We then identified articles exemplifying
current work in these categories published between August 1,
2012 and July 31, 2013 that made a significant contribution
to the mission of CLD (see http://www.cldinternational.org/
About/AboutCLD.asp). Members presented their selections
in a panel session at the annual conference and discussed why
the articles represented a Must Read for the past year. A
cross-cutting theme of the pieces was the school-level implementation policies and practices for students with LD.
The first selection, made by Committee Chair Deborah
Reed, addresses features of RTI as it is being implemented
in elementary settings. The assessment pieces were chosen
by Kelli Cummings, focusing on decision-making rules
for curriculum-based measurement (CBM) of reading, and
Elizabeth Allen, examining the diagnostic accuracy of
universal screeners for mathematics. Beverly Weiser
RTI
Deborah K. Reed
Brief Context/Rationale
As is well known, RTI became an allowable option for identifying students with LD under the 2004 reauthorization of
the Individuals With Disabilities in Education Act (IDEA).
1
Corresponding Author:
Deborah K. Reed, Florida Center for Reading Research at Florida State
University, 2010 Levy Ave., Ste 100, Tallahassee, FL 32310, USA.
Email: dkreed@fcrr.org
Jenkins, J. R., Schiller, E., Blackorby, J., Thayer, S. K., & Tilly,
W.D. (2013). Responsiveness to intervention: Architecture
and practices. Learning Disability Quarterly, 36, 3646.
doi:10.1177/0731948712464963
Why this article is a must read. This article offers increasing evidence that those most intimately involved with RTI
implementation at the elementary school level have greater
knowledge of the hallmark elements (e.g., flexible options
for special education students, benchmarking all students,
monitoring progress of those in intervention tiers, increasing intensity of instruction across tiers) than what was
reported just 3 to 4 years ago (e.g., Mellard et al., 2010;
Tackett et al., 2009). Moreover, it did not matter whether
the school was in the 1st year or 2nd of implementation, or
if it had 3 to 7 years of experience. Jenkins et al. (2013)
rightly note the self-report nature of the data lends itself to
providing the right answer; nonetheless, it is encouraging that the RTI leadership in elementary schools at least is
familiar with what the right answers are. At a minimum,
the jargon has taken hold. And there are other indications
in the extant literature that elementary special education
teachers have gone beyond the superficial improvement in
their knowledge of RTI language to improving their practice (Swanson, Solis, Ciullo, & McKenna, 2012). Swanson
and colleagues (2012) observed teachers in Grades 3 to 5
providing more engaging reading instruction that was better oriented to evidence-based practices than what was
reported just a few years ago (Kethley, 2005; Swanson,
2008).
This does not speak to the capacity of general education
teachers or the quality of differentiated instruction occurring in Tier 1, where there is reason to believe special education students might be experiencing far greater variation
in effective practices (Connor et al., 2010). Because Jenkins
and colleagues (2013) did not have any general education
teachers in their sample (apparently because none had sufficient knowledge of RTI implementation in their schools),
it begs reflection on what the field is emphasizing in RTI
implementation and the provision of services for special
education students. Have we focused too much attention on
reading intervention to the point of marginalizing the really
hard work of prevention in core instruction, which was a
main thrust of the 2004 IDEA reauthorization?
Summary. Jenkins and colleagues sought to expand on previous studies of RTI implementation at the state and district
levels (e.g., Mellard, McKnight, & Jordan, 2010; Tackett,
Roberts, Baker, & Scammacca, 2009) by surveying a broader
sample of schools to determine school-level practices. The
sample included personnel from 62 schools in 31 districts
across 17 states. Although urban, suburban, and rural locations were represented, the districts were predominately
small (i.e., 20 or fewer schools and 5,000 or fewer students)
serving mostly White students, 30% or less of whom were on
free/reduced-price lunch. Follow-up phone interviews were
conducted with 71% of the sample. Respondents were those
with detailed knowledge of the schools RTI practices, so the
majority of individuals were principals (n = 13) and RTI
coaches (n = 12). Others were identified as special education
teachers (n = 6), district administrators (n = 6), RTI consultants (n = 4), and reading intervention teachers (n = 2).
All school were implementing RTI in Grades K-3 and
most focused on reading (84%) with fewer focusing on
math (62%), behavior (47%), or all three (30%). The results
revealed more consistency among schools implementing
RTI in reading than noted in the extant literature. For example, most respondents stated they were using benchmark
assessments (98%)typically curriculum-based measures
(90%) and differentiating instruction (80%). However, the
researchers did not ask participants to elaborate on what
they were doing for students of different reading abilities,
so it is unknown how they were defining differentiation.
There was also consistency in intensifying Tier 3 interventions as compared with Tier 2 such as by providing smaller
group, greater time allocation, increased frequency of progress monitoring, and greater expertise of personnel (e.g.,
Tier 2 was more likely to be delivered by a paraprofessional
and Tier 3 was more likely to be delivered by a special
Reed et al.
The other important finding from the Jenkins et al.
(2013) study with implications for refining RTI implementation was the great variation in time allotments for Tiers 2
and 3. It seems intuitive that more instructional time would
be better than less, but the extant literature does not point to
an optimal amount of time for core reading instruction or
reading intervention in K-3. Recently, states have begun
reconsidering the once sacrosanct 90-min uninterrupted
reading block (e.g., Indiana, see Hinnefeld, 2013; West
Virginia, see Miller, 2011). This is likely to result in even
less consistency in intensity across schools unless the field
can generate better guidance for minimum and maximum
minutes of reading instruction and supplemental intervention per week. Earlier research identified optimal group
sizes (Vaughn, Linan-Thompson, & Hickman, 2003), so it
seems a curious gap in the RTI literature to not have
addressed time allotments that drive schools schedules.
Reading Assessment
Kelli D. Cummings
Brief Context/Rationale
CBM began as a tool to be used for evaluating individual
student gains in special education programs (Deno, 2003;
Deno, Mirkin, & Chiang, 1982) and grew in use until it was
considered the most widely used CBM in general education
(Graney & Shinn, 2005). The initial use of CBM as a tool
for basic skills monitoring in special education within a
problem-solving model has been associated with improvements in the precision of student individualized education
program (IEP) goals (Deno, Mirkin, & Wesson, 1984;
Drasgow, Yell, & Robinson, 2001; Shinn, 2008, Yell &
Busch, 2012) and even in the achievement gains made by
groups of students (L. S. Fuchs & Fuchs, 1986; Stecker,
Fuchs, & Fuchs, 2005). In addition, at a group level, there is
robust support for the use of CBM to facilitate screening
decisions, initial instructional grouping, and evaluation of
relative group progress (Wayman, Wallace, Wiley, Ticha,
& Espin, 2007). Notably, the use of CBM (rather than professional judgment alone) to make screening decisions has
evidence of reducing disproportionality in special education
referrals, evaluations, and identification rates (Marston,
Muyskens, Lau, & Canter, 2003).
Despite relatively robust evidence supporting the use of
CBM across a variety of educational contexts, there has
been remarkably little attention in the research literature to
the reliability and validity of the various features of progress monitoring for individual student decisions (e.g., goals,
decisions rules, and methods for evaluating the those rules).
In fact, most progress monitoring recommendations are
very similar, if not exactly the same, as they were during the
initial inception of CBM practice. Thus, for 2013s must
read selection, I recommend a CBM synthesis appearing in
Elizabeth A. Allen
Math Assessment
Brief Context/Rationale
The primary objective of the RTI method of academic intervention is to provide early assistance to children who are at
risk of academic failure. At the heart of the RTI process is
early identification through universal screening. However,
no previously published studies in the area of mathematics
had compared computer-adaptive testing (CAT) measures
with other measures designed for universal screening. This
Reed et al.
left a gap in the literature on the relative concurrent and
predictive validity of CBM and CAT measures of mathematics at a time when school districts were evaluating new
instruments to adopt as universal screening measures for
predicting math achievement on end-of-year state achievement tests. My must read selection is the first study to
address these issues. Its findings have implications for both
test publishers and test users in developing and selecting
measures for use in universal screening.
Shapiro, E. S., & Gebhardt, S. N. (2012). Comparing computeradaptive and curriculum-based measurement methods of
assessment. School Psychology Review, 41(3), 295305.
refers to the accuracy with which a test differentiates students with a disorder (e.g., LD) from those without the
disorder. Methods for establishing diagnostic accuracy
include the calculation of a tests sensitivity and specificity. In this context, sensitivity refers to the ability of a test
to correctly identify students who do have a LDthe most
important attribute of a screening test. Conversely, specificity refers to the ability of a test to correctly identify
students who do not have a LD. Educational researchers
vary regarding how large a tests sensitivity and specificity should be but the recommendations range from .70 to
.90 or higher.
The diagnostic accuracy of the STAR-M, MCAP, and
MCBM was investigated by using each of the measures to
predict outcomes on the PSSA. Because the PSSA uses the
16th percentile as the cut point delineating proficient from
not proficient, it was used as the cut point on all measures.
Across all three measures, sensitivity ranged from .28 to
.72 and specificity ranged from .91 to .97 indicating that
although all three measures were excellent at identifying
students who are not at risk for failure in math (e.g.,
median specificity = .94), none of the three measures was
particularly good at identifying students who are at risk of
failure in math (median sensitivity = .51). When using
STAR-M to predict outcomes on MCAP and MCBM,
results did not improve (median sensitivity = .47; median
specificity = .93).
Why this article is a must read. When selecting measures
for universal screening, schools desire measures that are
well connected to the curriculum and effectively differentiate students who are likely to be at risk of academic failure
from those who are not. Shapiro and Gebhardt (2012) provide the first detailed study in the area of mathematics comparing a CAT measure with any other type of measure
designed for universal screening. The authors found that the
STAR-M consistently showed stronger relations to and was
a better predictor of end-of-year math achievement than
MCAP or MCBM, but even the STAR-M fell far short of
the recommended levels of diagnostic accuracy needed for
a screening measure.
These results illustrate the importance of examining
diagnostic accuracy rather than relying on correlations and
tests of significance when investigating the validity of
assessments. As these results have proven, just because two
measures are highly correlated, they do not necessarily
yield the same results as indicated in studies of diagnostic
accuracy. The findings from the article highlight the importance for test publishers to report studies of diagnostic accuracy and for test users to demand such data for selecting
measures for use in universal screening and diagnosis.
These findings also highlight the need for much more
research comparing CAT with CBM measures for universal
screening.
Reading Instruction
Beverly L. Weiser
Brief Context/Rationale
Although there are experimental studies and extant literature on how to develop literacy skills for beginning readers,
there is a paucity of research on best practices to help older
readers comprehend and write about expository text, especially for students with LD. However, it is clear that students with reading difficulties need explicit and systematic
instruction of strategies and routines to exercise while reading and writing about challenging text across content areas
(Bulgren, Graner, & Deshler, 2013). One such strategy,
self-regulated strategy development (SRSD), developed by
Harris and Graham (1999), blends effective step-by-step
explicit instruction procedures for teachers with self-regulation strategies for students to follow in improving their writing abilities. The teacher steps include developing needed
pre-skills, discussing and modeling the strategy with students, having students memorize the strategy, giving guided
and scaffolded practice, and allowing students to have independent practice. During the process of explicit instruction,
the students are learning procedures for self-regulation such
as self-instruction, goal setting, self-monitoring, and selfreinforcement. In a meta-analysis, Mason (2013) examined
eight studies that combined SRSD with other cognitive
reading strategies and found significant effects for students
in Grades 4 to 8 with reading and writing disabilities.
Mason, L.H. (2013): Teaching students who struggle with learning to think before, while, and after reading: Effects of
self-regulated strategy development instruction. Reading &
Writing Quarterly: Overcoming Learning Difficulties, 29,
124144. doi:10.1080/10573569.2013.758561
Mathematics Instruction
Brittany L. Hott
Brief Context/Rationale
Currently, 45 states, the District of Columbia, and the
Department of Defense have adopted the Common Core
Reed et al.
State Standards (CCSS; NGA & CCSSO, 2010).
Consequently, many school districts have initiated the transition from locally developed standards or those produced by
the National Council for Teachers of Mathematics (NCTM)
to the CCSS. These changes have resulted in numerous curriculum and assessment modifications that affect students
and teachers. Therefore, it is important that practitioners and
researchers be cognizant of the impact these changes might
have on students with math difficulty (MD).
Powell, S. R., Fuchs, L. S., & Fuchs, D. (2013). Reaching the
mountaintop: Addressing the common core standards in mathematics for students with mathematics difficulties. Learning
Disabilities Research & Practice, 28, 3848. doi:10.1111/
ldrp.12001
Research Method
Keith Smolkowski
Brief Context/Rationale
Educators understand that many efficacious interventions
fail to offer practical advantages in their classrooms. An
intervention may produce outstanding student performance
gains in controlled research settings yet lack social validity,
acceptability, and relevance to the students who receive the
intervention or their teachers and parents. Although some
interventions may be too challenging to implement or use
undesirable methods, many simply require too much time,
money, or other scarce resources. Such challenges limit
teachers and administrators ability to adopt, implement,
and maintain many interventions. Reading Recovery (RR),
for instance, has been found to have positive effects by
What Works Clearinghouse (U.S. Department of Education,
2013), but the program requires substantial amount of time
from trained teachers, who typically support just 8 or 10
students per year. Complete implementation requires that
schools provide for program fees, teacher salaries, instructional materials, and rooms with one-way mirrors. Many
schools cannot sustain such an expensive, time-consuming
program. In contrast, schoolwide positive behavior interventions and supports (PBIS), implemented in tens of thousands of schools, has become popular largely because of its
low costs and high social validity. Blonigen and colleagues
Reed et al.
When intervention designers integrate all RE-AIM factors
into their development plan, it forces them to consider
numerous details that can influence the overall impact. In
addition to the RE-AIM framework, Cook and Odom introduce and integrate other works on implementation science,
such as McIntosh, Filter, Bennett, Ryan, and Sugais (2010)
principles of sustainable prevention and Fixsen, Naoom,
Blas, Friedman, and Wallaces (2005) synthesis of implementation research. These works also offer important contributions but are likely to be more familiar to educators.
Ultimately, Cook and Odom present a motivating overview of implementation science with helpful examples.
Implementation is the next, and arguably most critical,
stage of evidence-based reforms (p. 142). Because the
impact of evidence-based practices on children is unavoidably bounded by implementation (p. 142), their suggestion
that special education researchers attend to all aspects of
implementation makes their article my must read.
Funding
The author(s) received no financial support for the research,
authorship, and/or publication of this article.
References
*Items marked with an asterisk were included in the review.
Albano, A. D., & Rodriguez, M. C. (2011). Statistical equating
with measures of oral reading fluency. Journal of School
Psychology, 50, 4359. doi:10.1016/j.jsp.2011.07.002
Ardoin, S. P., & Christ, T. J. (2009). CBM of oral reading: Standard
errors associated with progress monitoring outcomes from
DIBELS, AIMSweb, and an experimental passage set. School
Psychology Review, 38, 266283.
*Ardoin, S. P., Christ, T. J., Morena, L. S., Cormier, D. C., &
Klingbeil, D. A. (2013). A systematic review and summarization of the recommendations and research surrounding
Curriculum-Based Measurement of oral reading fluency
(CBM-R) decision rules. Journal of School Psychology, 51,
118. doi:10.1016/j.jsp.2012.09.004
Blonigen, B., Harbaugh, W., Singell, L., Horner, R. H., Irvin, L.
K., & Smolkowski, K. (2008). Application of economic analysis to School-Wide Positive Behavior Support (SW-PBS)
programs. Journal of Positive Behavior Interventions, 10,
519. doi:10.1177/1098300707311366
Bradley, M. C., Daley, T., Levin, M., OReilly, R., Parsad, A.,
Robertson, A., & Werner, A. (2011). IDEA National assessment implementation study (NCEE 2011-4027). Washington,
DC: National Center for Education Evaluation and Regional
Assistance, Institute of Education Sciences, U.S. Department
of Education.
Bulgren, J. A., Graner, P. S., & Deshler, D. D. (2013). Literacy
challenges and opportunities for students with learning disabilities in social studies and history. Learning Disabilities
Research & Practice, 28, 1727. doi:10.1111/ldrp.12003
Burns, M. K., Egan, A. M., Kunkel, A. K., McComas, J., Petereson,
M. M., Rahn, N. L., & Wilson, J. (2013). Training for generalization and maintenance in RTI implementation: Frontloading for sustainability. Learning Disabilities Research &
Practice, 28, 8188. doi:10.1111/ldrp.12009
Christ, T. J., Zopluoglu, C., Long, J., & Monaghen, B. D. (2012).
Curriculum-based measurement of oral reading: Quality of progress monitoring outcomes. Exceptional Children, 78, 356373.
Christ, T. J., Zopluoglu, C., Monaghen, B. D., & Van Norman,
E. R. (2013). Curriculum-based measurement of oral reading: Multi-study evaluation of schedule, duration, and dataset
quality on progress monitoring outcomes. Journal of School
Psychology, 51, 1957. doi:10.1016/j.jsp.2012.11.001
Compton, D. L., Gilbert, J. K., Jenkins, J. R., Fuchs, D., Fuchs,
L. S., Eunsoo, C., . . .Bouton, B. (2012). What level of data is
necessary to ensure selection accuracy? Journal of Learning
Disabilities, 45, 204216. doi:10.1177/0022219412442151
Connor, C. M., Ponitz, C. C., Phillips, B. M., Travis, Q. M.,
Glasney, S., & Morrison, F. J. (2010). First graders literacy
and self-regulation gains: The effect of individualizing student instruction. Journal of School Psychology, 48, 433455.
doi:10.1016/j.jsp.2010.06.003
*Cook, B. G., & Odom, S. L. (2013). Evidence-based practices
and implementation science in special education. Exceptional
Children, 79(2), 135144.
Cummings, K. D., Park, Y., & Bauer Schaper, H. A. (2013).
Equating DIBELS next oral reading fluency progress
10
*Jenkins, J. R., Schiller, E., Blackorby, J., Thayer, S. K., & Tilly,
W. D. (2013). Responsiveness to intervention: Architecture
and practices. Learning Disability Quarterly, 36, 3646.
doi:10.1177/0731948712464963
Johnston, J. M., Foxx, R. M., Jacobson, J. W., Green, G., &
Mulick, J. A. (2006). Positive behavior support and applied
behavior analysis. The Behavior Analyst, 29, 5174.
Judge, S., & Watson, S. M. R. (2011). Longitudinal outcomes for
mathematics achievement for students with learning disabilities. The Journal of Educational Research, 104, 147157.
doi:10.1080/00220671003636729
Kethley, C. I. (2005). Case studies of resource room reading
instruction for middle school students with high-incidence disabilities (Unpublished doctoral dissertation). The University
of Texas at Austin.
Marston, D., Muyskens, P., Lau, M., & Canter, A. (2003). Problemsolving model for decision making with high-incidence disabilities: The Minneapolis experience. Learning Disabilities
Research & Practice, 18, 187200. doi:10.1111/15405826.00074
*Mason, L. H. (2013). Teaching students who struggle with
learning to think before, while, and after reading: Effects of
self-regulated strategy development instruction. Reading &
Writing Quarterly: Overcoming Learning Difficulties, 29,
124144. doi:10.1080/10573569.2013.758561
Mazzocco, M. M., Feigenson, L., & Halberda, J. (2011). Impaired
acuity of the approximate number system underlies mathematical learning disability (dyscalculia). Child Development,
82, 12241237. doi:10.1111/j.1467-8624.2011.1608x
McIntosh, K., Filter, K. J., Bennett, J. L., Ryan, C., & Sugai,
G. (2010). Principles of sustainable prevention: Designing
scale-up of school-wide positive behavior support to promote durable systems. Psychology in the Schools, 47, 521.
doi:10.1002/pits.20448
Mellard, D., McKnight, M., & Jordan, K. (2010). RTI tier structures and instructional intensity. Learning Disabilities
Research & Practice, 24, 185195. doi:10.1111/j.15405826.2010.00319.x
Miller, D. (2011, June 18). Schools drop rule that thwarted reading. Read Aloud West Virginia. Retrieved from http://www.
readaloudwestvirginia.org/miller061811.php
National Center for Education Statistics. (2011). The nations
report card: Reading 2011National assessment of educational progress at grades 4 and 8 (NCES2012-457).
Washington, DC: Institute of Education Sciences, U.S.
Department of Education.
National Governors Association Center for Best Practices &
Council of Chief State School Officers. (2010). Common core
state standards. Washington, DC: Author.
*Powell, S. R., Fuchs, L. S., & Fuchs, D. (2013). Reaching the
mountaintop: Addressing the common core standards in mathematics for students with mathematics difficulties. Learning
Disabilities Research & Practice, 28, 3848. doi:10.1111/
ldrp.12001
Shalev, R. S., Auerbach, J., Manor, O., & Gross-Tsur, V. (2000).
Developmental dyscalculia: Prevalence and prognosis.
European Child & Adolescent Psychiatry, 9, 5864.
Shanahan, T. (2008). Relations among oral language, reading,
and writing development. In C. A. MacArthur, S. Graham,
11
Reed et al.
& J. Fitzgerald (Eds.), Handbook of writing research (pp.
171186). New York, NY: Guilford Press.
*Shapiro, E. S., & Gebhardt, S. N. (2012). Comparing computeradaptive and curriculum-based measurement methods of
assessment. School Psychology Review, 41, 295305.
Shinn, M. R. (2008). Best practices in using curriculum-based
measurement in a problem-solving model. In A. Thomas &
J. Grimes (Eds.), Best practices in school psychology-V (pp.
243262). Washington, DC: National Association of School
Psychologists.
Shinn, M. R., Good, R. H., & Stein, S. (1989). Summarizing trend
in student achievement: A comparison of methods. School
Psychology Review, 18, 356370.
Stecker, P. M., Fuchs, L. S., & Fuchs, D. (2005). Using curriculum-based measurement to improve student achievement:
Review of the research. Psychology in the Schools, 42, 795
819. doi:10.1002/pits.20113
Swanson, E. A. (2008). Observing reading instruction for students
with LD: A synthesis. Learning Disability Quarterly, 31, 119.
Swanson, E., Solis, M., Ciullo, S., & McKenna, J. W. (2012). Special
education teachers perceptions and instructional practices in
response to intervention implementation. Learning Disability
Quarterly, 35, 115126. doi:10.1177/0731948711432510
Tackett, K. K., Roberts, G., Baker, S., & Scammacca, N. (2009).
Implementing response to intervention: Practices and