Date of Award

12-7-2022

Degree Type

Thesis

Degree Name

Master of Science (MS)

Department

Psychology

Advisor(s)

Russo, Natalie

Keywords

Curriculum Based Measurement, Teacher Judgments, Written Expression

Subject Categories

Education | Psychology

Abstract

Nearly 75% of students in the United States of America are not meeting grade-level standards in the area of writing (NCES, 2012; Persky et al., 2003), despite this skill impacting students’ performances in other academic areas (Ray et al., 2016), and limiting students’ access to higher education (Addison & McGee, 2010), and opportunities for jobs in the adult workforce (National Commission on Writing, 2005). Because difficulties with early writing skills are associated with later writing skills deficits (Juel, 1988), it is crucial that educators accurately identify students in need of additional support in order to provide them with appropriate instruction. Two common methods for identifying students are through teacher referral and standardized assessments such as Curriculum-Based Measurement-Written Expression (CBM-WE). Although levels of agreement between teacher referral and CBM-WE were examined in the past, this study extended the literature by conducting kappa analyses to investigate levels of agreement in order to take chance into account. In addition, due to differences in students’ performances on national assessments based on gender (Reilly et al., 2019), as well as differences between national and state normative data, levels of agreement were investigated as a function of gender and normative type. Results of this study suggest that levels of agreement may vary based on the CBM-WE scoring metric used and the student’s gender, but no evidence was found to suggest using national or local norms impacted agreement. Furthermore, this study revealed poor levels of agreement for female students with writing skills below the 10th percentile across, suggesting that schools may need to use converging data sources to accurately identify female students in need of support. Limitations, directions for future research, and further implications are also discussed.

Access

Open Access

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.