At a meeting of the state’s Mastery Examination Committee today, committee members discussed the purpose and use of standardized tests.
“One of the real things that occurred in the last era was a misuse of the state exam,” Commissioner of Education Dianna Wentzell said. “It created an over-focus on the exam itself and a narrowing of the curriculum in some cases to the things that were assessed.”
Don Williams, CEA director of Policy, Research, and Reform, pointed out that education researcher James Popham has strongly cautioned against misusing standardized tests designed for one purpose to fulfill a completely separate purpose.
Popham writes that the validity of a test, such as SBAC, which is designed to evaluate school and district performance, is rendered invalid if it is used for purposes not fully supported by evidence.
Committee members discussed the limitations of SBAC, including its inability to offer teachers and parents specific information to help students learn and grow. Districts alternatively administer a variety of formative assessments in order to identify student needs and adjust ongoing teaching and learning.
Jeffrey Villar, the executive director of the Connecticut Council for Education Reform, said he sees a value for districts in having a robust assessment system that includes benchmark assessments.
“Then you have the end of the year test which, quite candidly, the whole system should ignore while they work through their curriculum,” he said. “It’s when districts pay too much attention to the end score is when they make really bad decisions and you get bad outcomes.”
West Hartford teacher and local Association president Ted Goerner pointed out that it’s hard for teachers to ignore the SBAC and other mastery tests when the threat of these tests being tied to their evaluations hangs over their heads.
“SBAC is a very broad test and only focuses on math, reading, and writing,” he said. “The majority of teachers aren’t math or English teachers.”
“And it’s not just teacher evaluations,” said Williams. “If you’re going to wean school administrations away from focusing on the SBAC score as opposed to formative tests throughout the school year that identify the specific needs of the student, then you’ve got to stop treating SBAC like a high-stakes test that not only goes potentially to teacher evaluation, but to administrator evaluation, and to school ranking. Of course administrators are going to say, ‘SBAC is the most important test’ if it is high-stakes for all those purposes.”
Department of Education to use SBAC to construct growth models
This year Connecticut will, for the first time, use a growth calculation to predict future student performance on the SBAC test, and to measure students’ year-to-year growth on the exam. State Department of Education staff shared that they plan to have school- and district-level growth data available either late this fall or in the early winter.
The growth model sets what Wentzell called “ambitious but attainable goals” for student growth. The model creates a growth target for each individual student based on how he or she performed on the SBAC exam in the previous year. The percent of that target each student actually achieves is then averaged and used as part of Connecticut’s school and district accountability systems. (Click here for more about the growth model.)
The growth model the state Department of Education has developed uses the same growth target for all students at a particular grade and SBAC achievement level—regardless of demographic factors such as English language learner status, socioeconomic status, or parental education level.
Additional discussion regarding SBAC and the growth model will be part of the agenda at the committee’s next meeting on October 19.
Once again, the sub-standard SBAC measure is discussed as if it is entitled to a rational conversation; no discussion of its blatant inadequacies, its psychometric shortcomings, or its unfair and discriminatory use on minority students, special education populations, and foreign language learners. The SBAC discussion revolves around “a growth calculation” formula and various complex statistical machinations to justify the test-and-punish narrative promoted by the State Department of Education which has been failing CT’s students and parents for years. It is ludicrous to use a poorly developed, unproven, and highly controversial assessment protocol for any “high stakes” purpose. Teachers know that to design an assessment that fails the majority of students taking the test is absurd on its face, but then to allow those who favor this practice to continue justifying its use is educational malpractice.