Feeds:
Posts
Comments

Posts Tagged ‘Ontario Student Assessment’

The latest student achievement results, featured in the April 30, 2018 Pan-Canadian Assessment Program (PCAP) 2016 report, prove, once again, how system-critical testing is for K-12 education. Students in every Canadian province except Ontario saw gains in Grade 8 student scores from 2010 to 2016 and we are now much the wiser. That educational reality check simply confirms that it’s no time to be jettisoning Ontario’s Grade 3 provincial tests and chipping away at the reputation of the province’s independent testing agency, the Education Quality and Accountability Office (EQAO).

The plan to end Grade 3 provincial testing arrived with the final report of Ontario: A Learning Province, produced by OISE professor Carol Campbell and her team of six supposedly independent advisors, including well-known change theorists Michael Fullan, Andy Hargreaves and Jean Clinton. Targeting of the EQAO was telegraphed in an earlier discussion paper, but the consultation phase focused ostensibly more on “broadening measures of student success” beyond achievement and into the largely uncharted realm of “social and emotional learning” (SEL).

The final report stunned many close observers in Ontario who expected much more from the review, and, in particular, an SEL framework for assessment and a new set of “student well- being” reports for the 2018-19 school year.  Tampering with Grade 3 testing made former Ontario Deputy Minister Charles Pascal uncomfortable because it interfered with diagnosis for early interventions.

It also attracted a stiff rebuke from the world’s leading authority on formative assessment, British assessment specialist Dylan Wiliam. He was not impressed at all with the Campbell review committee report. While it was billed as a student assessment review, Wiliam noted that none of the committee members is known for expertise in assessment, testing or evaluation.

Education insiders were betting that the Kathleen Wynne Liberal-friendly review team would simply unveil the plan for “broader student success” developed by Annie Kidder and her People for Education lobby group since 2012 and known as the “Measuring What Matters” project. It is now clear that something happened to disrupt the delivery of that carefully nurtured policy baby. Perhaps the impending Ontario provincial election was a factor.

Social and emotional learning is now at the very core of Ontario’s Achieving Excellence and Equity agenda and it fully embraces “supporting all students” and enabling them to achieve “a positive sense of well-being – the sense of self, identity, and belonging in the world that will help them to learn, grow and thrive.”

The Ontario model, hatched by the Education Ministry in collaboration with People for Education, is based upon a psycho-social theory that “well-being” has “four interconnected elements” critical to student development, with self/spirit at the centre. The whole formulation reflects the biases of the architects, since grit, growth mindset, respect and responsibility are nowhere to be found in the preferred set of social values inculcated in the system. Whatever the rationale, proceeding to integrate SEL into student reports and province-wide assessments is premature when recognized American experts Angela Duckworth and David Scott Yeager warn that the ‘generic skills’ are ill- defined and possibly unmeasureable.

Evidence-informed researchers such as Daisy Christodoulou, author of Making Good Progress (2017), do not support the proposed change in Ontario student assessment focus. Generic or transferable skills approaches such as Ontario is considering generate generic feedback of limited value to students in the classroom. Relying too heavily on teacher assessments is unwise because, as Christodoulou reminds us, disadvantaged students tend to fare better on larger-scale, objective tests. The proposed prose descriptors will, in all likelihood, be jargon-ridden, unintelligible to students and parents, and prove particularly inaccessible to students struggling in school.

One of the reasons Ontario has been recognized as a leading education system is because of its success over the past 20 years in establishing an independent EQAO with an established and professionally-sound provincial testing program in Grades 3, 6, and 9 and a Grade 10 literacy test that needs improvement. Legitimate teacher concerns about changes that increase marking loads do need to be addressed in any new student assessment plan and so do objections over the fuzzy, labour-intensive SEL student reports.

The proposal to phase out Ontario provincial testing may already be dead in the water.  If it is, you can guess that the April 30, 2018 editorial in The Toronto Star was definitely a contributing factor.  If the Wynne Liberals go down to defeat in the June 2018 election, the whole plan will likely be shelved or completely revamped by a new government.

Whether you support the EQAO or not, the agency has succeeded in establishing reliable quality standards for student performance in literacy and mathematics. Abandoning Grade 3 testing and gutting the EQAO is not only ill-conceived, but ill advised. Without the PCAP and provincial achievement benchmarks we would be flying blind into the future.

What can possibly be gained from eliminating system-wide Grade 3 provincial assessments?  How does that square with research suggesting early assessments are critical in addressing reading and numeracy difficulties?  Without Ontario, would it be possible to conduct comprehensive Grade 3 bench-marking across Canada?  If staff workload is the problem, then aren’t there other ways to address that matter?  And whatever happened to the proposed Social and Emotional Learning (SEL) assessments and reports? 

Advertisements

Read Full Post »

Ontario now aspires to global education leadership in the realm of student evaluation and reporting. The latest Ontario student assessment initiative, A Learning Province, announced in September 2017 and guided by OISE education  professor Dr. Carol Campbell, cast a wide net encompassing classroom assessments, large scale provincial tests, and national/international assessment programs.  That vision for “student-centred assessments” worked from the assumption that future assessments would capture the totality of “students’ experiences — their needs, learning, progress and well-being.”

The sheer scope whole project not only deserves much closer scrutiny, but needs to be carefully assessed for its potential impact on frontline teachers. A pithy statement by British teacher-researcher Daisy Christodoulou in January 2017 is germane to the point: “When government get their hands on anything involving the word ‘assessment’, they want it to be about high stakes monitoring and tracking, not about low-stakes diagnosis.”  In the case of  Ontario, pursuing the datafication of social-emotional-learning and the mining of data to produce personality profiles is clearly taking precedence over the creation of teacher-friendly assessment policy and practices.

One of the reasons Ontario has been recognized as a leading education system is because of its success over the past 20 years in establishing an independent Education Quality and Accountability Office  (EQAO) with an established and professionally-sound provincial testing program in Grades 3, 6, 9 and 10.  Whether you support the EQAO or not, most agree that is has succeeded in establishing reliable benchmark standards for student performance in literacy and mathematics.

The entire focus of Ontario student assessment is now changing. Heavily influenced by the Ontario People for Education Measuring What Matters project, the province is plunging ahead with Social and Emotional Learning (SEL) assessment embracing what Ben Williamson aptly describes as “stealth assessment” – a set of contested personality criteria utilizing SEL ‘datafication’ to measure “student well-being.” Proceeding to integrate SEL into student reports and province-wide assessments is also foolhardy when American experts Angela Duckworth and David Scott Yeager warn that the ‘generic skills’ are ill- defined and possibly unmeasureable.

Social and emotional learning is now at the very core of Ontario’s Achieving Excellence and Equity agenda and it fully embraces “supporting all students” and enabling them to achieve “a positive sense of well-being – the sense of self, identity, and belonging in the world that will help them to learn, grow and thrive.” The Ontario model is based upon a psycho-social theory that “well-being” has “four interconnected elements” critical to student development, with self/spirit at the centre. Promoting student well-being is about fostering learning environments exhibiting these elements:

Cognitive: Development of abilities and skills such as critical thinking, problem solving, creativity, and the ability to be flexible and innovative.

Emotional: Learning about experiencing emotions, and understanding how to recognize, manage, and cope with them.

Social: Development of self-awareness, including the sense of belonging, collaboration, relationships with others, and communication skills.

Physical: Development of the body, impacted by physical activity, sleep patterns, healthy eating, and healthy life choices.

Self/Spirit:  Recognizing the core of identity whieh has “different meanings for different people, and can include cultural heritage, language, community, religion or a broader spirituality.”

Ontario’s new student report cards, proposed for 2018-19 implementation, will incorporate an distinct SEL component with teacher evaluations on a set of “transferable skills” shifting the focus from organization and work habits to “well-being” and associated values, while retaining grades or marks for individual classes. The Ontario Education “Big Six” Transferable Skills are: critical thinking, innovation and creativity, self-directed learning, collaboration, communication, and citizenship.  Curiously absent from the Ontario list of preferred skills are those commonly found in American variations on the formula: grit, growth mindset, and character

The emerging Ontario student assessment strategy needs to be evaluated in relation to the latest research and best practice, exemplified in Dylan Wiliam’s student assessment research and Daisy Christodoulou’s 2017 book Making Good Progress: The Future of Assessment for Learning.  Viewed through that lens, the Ontario student assessment philosophy and practice falls short on a number of counts.

  1. The Generic Skills Approach: Adopting this approach reflects a fundamental misunderstanding about how students learn and acquire meaningful skills. Tacking problem-solving at the outset, utilizing Project-Based Learning to “solve-real life problems” is misguided  because knowledge and skills are better acquired  through other means. The “deliberate practice method” has proven more effective. Far more is learned when students break down skills into a ‘progression of understanding’ — acquiring the knowledge and skill to progress on to bigger problems.
  2. Generic Feedback: Generic or transferable skills prove to be unsound when used as a basis for student reporting and feedback on student progress. Skills are not taught in the abstract, so feedback has little meaning for students. Reading a story and making inferences, for example, is not a discrete skill; it is dependent upon knowledge of vocabulary and background context to achieve reading comprehension.
  3. Hidden Bias of Teacher Assessment: Teacher classroom assessments are highly desirable, but do not prove as reliable as standardized measures administered under fair and objective conditions. Disadvantaged students, based upon reliable, peer-reviewed research, do better on tests than of regular teacher assessments. “Teacher assessment is biased not because they are carried out by teachers, but because it is carried out by humans.”
  4. Unhelpful Prose Descriptors: Most verbal used in system-wide assessments and reports are unhelpful — tend to be jargon-ridden, unintelligible to students and parents, and prove particularly inaccessible to students struggling in school. Second generation descriptors are “pupil friendly” but still prove difficult to use in learning how to improve or correct errors.
  5. Work-Generating Assessments: System-wide assessments, poorly constructed, generate unplanned and unexpected marking loads, particularly in the case of qualitative assessments with rubrics or longer marking time. In the U.K., for example, the use of grade descriptors for feedback proved much more time consuming than normal grading of written work Primary teachers who spent 5 hours a week on assessment in 2010, found that, by 2013, they were spending 10 hours a week.AssessmentMarkLoadCrisisWhat’s wrong with the new Ontario Assessment Plan and needs rethinking?
  1. The Generic Skills Approach – Teaching generic skills (SEL) doesn’t work and devalues domain-specific knowledge
  2. Social and Emotional Learning (SEL) models — carry inherent biases and are unmeasurable
  3. Breach of Student Security – Data mining and student surveys generate personality data without consent
  4. Erosion of Teacher Autonomy – Student SEL data generated by algorithms, creates more record-keeping, more marking, cuts into classroom time.

The best evidence-based assessment research, applied in deconstructing the Ontario Assessment initiative, raises red flags.  Bad student assessment practices, as Wiliam and Christodoulou show, can lead to serious workload problems for classroom teachers. No education jurisdiction that lived up to the motto “Learning Province” would plow ahead when the light turns to amber.

A summary of the researchED Ontario presentation delivered April 14, 2018, at the Toronto Airport Westin Hotel. 

Where is the new Ontario student assessment initiative really heading? Is it a thinly-disguised attempt to create a counterweight to current large-scale student achievement assessments? Is it feasible to proceed with SEL assessment when leading researchers question its legitimacy and validity? Are we running the risk of opening the door to the wholesale mining of student personal information without consent and for questionable purposes? 

Read Full Post »