Evaluating Learners: How Much Is Enough?

  • How many eval­u­a­tion activ­i­ties in a course are enough to grade and pro­vide a final mark to stu­dents?
  • How much work should stu­dents do to demon­strate their learn­ing through course eval­u­a­tion meth­ods (tests, quizzes, projects, assign­ments)?
  • How much is too much — when stu­dent learn­ing will suf­fer because of too much work­load, expec­ta­tions and brain pow­er?
  • Are we teach­ing stu­dents how to be learn­ers in the eval­u­a­tion process and includ­ing eval­u­a­tions of their meth­ods and strate­gies? 
  • Should all cours­es have a learn­ing out­come about metacog­ni­tion — learn­ing about learn­ing?

This page pro­vides a one-stop spot to dive a bit deep­er into think­ing about how much is the right amount of eval­u­a­tion to have in a course that will sup­port qual­i­ty stu­dent learn­ing but also sup­port a bal­anced course for well-being of the learn­ers and instruc­tors.

Answers to State­ments at Bot­tom of Page (10, 14, 15, 19 and 20)

institutional Policy

North Island Col­lege has an Eval­u­a­tion of Stu­dent Per­for­mance pol­i­cy (3–33). Key prin­ci­ples and pro­ce­dures are shared below but NIC instruc­tors are encour­aged to ful­ly read the entire pol­i­cy.

  • Pol­i­cy 3–33 Eval­u­a­tion of Stu­dent Per­for­mance: Link
  • Prin­ci­ple #3: Eval­u­a­tion of stu­dent per­for­mance will be aligned with course learn­ing out­comes and is inclu­sive of diverse learn­ing needs.
    • Pro­ce­dure #1: The student’s final grade for a course must be com­prised of a min­i­mum of three eval­u­a­tive com­po­nents with no sin­gle eval­u­a­tion worth more than 40%.
    • Pro­ce­dure #2: Eval­u­a­tions should be var­ied to ensure stu­dents can meet the cours­es’ learn­ing out­comes.
  • Prin­ci­ple #6: NIC sup­ports stu­dent suc­cess by not per­mit­ting eval­u­a­tions worth more than 10% of their final grade to be assigned in the last week of class­es.
    • Pro­ce­dure #6: Eval­u­a­tions total­ing more than 10% of the final grade may be due in the last week of instruc­tion as long as they were assigned pri­or to the final week of class­es. Nor­mal­ly, assign­ments will not be due lat­er than the last day of class­es.
  • Prin­ci­ple #4: Stu­dents must receive ade­quate feed­back (nor­mal­ly a min­i­mum of 20% of the total grade) in advance of the aca­d­e­m­ic with­draw­al date for their pro­gram.
NIC Assessment and Evaluation Principles and techniques
  • Prin­ci­ples of Assess­ment and Exam­ples: Link
  • Assess­ment: Sim­ple, Focused and Aligned Ideas: Link
  • Class­room Assess­ment Tech­niques: Link
Student course Time: Workload Calculator
  • A nifty tool for instruc­tors to use when plan­ning the activ­i­ties and learn­ing expe­ri­ences for stu­dents. Includ­ing both instruc­tion­al and eval­u­a­tion strate­gies, this tool (orig­i­nal­ly cre­at­ed by Bet­sy Barre at Wake For­est Uni­ver­si­ty), has been adapt­ed by UBC
    • Stu­dent Course Time Esti­ma­tor: Link
  • Use to esti­mate the work­load you will be expect­ing stu­dents to under­take in your course(s) and this will help in look­ing at stu­dent eval­u­a­tions and mak­ing suit­able align­ments.
Evaluation Alignment Chart
  • The very best way to see how much is enough — is to map out your course learn­ing out­comes with the eval­u­a­tion (sum­ma­tive assess­ment) and the teach­ing strate­gies to see if you are abid­ing by the prin­ci­ples and pro­ce­dures per the pol­i­cy ALONG with the work­load cal­cu­la­tor results of how much work stu­dents are doing in the course ALONG with reflect­ing on what stu­dents learn/stickiness of learn­ing a few months after the course
  • This is called course “con­struc­tive align­ment” where each learn­ing out­come has suf­fi­cient for­ma­tive (infor­mal, prac­tice) oppor­tu­ni­ties and aligned and prop­er­ly designed eval­u­a­tions (for­mal, sum­ma­tive) to allow stu­dents to demon­strate their learn­ing.
  • A well-designed eval­u­a­tion can cov­er mul­ti­ple learn­ing out­comes and pro­vide a suit­able demon­stra­tion of stu­dent learn­ing.
  • Why should assess­ments, learn­ing objec­tives, and instruc­tion­al strate­gies be aligned? (CMU) — Link
Course Learn­ing Out­come Eval­u­a­tion Method (sum­ma­tive) Learn­ing Lev­el Assess­ment  (for­ma­tive) Teach­ing and Learn­ing Strate­gies
cre­ate a project plan with iden­ti­fied deliv­er­ables and mea­sures of suc­cess for an authen­tic com­mu­ni­ty project
  • Com­mu­ni­ty Project Plan

 

  • Com­plex (devel­op­ing, plan­ning, orga­niz­ing, ana­lyz­ing, build­ing)
  • Tick­et out Door
  • Debrief­ing Ses­sions
  • Dis­cus­sion Forum
  • Direct­ed Instruc­tion at begin­ning
  • Team-Based Learn­ing
  • Self-Direct­ed Learn­ing
work col­lab­o­ra­tive­ly and effi­cient­ly as a team through­out the course engage­ments and com­mu­ni­ty project
  • Pro­fes­sion­al­ism Feed­back Rubric
  • Medi­um (com­mu­ni­cat­ing, prob­lem solv­ing, reflect­ing)
  • Reflec­tive Dis­cus­sions
  • Team-Based Learn­ing
  • Role Play­ing
  • Direct­ed Instruc­tion
Assessment design

Well designed assess­ments (infor­mal and for­mal) real­ly help with stu­dent learn­ing and cut down on caus­ing more stress for stu­dents in try­ing to under­stand the assess­ment off the top. The fol­low­ing pages pro­vide some ter­rif­ic and sim­ple ways to design assess­ments to ensure they work from day 1. Some charts to help you align assess­ments with learn­ing out­come lan­guage are also pro­vid­ed via the links below too.

    • Approach­ing Assess­ment Design (Wil­frid Lau­ri­er Uni­ver­si­ty) — Link
    • Learn­ing Activ­i­ties and Assign­ments: How to Max­i­mize Their Effec­tive­ness (Water­loo Uni­ver­si­ty) — Link
    • Bloom’s Tax­on­o­my Learn­ing Activ­i­ties and Assess­ments (Water­loo Uni­ver­si­ty) — Link
learner Readiness: SepARATING bEHAVIOURS FROM lEARNING

Instead of mud­dy­ing the eval­u­a­tion waters with ele­ments like: par­tic­i­pa­tion, atten­dance, on-time­ness etc. — con­sid­er sep­a­rat­ing these “behav­iours” from the demon­stra­tions of stu­dent learn­ing. One way to do this is use a “learn­er readiness/professionalism rubric” self- assess­ment to high­light those actions, activ­i­ties and apti­tudes that help cre­ate suc­cess­ful stu­dent learn­ers. CTLI Word Doc for edit­ing.

RANking the Evaluation Plans

Exam­ine the fol­low­ing col­lec­tion of eval­u­a­tion plans for a course. Con­sid­er which plan might work best for the learn­ing out­comes: PDF Hand­out

20 Evaluation statements: Evidence-based or not?

Con­sid­er the fol­low­ing state­ments for reflec­tive thought about eval­u­at­ing learn­ers (mean­ing the tests, projects, quizzes, exams, projects, reflec­tive activ­i­ties — that are graded/valued/with marks/percentage).

Which state­ments are aligned with evi­dence-based research? Jot down the num­ber of the state­ment that you feel is backed by evidence/research. (Answers at top of page)

  1. The more eval­u­a­tions in a course, the more infor­ma­tion instruc­tors obtain to make a more accu­rate deci­sion on a grade.
  2. Many small­er eval­u­a­tions are bet­ter than few­er larg­er eval­u­a­tions in a course.
  3. The more eval­u­a­tions the more chances stu­dents have to demon­strate their learn­ing.
  4. Eval­u­a­tion meth­ods that have con­tent that is search­able on the inter­net are not good meth­ods.
  5. Detailed rubric matri­ces out­lin­ing cri­te­ria across 3–4 lev­els are the best way to eval­u­ate stu­dent learn­ing.
  6. Group activ­i­ties with one eval­u­a­tion per group are help­ful for stu­dents to build their col­lec­tive learn­ing expe­ri­ences.
  7. Each eval­u­a­tion should only be designed to test one course learn­ing out­come at a time.
  8. The more demon­stra­tions of learn­ing the more data instruc­tors have for an appeal or ques­tion about a grade.
  9. The more eval­u­a­tions, the more engaged learn­ers will be in doing home­work, show­ing up to class and pay­ing atten­tion.
  10. Reduc­ing empha­sis on a grade and increas­ing empha­sis on feed­back aids in stu­dent learn­ing.
  11. Writ­ten assess­ments are time con­sum­ing to mark because you have to com­ment and pro­vide feed­back on the whole sub­mis­sion.
  12. Peer and self-eval­u­a­tion com­po­nents are for infor­mal feed­back and nev­er part of a final course grade.
  13. Invig­i­lat­ed final exams are the best way to ensure you are see­ing stu­den­t’s orig­i­nal work.
  14. Tak­ing a test is a good skill all stu­dents need to learn how to do — but teach­ers need to teach these skills first.
  15. Many low stakes eval­u­a­tions allow stu­dents to demon­strate learn­ing in small­er chunks and with less stress.
  16. Course final grades are accu­rate indi­ca­tors of the learn­ing stu­dents did in that course.
  17. An instruc­tor must assess every learn­ing out­come in a course to ensure they are account­able for qual­i­ty stu­dent learn­ing.
  18. The marks/weighted per­cent­ages for an eval­u­a­tion method need to be aligned with the amount antic­i­pat­ed stu­dent effort, time and work involved.
  19. Post-sec­ondary instruc­tors spend more time in the assess­ment of learn­ing (sum­ma­tive) than the assess­ment for learn­ing (for­ma­tive).
  20. A well-designed sin­gle assignment/test/project can sat­is­fy many learn­ing out­comes and pro­vide use­ful infor­ma­tion for mark­ing.