Wednesday, December 1, 2010

WHERE IS FORMATIVE

Quite often we assess students without them even knowing it - is this FORMATIVE? or is this making some pre judgements on inviduals competency?
When we ask studnets to recall a recent point  for a summary of what has been said I believe an assessment is ocurring - is this FORMATIVE? Sometimes we adminster small tests before continuing with instructions - is the FORMATIVE? When we set activities (individual or group) are we assessing to see if there has been any tranferance of learning, competency - is this FORMATIVE? Activities and discussions which follow lecturers will inform the lecturer on how well the students are coping and whether more time or help is needed - is the FORMATIVE.

I believe that all the above techniques would be described as FORMATIVE ASSESSMENT as FORMATIVE ASSESSMENT  is used to check the students progress during a learning event.

www.qualityresearchinternational.com/.../formativeassessment.htm 24 Aug 2004  Formative assessment -is evaluation of student learning that aids understanding and development of knowledge, skills and abilities without passing any final judgement (via recorded grade) on the level of learning-

SUMMATIVE ASSESSMENT  measures the overall atainment and it is used to determine the degree of mastery acquired. Its purpose is to help the student focus on the particular nearning necessary to progress. Does summative provide different approaches to assessment by incoporoating the "soft skills" as well as technical-
  • Observation
  • demonstration of skill
  • oral questions
or is the soft skills more within the formative domain and summative to assess the skills and knowlege.

The University of Warwick (2004) defines summative assessment as: Assessed ...
www.qualityresearchinternational.com/.../summativeassessment.htm - Summative assessment is the process of evaluating (and grading) the learning of students at a point in time.


I believe that the soft skills sits in both arenas and I have recentley been involved in an assessment that sat within a cultural framework which incoproated three domains of learning within an assessment.

The students are currently studying on a bicultural degree and one their summative assessments was to a combiunation of group, indivual work that was assessed on a marae as part of a Noho marae (spent the day, evening till next morning on the marae). 

The three domains to the assessment.

Knowledge
  • Students where in groups of 4 and each group where given a particular section of a Karakia that they need to present as part of there group mark.
  • Each group member was also required to present their Pepeha individually as part of their individual mark. 
Skill

  • Each group where assigned a taks in organising the Noho marae in preperation for their group and indivdiual assessment.
  • One group organised the food
  • One group organised the sleeping area and there where other areas that the remaing groups where responsible for
Attiudes
It is very difficult to measure attiudes and values in isolation and we mostly assess skills and knowledge. This assessment allowed the students to be observed by the lectures in a real stiuation. They observed the groups prepare over a period of three weeks and observed them on the day, evening and morning.

These three domains of learning provided a robust and valuable assessment for the students and lectures. It took assessment to another domain and out of the traditional classroom or simulation and provided a real experience for all student.

In my journey to find 'WHERE IS FORMATIVE ASSESSMENT" within the current degree program I have found that it is written in our documents as one of the methods of assessment BUT when I asked individual lectures if they know of FORMATIVE ASSESSEMENT -  they all replied with a confident YES.

When I asked them to describe/examples of  what FROMATIVE ASSESSMENT occurrs within there respective teaching methods the response was wide and varied. They did not inform the students about formative assessement or felt the need to. They all believed that they did some sort of formative assessment within their classess but again this was wide an varied - and not sure if what they described is what my understanding of what formative assessment is and how to implement it. Interestingly some lectures thought formative assessment was more for the lecturers to check if they had covered all the material and it was a measrue for them and not the students.

When I aksed about summative the the lecturers where able to describe/explain and provide comprehensive dialogue.

I had an opportunity to review a paper that was a first year paper within a degree program and there were four learning outcomes and 6 summative assessments. No where in the document or lesson plans could I see FORMATIVE ASSESSMENT.

The question I will be asking the team at our two day hui togther is 'WHERE IS FORMATIVE ASSESSMENT?" and using this time to explore and looks at the need to incorporate this assessment within their programs.

I will remind them of their own learning journeys where we some of us will be familiar with testing scores and being ranked - often as a percentage mark or grade. When we got our results all it told us was how good or bad we were but didnt tell us where our gaps where and how to strengthen these areas.






Wednesday, October 13, 2010

Qualities of good assessment

My reflections after I had been marking yr2 students summative assessments where 7 students our of 38 failed the paper (18.4%).  I could have ignored this and put it down to the individuals who failed but -

The outcome of this led to some questions I needed to explore as the lecturer.
  1. Was the assessment planned, purposeful and was there a clear understanding of the assessment?
  2. Was the assessment requirements clearly communicated to the students?
  3. Were the learning goals clear and where the students aware of the outcomes?
  4. Was there clear alignment between the expected learning outcomes, what was taught and what was learnt?
  5. Which particular knnowledge and skill sets were being assessed?
  6. Where the assessment methods appropriate/relevant for the assessment?
  7. Did the assessment match what had been taught and vise versa?
  8. Were the students provided with the appropriate resource, time, gudianc, support and feedback to undertake the assessment?
  9. Evaluation of the course outline and assessments.
I  reviewed the course outline and assesment methods against the above questions and my findings where -
  1. The assessments were planned but I believe the wording of the assessment made the tasks required unclear for the students.
  2. I believe this is an area that could improve as there seems to be an expectation that students will read the course outline, that contained information about the assessments, and this should be sufficent. Tutorial is a good method to discuss asssessment requirements and it shoud be incorporated into the teaching. It tends to be seen as a something that sits outside the paper.
  3. I believe the learning goals were clear as where the outcomes.
  4. There was no clear alignment.
  5. Needs defining.
  6. There were two summative assessments within this one paper and the use of formative would have strengthened the assessment methods.
  7. Refer to 6.
  8. An area to be strenthened within the paper.
The assessment methods contained with this paper require the development of  quality assessment methods that involve more that one source of student performace with a balance of formative assessemnt and summative assessment but also to be careful not to overassess.

If you want good assessments then they need to be planned, purposful and there needs to be a clear understanding of why the students are being assessed. The assessment needs to be transparent, fair and we must always look to continuous improvement.

Tuesday, October 5, 2010

Second time around

Started a blog last week and feeling pretty good as  I am IT challenged and then my worst nightmare- lost everything and no matter how I tried could not find it. Stepped away and put blogs out of my mind and concentrated on other things.
I have come back and second time around giving it another go.

I could easily have thrown in the towel and blamed the equipment, information or the weather but then I started to reflect on- do we provide students with sufficent information, tools and resources to be able to complete assessments/tasks.

When our students dont pass assessment do we look at, was the instruction/information understood? Did the student have the necessary tools/resources to be able to complete the assessment? Did we over use summative assessment and maybe intergrating formative would have prepared the student for the final assessment/task? Do our students feel confident to inform the lecturer that they dont undestand and do we create safe environments where the student can ask for assistance? Or do we le them walk away feeling less confident than when they walked in the room.