Saturday, February 28, 2009

4th seminar – Peer and Self Assessment

I was looking forward to this seminar for two reasons: 1) Peer assessment is heavily used in my school and I wondered, whether is done right and what are the findings about peer and self assessment in research. 2) I had dilemma about terminology, I mentioned earlier on this Blog (No more ‘summative purpose’).

Peer and self assessment is very strong in AfL as according to some research, when are students involved in peer assessment and receive training on how to do it, their learning gains are almost 50% higher than control groups. And this is a lot. So even if not done professionally and as experiment, but in normal classroom setting, the results still must be pretty impressive.

There is however a difference between peer assessment and peer marking. If students just follows teachers marking scheme and give grades or comments on what is wrong, there is no learning. This is not peer assessment.

The biggest benefit of this type of learning I see in internalisation of success criteria. Bu this will not happen just by displaying them. Even teachers need training to became good assessors. The same our students. Modelling, examples, success criteria, teacher’s moderation and guidance are necessary to make this work.

Some more info on research:

http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=2415&language=en-US

Thursday, February 26, 2009

Cultural Change

Since I was introduced to Assessment for Learning I was always intrigued by how would it work in Slovakia. I was aware of obstacles represented by differences in school system and culture and the way student work. And also by the differences in curriculum. But still, Would it work in Slovakia?

I think yes, it would. I even think it would work even better than here in England. Overly optimistic? Probably I am, because I feel, that many schools and teachers in Slovakia are lacking the potential to change and willingness to take the risk. Overcoming this obstacle, AfL could thrive. What makes me say that?

  1. Teacher is more independent about assessment and judgments he makes in the class. Therefore can implement many aspects of AfL without risk of failure in high-stake tests, which make many teachers in the UK teaching to test.
  2. Different kind of paperwork, no student tracking and reports etc. therefore more time to create made to measure system for class or whole school.
  3. Traditionally good student-teacher relationship and less hassle with classroom management, which gives more learning time to try out things.
  4. Usually strong emphasis on homework and learning from lesson to lesson and home preparation for school. This is great opportunity for feedback planning, self and peer-assessment and many other aspects of AfL.

What else needs to be overcome?

  • AfL is hard to implement for just one person. Willingness to collaborate with teachers in the same school and with other school is necessary. But teachers usually do not discuss their assessment strategies.
  • Grades. Probably most difficult to overcome. Schools, teachers and parents are not ready to abandon grades. Well Keep them. They are part of assessment – summative one. But use them less (some teachers give approximately 11 grades in one week in one class!) and use them after feedback and other intervention took place.
  • Rota learning. I admit, that I see it as occasionally good way of learning. How would you learn for test? Still rota learning does not have to be rota testing too.
  • Training. All is good, to persuade teachers al over the world about benefits of AfL, but how to implement? How to ask open ended questions, how to plan, give feedback? When? And also how to retain good practice or abandon ideas, which are not working for us?

Wednesday, February 25, 2009

The water needed to produce common goods and beverages | Thirsty work | The Economist

The water needed to produce common goods and beverages | Thirsty work | The Economist

Tuesday, February 24, 2009

In what ways can assessment contribute to school improvement in Slovakia?

 

There are many areas which school can focus on to improve its overall quality. Probably the most important however is ‘teaching and learning’. This is what school is about. Place where teaching and most importantly learning takes place.

Traditionally, as in many other countries no matter what tradition or culture, learning was happening to the students by teaching. So they came to school to be taught. Today, based on evidence and sometimes on fashion too, there is a shift from this view. There ought to be less teaching or teaching should transform into facilitating learning and learning ought to be active process. Learning is done by learners not to them and it is their responsibility too.

This requires new approach to delivery and instruction. Luckily Slovakia does not have high stake tests and accountability, which means, that it is much easier to take risk and try new ways of teaching and assessment. Interestingly enough, there is very little evidence, that Slovak teachers are innovative and do try new ideas in the area of teaching methods. (please, let me know if I am wrong) They stay rather within tradition and conservatisms.

It seems today, that this could mean staying also on the bottom of PISA and TIMMS tables (which might not be most important) and compromise the quality of education, thus quality of life of future generation. New school reform (being too fast, and maybe to some extent under designed) had this in the mind. On the paper it calls for new approaches, innovative and modern methods. The question is what are they? Probably the reform documents cannot define these methods and approaches, as this is not the area of legislation. Ministry and other agencies though should have some idea of what they are asking for. Teacher will not try new method not knowing, if it works and just because minister wants him to… especially if nobody knows what the New Methods are. And how they work, and what to do to make them work.

This can be illustrated in the area of assessment, where new state educational programme and example of school educational programme call for more effective ways of assessment than oral examination in front of the class. What is more effective?

Tests? Because you can assess all class at once? Test measures only parts of achievement and they need to be designed well to measure more than just knowledge. How many teachers in are trained to design tests valid and reliable? And how many of them have time to do it?

Projects? They can measure skills and effort, and some of key competencies but fail to measure knowledge. Our curriculum is still driven by knowledge and by close examination of new school programmes it will remain so for long time.

What else have we got readily available for assessment in Slovak schools? Not much more than some presentations, writing essays and reports etc. But how do you mark these? It might be clear for people from Anglo-American tradition, where clear criteria and rubrics are sort of a norm. Not so in Slovakia where, except languages, marking essay is rather intuitive.

Where to start then, to improve school? Using ideas from Assessment for Learning (AfL) and taking some risk we can impose some change and even answer the call of the reform for innovation. AfL has few main principles, which when transformed and applied to Slovak system. Most important drives of improvement I can see in sharing success criteria, effective feedback and peer assessment.

Success criteria

This would not be too big shift from current practice, but still would require some change in point of view. Many teachers share learning objectives and students will know what is expected from them to be successful when answering. But it in mostly knowledge, learning objectives (as brief analysis of school educational programmes shows) are mostly what teacher does, what he explains and stresses as important and what students will know. Content, content content. It is very likely that successful and able students and those, who have no problems with memorising will be very successful. Those less able will struggle.

Let’s go back to basics and look at Bloom’s taxonomy of learning objective and sit down and write clear criteria for success. What student will know? Everything? Unlikely. So write it down like ability to write a list, name, compare, understand (How to show understanding?) … all active verbs and all about what student does. This will help to identify what learning intentions we have and communicate them clearly to less performing students. May be create rubrics with expectations and ask students to highlight where they thing they are. And this leads to another principle:

Feedback

Effective feedback leads to the action. It can be student telling me, that he is well ahead of far behind the class. It is worthless, is I do not act on this information. It can be me telling student that he has missed some important information, or misinterpreted  something. Worthless, if it is last thing we do about it.

To apply this principle, there must exist clear information about expectation. So that both student and teacher know, where are they heading to, what is the objective. And based on that teacher provides information about the ‘gap’. What is missing. And also information about how to close the gap. what needs to be done. It does not to be done explicitly, so that teacher will in effect finish the work. Clue, question, example etc. could be sufficient. And it even does not need to be a teacher, who is giving this kind of feedback. It can be peer.

Peer-assessment

is third principle I want to draw attention to. When criteria for assessment are clear, than peer-assessment can drive achievement even higher, as even less performing students can participate in this process, thus internalise criteria and try to act on them. Of course this requires some training and time spent on practising.

Overall this three principles can lead to better achievement and improvement not only in learning, but in teaching too. And with system, where high stake test are rare and teachers exercise huge autonomy in what happens in the classroom (even if not in the area of content), there is little risk of changing this practice into ‘assessment as learning’, where criteria and standards are the drive of teaching (checklist of standards: can do- tick, cannot do – this is what you must do to pass… ).

Sunday, February 22, 2009

Why it works? Why it does not?

Still working on my assignment and searching materials I can use… More I read, more curious I get whether Assessment for Learning works always, or the evidence is so strong, because of ‘novelty effect’. I don’t mean because it is new concept (term ‘formative evaluation’ is from 60ties, I think), but because it is new for particular classroom/individual teacher and so they do everything to make it work. What makes me saying that is the evidence from Ofsted – fact that AfL, after strong support and national strategy initiatives, still is weak and does not work in many schools. (see my previous post on Ofsted Report)

Is that because these schools seen they priorities somewhere else or did not have change/improvement potential (the staff and leadership were not ready to change)?

I feel like I need to find some more info on school improvement / influence of different initiatives etc. (Does Assessment for Learning work because it is new initiative and people are enthusiastic so any new initiative would work the same way?)

And also I am struggling to get some material on assessment published in Slovakia or related to our school system or system similar to ours (Czech, Hungarian). Assessment for Learning literature is mostly in English therefore very likely from similar cultural context. Will it work in our context? How to implement? This are just few questions I need to get my head around. 

Saturday, February 21, 2009

Meet Tarun Kapur, the headmaster of Parrs Wood... Ashton-on-Mersey... and Broadoak schools - Education News, Education - The Independent

Meet Tarun Kapur, the headmaster of Parrs Wood... Ashton-on-Mersey... and Broadoak schools - Education News, Education - The Independent

Friday, February 20, 2009

Grading

Following previous post on assessment practice I want to add some info on grades and grading:

Grades in Slovakia are either in numbers on the scale 1 – 5 of words, equivalent to this scale:

  1. = Excellent
  2. = Very good
  3. = Good
  4. = Satisfactory
  5. = Unsatisfactory

These are given for academic achievement in graded subject and are used both in continuous assessment and in end of term/end of year certificates (Or in end of school/qualification certificates too). Of course this scale is not enough to measure all kinds of performances and activity during lessons. Many teachers therefore have some additional system or add some + or – to the grade, or as a merit. Or they give grade as 2/3 which mathematically is less then 1, therefore should mean better grade, but for the teachers and students in Slovakia for decades it meant something between 2 and 3. (I was graded like that and I myself used to grade my students the same way)

In Ministry of Education Guidance on Assessment (*.zip in Slovak Language ) the grades are as follows

    • Grade 1 (excellent)
      if the pupil masters the knowledge, concepts and patterns according to the curriculum and can readily use them in his/her intellectual, motoric and other practical activities. Independently and creatively applies knowledge and key competences in solving various tasks, evaluation of events and patterns. His oral and written language is correct, accurate. Graphic expression is aesthetic. Results of the activities are good, with only minor shortcomings.

    • Grade 2 (good)
      if the pupil masters the knowledge, concepts and patterns according to the curriculum and they can readily use them. He/She has adopted core competencies that apply to the creative, intellectual, motoric and other practical activities. He/she adopted the key knowledge and competence in dealing with various tasks, evaluation of events and patterns independently and creatively or with minor help from the teacher. His oral and written language has minor deficiencies in accuracy, precision and relevancy. Graphic expression is aesthetic, without any major inaccuracies. Results of the activities are good, without major shortcomings.

    • Level 3 (good)
      if the pupil has irrelevant gaps in the accuracy, integrity and completeness of acquired knowledge, concepts and principles according to the curriculum and in their use. It has adopted core competencies that he/she uses in intellectual, motoric, and other practical activities with minor shortcomings. At the instigation of the teacher applies the core knowledge and competencies in dealing with various tasks, assessment of events and patterns. Student knows how to correct significant errors and inaccuracies  with the teacher help. In oral and written language he/she has shortcomings in the correctness, accuracy, relevancy. Graphic expression is less aesthetic. The quality of the results of its activities are often gaps.

    • Level 4 (satisfactory)
      if the pupil has serious gaps in the integrity, accuracy and completeness of acquired knowledge and principles of the curriculum as well as in the use of it. In addressing the theoretical and practical problems with implementation of key competencies are substantial errors. He/She is very dependant in the use of knowledge and evaluation of events. His oral and written language has serious shortcomings in the correctness, accuracy and relevancy. In the quality of the results of his actions and graphic expressions are errors, the work is a little aesthetic. He/she can correct serious errors and insufficient evidence with the help of teacher.

    • Level 5 (unsatisfactory),
      if the student did not acquire required knowledge and curriculum, has serious gaps in them, therefore, he/she is unable to use them. In addressing the theoretical and practical problems with implementation of key competencies are found significant errors. He/She is very dependant in the use of knowledge, evaluation of events, and is unable to apply his/her knowledge even with the help of the teacher. His oral and written language has significant shortcomings in the correctness, accuracy and relevancy. The quality of the results of its operations and graphic expression is low.Student makes serious errors and fails to correct deficiencies with the help of a teacher.

(translated with help of GoogleTranslator)

In very few subject areas those broad descriptions were broken down into clear criteria. And of course teachers have to use their own judgment on what performance, result and work is grade 1 and which grade 5. Although it is less tricky with those two extreme grades than it is with those in the middle. Especially in situations, where student is slightly underperforming his usual self. Or over performing. Teacher is tempted to give higher grade.

And in terms of sharing this criteria with students, I dare to thing, that none of the teachers is using them/sharing them with their students.

Thursday, February 19, 2009

Monitor on Psychology - Mini-multitaskers

Monitor on Psychology - Mini-multitaskers: "In research published in 2001 in the Journal of Experimental Psychology: Human Perception and Performance (Vol. 27, No. 4), Meyer and colleagues found that people lost time switching from one task to another. The amount of time they lost increased significantly as the tasks became more complex or unfamiliar."

Wednesday, February 18, 2009

bozarthzone: Sacred Training Cows

bozarthzone: Sacred Training Cows

Assessment practice in Slovakia

I am now in the process of writing my essay for the AfL course. The main focus will be in Assessment and improvement of teaching and learning in Slovakia. I started quite well with Ideas related to school reform in Slovakia and questions how this can affect assessment system. There is very little notion of assessment in all reform documents, except some general recommendation and so it seems it would not change at all. Also as one my friend mentions he has briefly seen Ministry Guidance on Assessment five years ago… So probably he is not aware of new one from January 2009 and therefore it will have little impact on his practice, if any at all.

Teachers in Slovakia have quite large independence in terms of assessment and there are very little accountability and high stake testing, to take into account. It is traditional approach, which luckily remained in new system. Teachers mostly assess the knowledge or performance or the outcome (depending on the subject) either verbally or by teacher-created test (there is very little instruction on tests design in teacher training though).

Each subject has a list of standards with competences and knowledge expected form every student in particular year and using this standards, but largely using professional knowledge based on experience, teacher assess students by giving a grade on scale between 1-5(1 being excellent, 5 being unsatisfactory). Roughly a decade ago, some schools and teachers experimentally started with verbal grading/ verbal assessment only. This however is not supported by many teachers and society in general. There is an legal obstacle as higher secondary sector cannot use this verbal assessment and requires grades in admission process.

Assessment process is continuous one, where teacher selects individual students or assess whole class throughout the year. This results in selection of grades, which are a basics for end of term and end of year assessment – certificate, which is legal document (and even has to be given to students on certain date).

Grades 1-4 are pass grades (4 means satisfactory). Students who have more than two ‘unsatisfactory’ grades, failed this year and are hold back. They have to repeat whole year in all subjects. For those having one or two unsatisfactory grades, school and subject teacher has to provide additional mentoring program over summer and towards the end of summer (usually) they have exam in front of exam board named by headmaster from school teaching staff.

Tuesday, February 17, 2009

International GCSEs 'can be offered in state schools' - Telegraph

International GCSEs 'can be offered in state schools' - Telegraph: "Ofqual, the Government's qualifications regulator, has officially approved International GCSEs for the first time.

The exams are already favoured in top independent schools as a more rigorous alternative to conventional tests - providing better preparation for A-level"

Monday, February 16, 2009

Britain has produced unteachable 'uber-chavs' - Telegraph

Britain has produced unteachable 'uber-chavs' - Telegraph

Given this post, readers will be able to describe my perspective on course objectives to 100% accuracy | MinuteBio

Given this post, readers will be able to describe my perspective on course objectives to 100% accuracy | MinuteBio:

"I think of them as a contract. It is an agreement between the content and the audience. And the assessment measures whether the contract was fulfilled."


Back to learning objectives. And their importance to assessment. Without knowing what your student ought to learn, you don't know what you ought to assess... and likewise if your students don't know what they should learn, they cannot prepare for assessment (they don't know what you going to assess...) How simple logic and common sense. The trouble is, we sometimes have problem to define, what ought to be learned, or how to assess it, or how to communicate the objective...

Saturday, February 14, 2009

Why is the dawn-to-dusk extended schools scheme failing the very families it is meant to help? | Society | The Guardian

Why is the dawn-to-dusk extended schools scheme failing the very families it is meant to help? | Society | The Guardian: "Revolution blues

A radical plan to enrich the lives of disadvantaged children was launched with a fanfare in 2005. But why is it failing the very families it is meant to help? By Amelia Gentleman"

Friday, February 13, 2009

Teachers 'failing to spot' causes of bad behaviour | Education | The Guardian

Teachers 'failing to spot' causes of bad behaviour | Education | The Guardian: "Bad behaviour in schools is being fuelled by teachers' failure to properly identify children with special educational needs, according to the government's chief adviser on school discipline.

Schools are labelling children as naughty when they have serious problems and have been failing to address the causes of disruptive behaviour, in some cases for years, according to Sir Alan Steer, a headteacher who has advised on behaviour issues in schools since 2005."

I sometimes think that children are naughty... you cannot label every naughty kid as SEN. Sometimes they are just naughty... SOMETIMES. And for the other cases yes, teachers are failing to identify SEN, as are people in social services and other agencies. People trained to recognise this cases. Training, education, support and time...

Thursday, February 12, 2009

3rd Seminar - Feedback

 

One of the topics, which are very vivid online. And very important for corporate, business, training and management worlds. And becomes ever more important in learning.

It raise came after very influential study from Israel, where in one experiment comment only feedback group performed best out of 3 groups – comment only, comment and grade and grade only group. This was only one study, one experiment done in Israel, therefore one must be very careful about its generalisation or transformation of the results in another cultural setting. But as our lectures said – worth paying attention to. And probably turning from ‘grades are important’ culture to ‘how you act to improve’ culture.

Than we tried to establish some basics features of effective feedback and ineffectual feedback and had practice session with example of students work, where we meant to give a feedback. This was probably the best and most important part of the seminar. For me at least, as it made me realise what thinking process I need to apply to provide effective feedback, how to word my comments and what activities will be the best for action. Definitely not an easy task…

Feedback in probably most important part of assessment for learning. The part, which can make greatest contribution toward successful implementation of AfL (when implementing AfL one need good quality feedback too;-).

In Learning setting it means that I know, where to concentrate my feedback, what to mark, as I cannot mark everything at once (assessment for different purposes) and it simply means that I know my learning objective and I success criteria (which is not the same). One of the good practice is to use questions to break success criteria down into plain English… Just then I can give feedback focused on my aims and with clear notions on how to improve. Thankfully we are moving from ‘praise them all’ to give them true picture.

Again, as with may things here, we can agree with theory, but how to turn it into effective practice?

If you have some really good practical suggestions, please share them in comments. Thanks.

Tuesday, February 10, 2009

Brain rules...

Monday, February 09, 2009

Assessment and School Improvement Mindmap

While thinking about my Uni work and essay I decided to make a Mind Map to see the links between information I have and missing links or missing (incomplete) information. And by doing research on assessment methods I came across good webpage about assessment and methods of assessment linked to the skill, you might want to assess. And I used great mindmapping tool http://www.bubbl.us

Well and here is my mindmap:

image

Friday, February 06, 2009

Kapp Notes (Blog)

Cool Level One Evaluation

As learning professionals, we are familiar with Donald Kirkpatrick and his four Levels of Evaluation.If you need to get up to speed, you can read an interview with him here.

I have never heard about four level of evaluation before, but surely I am going to spent some time on this. I love the pictures and I want to know more…

Thursday, February 05, 2009

'Blessed' school learns a lesson

http://news.bbc.co.uk/1/hi/wales/north_east/7851890.stm

We don't have rules, we have respect, behaviour and uniform... we respect the teachers more and they respect us back

Thirst

Wednesday, February 04, 2009

Brightest children 'failed by state school teachers who fear promoting elitism' - Telegraph

Brightest children 'failed by state school teachers who fear promoting elitism' - Telegraph

Tuesday, February 03, 2009

how to succeed...

Assessment for learning: the impact of National Strategy support


This survey evaluated the impact of the National Strategies’ approaches to
assessment for learning in English and mathematics lessons across a sample of
primary and secondary schools. The impact on achievement and provision was no
better than satisfactory in almost two thirds of the schools visited. It was better
developed in primary than in secondary schools. Surveys of other subjects provided
additional evidence of its variable impact.
Quite alarming results and probably waste of money and resources too. It is based on survey in 43 schools in England, so it possibly is not the whole nation picture. But even so the findings show, that
In the less effective practice, teachers failed to understand sufficiently how the
approaches were meant to improve pupils’ achievement. Although schools valued
the training and support provided, good practice in assessment for learning did
not necessarily follow. Senior leaders did not maintain the momentum of
implementation, often moving on to other priorities before practice was secure.
I find AfL an amazing tool to improve achievement. And to enable pupils to become lifelong learners too. Especially when using peer and self-assessment.

So what the survey found and what can we learn from it.
1. The implementation of AfL is not easy process and even when it becomes initiative supported by government and many hours of training, it still can fail.
2. When AfL did not have great impact, it was seen by surveyors, that teachers did not implement strategies correctly or did not understand AfL.
3. Also there was a correlation between successful AfL practice and involvement of senior management.
4. Peer and self- assessment seems to be least used and implemented practice.
5.
Only three of the secondary schools showed they used assessment information
effectively to plan the curriculum and teachers’ setting of objectives


6. The highest impact of AfL was in the provision of SEN.

I am keen on AfL. The evidence shows that this is the right direction and can have huge impact not only on students, but on the teachers too. As I mentioned in one previous post there are thing I would like to export from British schools to Slovakia. AfL is one of them.

Monday, February 02, 2009

My academies may be failing, admits chief - Education News, Education - The Independent

My academies may be failing, admits chief - Education News, Education - The Independent

What would I import into school in Slovakia

Cultural shock would best describe my feelings, when I started to work in school in the UK almost three years ago. Since then I have gone a long way from rejecting, comparing, praising, hating or enjoying either features i missed from Slovakian schools of my place here. This was and still is a fantastic experience and no university or training could give so much.

Now, when I look back in my experience in Slovakia, I know what and how much I would miss, if I started to work there again. Here is my list (I do not mention the pay):

Commitment of the teachers and the way school can use their time.

Teachers in the UK are employed on different basis and schools pay for certain amount of working hours, they spent. Therefore can decide how this time can be used during school day or after school. In Slovakia we have given amount of teaching hours and equivalent of non contact time. If teacher's lesson finish at 12 o'clock, he or she is usually free to go home. Very few teachers give up their time to stay longer at school.

Tutor time
It is small amount of time. 15 min three times a week in the morning. and it can make such a difference. I would introduce this instead of tutor time in form of rolling tutor once a fortnight. This gives tutor time and opportunity to react on any issues raised day before, give last minute notices, speak to tutees and manage the administration of the group on the go.

Briefings
Much better than staff meetings. Happens in the morning three times a week and gives overview of what is happening in the school, opportunity to pass notices to the student, inform about events either past or future ones etc...

Permanent classrooms for teacher
In Slovakia teaching group is fixed and has permanent base in one classroom. The group moves only to go to PE or a special lab. Teacher moves around. Although it seems a difficult task to move so many pupils around, it gives teacher a benefit - opportunity to stay in the class and welcome students, making the classroom his/her personal space, has resources ready and no need to carry everything around (Students have their own books, so teacher does not need to carry these)...

Behaviour management
Use of different methods of praise and punishment and clear rules. Also the information route, where everyone concerned is posted without the need to spent time to repeat the same information few times. And the steps in the use of detentions and exclusions. Slovakia does not know exclusion (expulsion is possible but rare) and after school detentions are rare. Break or lunch time detentions do not exist...

The use of receptions and admin staff
Something rather expensive for the schools in Slovakia, but the impression on the visitors and the help when there is somebody, who can deal with emergency situation from first aid, through calls and letters and photo copying is invaluable.

Target and goal setting and assessment towards them not only towards attainment levels
The fact that here even when you give just one grade or level you actually assess students in two different ways is fantastic. An eye opener for me. The grade tells where he/she stands against standard and levels, but it tells also whether he has been working hard and made an improvement or not. The existence of personal target is so personalised and helps to give the right feed back. I believe the motivation is strong here. And the element of personal responsibility too.



Sunday, February 01, 2009

BBC NEWS | World | Europe | Legendary British warship 'found'

BBC NEWS | World | Europe | Legendary British warship 'found': "Legendary British warship 'found'

A US-based salvage firm is believed to have found remains from the wreck of a legendary British warship which sank in the English Channel in 1744."

An artist's impression of how HMS Victory may have looked like