Why I believe in high stakes testing… in the right context

https://commons.wikimedia.org/wiki/File:ATC_Admission_Exam.JPG

Teachers are exceptionally good at creating strong relationships with classes of children and young adults. As knowledgeable, fascinating figures who beam out a sense of ‘I know you can do it’, they are able to use their positive relationships to challenge students to push through difficult and troublesome learning, achieving more than they thought was possible and exploring skills and understanding that they’d have never had access to before.

Learning isn’t always a comfortable process, and wise teachers know that they need to fine-tune the level of difficulty to hover around the edge of students’ comfort zones. Occasionally they need to consolidate and build confidence, sometimes they need to push and take a leap. Sometimes they will pursue a student’s own fascination with a topic and help them achieve amazing things. In other cases they will carefully and lovingly push them in an uncomfortable direction, nurturing a resilience and drive for future life to take on tough challenges with gusto, while enabling students to experience and learn things they’d have never got access to on their own accord.

Learning that isn’t challenging can become dull and uninteresting. As a species, humans love puzzles, challenges and a bit of challenge. We revel in having the hard task of ‘climbing the mountain’ rewarded when we have an opportunity to look at how high we’ve climbed and admire the view. We feel pride and joy as we grow and develop.

There are many ways to create this challenge, of course, so what role do tests play? A solid body research tells us, perhaps surprisingly, that an entirely low-stakes test can be enormously beneficial to the learning process itself. The latest science about how learning occurs in the brain demonstrates that the challenge of remembering and recalling knowledge builds long term memory.

However, not all tests are low stakes. Some test, like public examinations and national assessments may be a little more daunting. Done well, schools can engender a feeling of excitement and challenge in students. Here is a bar for you to leap over, a way to demonstrate how far you’ve climbed, an opportunity to feel proud and gain a recognition of your progress that no-one can ever take away. Done badly, these can make students feel demotivated and scared, leading to a lifetime of bad memories.

Professor Marc Jones studies the different ways that a challenge can affect us physiologically, in different organisations and teams. He notes that stressful situations can be both good for us or bad for us, depending on context.

“The belief in our ability to perform well is clearly a crucial element in being able to perform under pressure. A high level of confidence is important for a challenge state. Second is a feeling of control. Believing you have control over factors that may affect performance and how you perform under pressure is important for a challenge state. Going into pressure situations focusing on factors that cannot be controlled, such as a footballer worrying about match officials, is associated with a threat state. Finally, being focused on what can be achieved – an approach focus is important. Individuals who are challenged are focused on what can be achieved while those that are threatened are focused on what might go wrong.”

So, we can help students associate future challenge with excitement, rather than terror, by carefully building them up for well-calibrated, high-stakes tests such that they feel confident, in-control and focused on the positive. We can support this through a shared ethos of positivity, of belonging and support. It’s the thrill of the high-jump, the heart-pounding excitement of not quite knowing if you’ll make it, followed by the pay-off of practice and dedication – the glow of success.

There is, of course, a constant and very human temptation to avoid challenging students. After all, even if 9 out of 10 students benefit, we may leave 1 out of 10 with a sense of failure. Given how highly attuned we are to their feelings, this can lead to very well-meaning temptation to reduce challenge and ensure that students never feel any stress. The unhappy corollary is that lower challenge can often mean less learning and fewer opportunities for pride and success. hard work with occasional stress followed by success is so much better for young people than a lifetime of well-meaning low bars and low expectations.

The balance to be struck is to keep the challenge high enough that there is some risk, or else the challenge becomes too low. However, we also need to quickly pick students up after a fall, dust them off and engineer another challenge where they can succeed, learn to be resilient, and get their pride back. It’s something that we naturally do with children as they learn to ride their bikes, and teachers are immensely skilled at doing this in the classroom.

Another startling finding is that tests can actually help the most vulnerable students to succeed. Studies have shown that humans are not very good at making objective judgements and will often by fooled by stereotypes. Entirely inadvertently teachers (like all human beings) have often been found to make more negative judgements compared to test scores, for example, with girls in maths, boys in English, and children from disadvantaged backgrounds in all subjects. This is not due to any ill intent, it is merely a limitation of the way our brains work. When we acknowledge and recognise this natural limitation, a well-designed test can help the profession and the school system to overcome these entirely human and inevitable biases and even out entrenched inequality. And that, of course, is what we want for all young people.

Great tests can also be part of the suite of powerful tools to help teachers to learn more about students’ needs. Where teachers use formative assessment in their own professional development, we know that it helps them grow and improve more effectively and ensure they can help future generations achieve even more. A mix of professional judgement and skilfully designed tests helps us grow and become ever better at supporting young people’s learning. Not only that, both low, medium and high-stakes assessments can give us rich and powerful insights into our learners thinking, with pointers to how we can plan future lessons and tasks to help them most effectively and personally.

In so many classrooms, students will do so much for the teachers they respect – they want to please them, feel proud, and do well. However, we live in in a world of high-stakes inspections, performance related pay, performance management and league tables. If teachers are made to feel not only stressed and anxious about students achieving, but if they also lack confidence and support, then this will inevitably be picked up by the students as well. This could, of course, negate many positives from high challenge tests. Not only that , badly designed tests in a low-trust culture leads to a toxic environment, gaming and teacher burn-out. It leads to superficial teaching to try and desperately ‘drill’ the learning into students heads, no matter how short term, out of survival desperation. This is the very antithesis of what we aspire for our students – I do understand why there is so much anger around and why it’s so tempting to aim this fury at tests themselves.

For high stake assessment to work, therefore, we not only need to focus on the conditions for students but also to focus on the conditions for the teachers.

We need every teacher to feel confident, in control, well supported and focused on the positive. This requires accountability systems that are paired with support and warmth, where success is shared and the right level challenge remains positive and keeps us excitingly hovering around the edge of our own comfort zones. It requires school leaders who have positive, trusted relationships with teachers and, by extension, who have similar relationships with those who hold them to account as well. It requires a faith that, if a high bar is not jumped, there will be support and encouragement from peers and leaders to pick schools and teachers back up and help them try again. Everyone deserves more than one shot, especially when an increasing number of teachers and heads are considering whether they even want to stay in this great profession.

Testing is no panacea, and tests are too often accompanied by crude carrots and painful sticks in a low trust, punitive approach that tries to get performance through fear. It is right to reject such a system that causes bad stress and propagates too much fear and provides too little support. However, let’s not throw the baby out with the bathwater. Great testing is one of the most powerful implements in a teacher’s toolbox. Let’s fix the system, provide the right support, and use this tool to provide powerful learning, memorable success and a deep well of pride for every student that provides a solid foundation for a happy, fulfilled and successful life.

Article image from Wikimedia Commons: https://commons.wikimedia.org/wiki/File:ATC_Admission_Exam.JPG

How learning science might inform dance: A cognitive psychologist responds

https://commons.wikimedia.org/wiki/File%3AJive_Langella_Moshenska_1107.JPG

Dr Yana Weinstein (@DoctorWhy) responds to my speculative post about cognitive science and ballroom/latin dance.

I’ve been a professional cognitive psychologist for 10 years and an amateur Latin dancer for 2, so I couldn’t not get over-excited when I saw this post. Unfortunately, none of the cognitive psychology research has been carried out with dancers (at least, to our knowledge), and I’m currently suppressing a very impractical urge to go in this direction! (I’ve already gotten myself in trouble with a project on music memorization – you have no idea how hard it is to branch out beyond generic cognitive tasks to this kind of applied work).

So all we have are the rather well-informed speculations discussed here. Let me speculate further.

1. Chunking – I wonder if it’s not an accident that my teacher always breaks up new choreography into 15-30 second chunks for us. I’m sure she’s not aware that this is the duration of working memory, but maybe she naturally defaulted to this duration.

For this part of the suggestion – “dancing with a partner or being aware of others watching you may be factors that overwhelm or impede learning” – there is also some relevant research. For example, it has been suggested that certain types of test anxiety may lead to off-task thoughts that take up part of working memory resources.

2. Interleaved vs. Massed practice – so much to say here. First of all, don’t confuse spacing with interleaving (it is extremely easy to confuse the two, and honestly, I still do myself sometimes even though I co-wrote a chapter with a large section on each one ). For example, in the main point, “you’ll end up with stronger memory of routines if you interleave dances” is about interleaving, but in the suggestion, “it has been shown that by giving ourselves a bit of time to forget an idea then […] the long-term strengthening of memory of this approach is much greater” is about spacing.

Spacing is more about how you would distribute practice over a period of time. If your performance is in a week, should you practice for an hour every day, or 7 hours the day before? I think we all know the answer.

Interleaving has been most commonly studied with math problems: should you do 10 of the same type of problem, or mix it up? What’s tricky and confusing about the two is that interleaving naturally adds in spacing, so it is hard to have a pure measure of the effectiveness of interleaving without also implicating spacing. However, this paper  attempts to hold spacing constant and still finds a long-term benefit of interleaving.

I don’t know if this has been explicitly specified, but my strong suspicion is that the reason interleaving is helpful is that it enables you to practice doing a problem “cold” (i.e., without the carry-over effect of having just done a similar problem). It’s important, though, to consider what your goal is. If you tend to go to dances where you’re expected to dance salsa and then bachata, interleaved (as I do), then yes – practice them interleaved. But if the two dances tend to be danced in separate parties (e.g., salsa and tango), then I’m not sure interleaving is going to be as necessary, because you will always get to warm up and then after that you’re in a massed testing situation. The grain size of what you are interleaving also matters. You could take this to the absurd: do you need to interleave practicing one rumba dance with doing one yoga pose? Probably not.

Also, I suspect that level of familiarity with the material is also a factor, and some massing is necessary before interleaving can be useful. Have you noticed how a teacher will always introduce a small chunk (cf., chunking), and then you will mass-practice it until it feels comfortable, and only then practice it with whatever comes before and after? It seems obvious now that I think about it, but clearly what this is doing is getting the information from working memory into long-term memory! Think about how the first few times you run through a new chunk, you’re really just copying the teacher in the moment, so you’re not really using your long-term memory. So maybe the ideal practice protocol includes some massing to transfer information to LTM, and then lots of interleaving. But does this mean you should scramble the order of chunks within a choreography and practice them in different orders? This is the same as the rumba vs. yoga pose question, and I’m honestly not sure.

3. Transfer – the suggestions are great, but the main point is more about context than transfer. When we talk about transfer, we usually mean to a new problem (rather than the same problem in a different environment). For example, if you know salsa, how well will you dance bachata? Probably pretty badly until you get taught at least the basic step and some basic moves – and then you’ll probably pick it up faster than a novice dancer, showing some transfer. A more subtle example of transfer might be: say you were taught musicality with a particular song (e.g., here’s a good part of the song to do a dip). An example of transfer would be noticing those moments in a different song.

4. Still images and attentional focus – the point about learning from still images better surprises me, but I must not know the research on moving vs. still images. I just can’t imagine that any better way of demonstrating a dance move could involve still images, but I’m willing to consider the possibility. I suspect, though, that some research (that I either do not know, or cannot recognize from the description) is being misapplied because the learning outcome (what we call “criterion test”) of the study was not mimicry of a physical movement. The idea of attentional focus during learning is also fairly unfamiliar to me, although it definitely makes sense, and perhaps could be addressed by having the dancer wear bright red shoes or bright red gloves depending on whether they were demonstrating feet or arms??

5. Self-explanation – this seems reasonable, and on a totally personal level, I have to say my instructor doesn’t really let us ask questions. I mean, of course she clarifies specific points, but I tend to ask a lot of questions, and she has more or less shut me down on some occasions because it was slowing down the class. Now, as a teacher I completely appreciate the frustration of tangential, time-consuming questions, but I like to think (probably erroneously!) that my questions are relevant. It just feels as though she has a certain amount of material to get through each class, and any elaborative interrogation (and it’s really not that elaborative – I’m usually just trying to figure out exactly how something fits together) cuts into that time. Perhaps a discussion session after class would be valuable.

6. I don’t know the research on putting two concrete examples side-by-side, but I feel that this point also addresses the value of feedback. To which point, maybe it’s useful to mention that the jury is still out on whether immediate or delayed feedback is best for learning.

Overall, though, here’s my take on learning dance: I feel like we are generally pretty well aligned with the cognitive principles. Most importantly, I think – and David didn’t mention this in his post, possibly because it’s too obvious – we make constant use of the testing effect. We learn by doing the dance, over and over, from memory. We don’t sit for an hour listening to our dance teacher describe the moves and taking notes; we don’t practice by watching the teacher’s performance video over and over again (though we do consult it in between attempts to get it right); and the teacher doesn’t just call on one student at a time to do one small part of the routine while others watch passively. Why, then, is the same not true in a typical school classroom? Why aren’t our kids repeatedly practicing retrieval of the information the teacher is trying to teach?

And here is a dress rehearsal of my latest routine with Leah’s Chicas! 🙂

Teachers must be learners

This article appears in the May edition of Education Investor magazine and the Teacher Development Trust blog

Better schools will need better teachers. And that means better CPD, says David Weston.

Research has repeatedly shown that the number one influence on the quality of student attainment isn’t leadership, buildings or IT: it’s the quality of teaching. Student background and quality of parenting are hugely important, too, of course – but schools struggle to affect such external factors. The most effective thing a school can do to improve the lot of its students is to improve the quality of its teachers.

However, most schools spend only small quantities of money and time on staff development. What’s more, the training they choose is often poorly chosen and ineffective, and the evidence about how to fix this is not widely known or understood. Here at the Teacher Development Trust we’ve been doing some digging to illustrate the scale of the problem.

English schools reported spending just under £200 million on staff development last year – equating to only £25 per student, or 0.5% of the national education budget. Of that, around half the money spent went on supply cover costs to free teachers from the classroom. In other words, just a quarter of one percent of the national education budget was spent on actual training or coaching.

As to how this money was spent, teachers most commonly reported they chose whatever course they fancied. (The next most common answer was that they went on whatever course they were told to.) The majority of these courses weren’t even very effective: of the training courses sampled by the recently-closed Teacher Development Agency, just 10% were able to embed new ideas in the long term, and just 1% were of the quality that could transform poor practice into more effective teaching. The most commonly reported method of training was sitting passively listening to a lecture or presentation – exactly the sort of thing teachers are taught to avoid doing with their own classrooms.

Once training was completed only 63% of schools evaluated its effectiveness. And just 7% of schools – and 3% of secondaries – considered the impact on student attainment.

It’s a grim picture – but it doesn’t have to be that way. We now have a strong evidence base for what constitutes good teacher development, and it doesn’t require vast sums to be spent.

First of all, let’s be clear about what good practice doesn’t look like. It doesn’t mean:

  • forcing teachers to follow lists of ‘best practice’ methods and checking compliance through repeated observations and scrutiny of lesson plans;
  • mandating fixed structures for lessons;
  • bolting on ‘tips and tricks’ to existing teaching;
  • buying in and parroting pre-prepared schemes of work and lesson plans.

Any one of the above methods could produce a short-term and limited ‘bump’ in student attainment. But what they won’t do is to create self-sustaining improvement. Ultimately, they just lead to lower staff morale.

Fortunately, there’s an increasing body of research to suggest that truly effective professional development follows fairly specific rules.

  • It must begin by identifying teacher development needs based on the learning needs of the students being taught, and it must build on teachers’ existing skill.
  • The coaching or training must maintain a balance of focusing on ways for the teacher to help these students while providing skills that transfer to the rest of the teacher’s work.
  • The development process must be collaborative, with teachers of similar skill and confidence supporting, observing and coaching each other.
  • The development process must be actively sustained for at least two terms for a large number of hours (i.e. more than 40). And it must follow cycles of trying, reflecting, and adjusting, while maintaining the focus on improved student learning – and not teacher behaviour.
  • External expertise is vital to keep the improvement on track, avoid false glass-ceilings and disrupt ‘group-think’ that can develop in departments and schools. This could be an expert teacher from a nearby school, or an external consultant.

Schools need to deeply embed these ideas in the day-to-day running of their schools. Time spent by school leaders engaging with teaching and learning is significantly more productive than any other activity in raising student attainment, so it follows that teachers should be viewing their own development as a much higher priority. However, it’s easy for such processes to be subsumed beneath every-day planning, marking, discipline, and bureaucracy.

At the Teacher Development Trust we’re putting in place three strands of work to support the education sector in adopting these practices. Firstly we’ve created the free GoodCPDGuide.com website, a quality-assured database of training and coaching that helps teachers assess their needs and evaluate the impact of training. Secondly, we are working with training providers to help them deliver higher quality courses, with resources, training and inspection processes.

Finally, we are working with schools to support them to change their working practices. The goal is to put high-quality teacher development at the heart of everything they do and create reflective, adaptive professionals who are confident and effective in their classrooms. That could do more to improve schools than any structural change.

David Weston is a former teacher, and the founder and chief executive of the Teacher Development Trust.

Building excellence in education.

How do you improve education? Everyone has a theory, arguments rage. Governments around the world are trying all sorts of exciting schemes, and we can all see that there are a few different possible levers we can try and pull. So, which to choose?
Do we crank up accountability? This is a great short-term solution for a sluggish education system. Every new measure results in a short fear-induced jump with people scrabbling to get out of the ‘danger zone’. Ultimately of course the majority of those in safety can and will revert to being just as sluggish as before. Witness the current scrabble to reinstate humanities and language teaching due to EBacc and drop the now frowned-upon vocational qualifications after the previous 5A*-C panic caused the opposite. This method of improvement is something akin to prodding a sleepy animal with a pointy stick, I think. The animal will rearrange itself to move out of the way of the prods where possible, and then settle back to sleep. Should it have a place in the system? Yes. Is it vastly and painfully over-used? Undoubtedly.o we crank up accountability?

How about imposing new rules and methods? The last government loved this one. We had national strategies and literacy hours, an upsurge in bureaucracy and teachers generally slapped about the face unless they were doing nice three part lessons with starters and plenaries with Assessment for Learning in place (even though most of them didn’t really know what this meant). This is another great method for producing a bump in results. Your lazy bottom 10% of teachers will probably improve a wee bit, and the top 10% of enthusiasts will see the potential and incorporate it relatively happily. The rest will wearily comply just enough to avoid being prodded by the pointy stick and carry on the same as before. There will be dark mutterings and resentment at the imposition into teachers’ ‘personal space’, and huge amounts of energy wasted on oodles of utterly superficial change nationwide. Effect on learning outcomes, minimal.

A current favourite is autonomy of course. How about this one? This is fantastic for all those innovative types who were straining at the leashes of all the bureaucracy and compliance. The enthusiasts will rejoice and start doing things differently. Some of them will try new and foolish ideas that turn out to be a bit rubbish, and some will hit on brilliant ones that will be revolutionary. The weary middle will look suspiciously around waiting for the next inevitable pointy stick and carry on teaching the old way. The lazy ones will sink gently bag into the bog of incompetence with a smile on their faces.

Everyone’s favourite though is structural change. Create whole new categories of schools, change legal designations, alter funding streams, add or remove layers of management. This is stunningly helpful for the small minority who were genuinely trying to innovate and enthuse but were blocked by bureaucracy (probably the ones who were shouting most loudly at the government when they came in to power). Some of the existing enthusiasts and innovators will dismay as they discover their existing growth base has shifted, while others will attempt to adapt. Plans will go on hold all over the country as people try to re-engineer their working practice, finances and development plans. Some of the enthusiasts will adore the new systems, the weary middle will grumble at being made the change, again, and assume that it’s a way of making a new type of pointy stick, and the lazy incompetents will remain blissfully ignorant. Potential for improvement for some? Yes.  Improvement for all? a guaranteed no. Lots of wailing and gnashing of teeth about ideology, rights, politics and change? You betcha!

So how do you actually improve education? Is it by tinkering, foisting, poking or restructuring? Well, ultimately each of these imposed top-down things either unleashes a small pent up need at one end of the spectrum or vaguely squashes a section of incompetence at the other. The only real way you can really improve things is by getting as many teachers as possible on board with improving themselves in a self-sustaining way.

I don’t mean smile winningly and say “off you go lads ‘n lasses” and hope the teachers will improve by magic, I mean system-wide evidence-driven change with teachers in the driving seat.

There are some great examples of all types of change, of course. Laptops for Teachers unbunged the improvement pipe who just needed the kit to get on with it. Banning corporal punishment stamped out an outdated and harmful practice. The London Challenge (and similar projects under the Excellence in Cities banner) created structures, funding and time with which schools could identify problems, collaborate, share expertise, and continuously work to improve outcomes for students. And it is this last one that I think provides the real model for radical school improvement for the UK.

We’ve all seen countless studies that show, time and again, that the biggest thing a school can do to improve outcomes for its kids is to improve its teachers. Apart from the statistically insane and wilfully stupid we’ve discounted the idea that we can simply fire all the incompetent ones and hire new ones. The weary middle, who grow remarkably tired of being poked with a pointy stick will shout about making parents sort it out, but the answer is actually really rather clear. We need systems in place that promote teacher professionalism, systematically grow and develop teacher expertise and sustain this in the long term. Teaching Schools, while a nice idea, are a drop in the ocean. Every school needs to embark on the journey to put in place proper professional development, and fortunately there is a very strong evidence base to tell us just what this looks like. I’ll be blogging more about what this means for schools, teachers and training providers quite soon over at the Teacher Development Trust.

Ok, clearly you still need the right number of working schools with non-leaking buildings, decent finance, a steady stream of new recruits and all the other bits. But on the whole, the English education system is doing reasonably well at those things. You could tweak of course, and I’m sure people will, but the really big changes in outcomes won’t come until leaders, teachers and administrators all start focusing heavily on creating better student outcomes using the lever of teacher professional development combined with the research on how to use it effectively.

Just, please, no more tinkering, prodding and poking.

As always, your thoughts and opinions are most welcome. Let’s start a discussion.

PS Here’s a link to a great recent Harvard research paper suggesting that the key factors affecting student outcomes are (wait for it)…. teaching and learning factors. http://www.economics.harvard.edu/faculty/fryer/files/effective_schools.pdf

How effective is the professional development undertaken by teachers?

This blog piece originally appeared in The Guardian on Monday 26th March 2012

Two hundred million pounds is a lot of money to spend every year. It’s the equivalent of five thousand experienced teachers, forty secondary schools, or half a million new computers.

It also happens to be a rather conservative estimate of the amount of money that English schools reportedly spend every year on professional development for teachers (the real value could well be a significant multiple of this).

Any national programme that costs this much money would (or should) come with strings attached. We’d would expect to see a fair old amount of bang for our taxpayer buck. We’d insist that good practice was followed and that bad providers would be hounded out.

So here’s the rub. A fair amount of teacher professional development (also known variously as teacher training, inset, CPD or professional learning) is really bad. I don’t just mean that it’s poor value for money or insufficiently effective – it’s much worse than that. A large swathe of training has no effect whatsoever on pupil outcomes.

In fact, in some cases, teachers come away from irrelevant away-days having made poorly-understood and superficial changes to their teaching that not only make the lessons worse but also leaving them with the impression that they are now better teachers who require less training in future.

Of course you’d expect that this sort of ruse would soon be rumbled and that ineffective provision would be blacklisted, right? Wrong. Many schools still select training and consultancy from a single dominant supplier (often the local authority) or from a folder of assorted fliers that have arrived in the post.

So what does effective professional development look like, and how can schools make good practice stick? Fortunately there have been a raft of reports (e.g. from EPPI and from Ofsted, among many others) that tell us exactly what to look for, and the good news is that great teacher learning is a remarkably similar beast to the great pupil learning.

Philippa Cordingley from the Centre for the Use of Research and Evidence in Education (CUREE) has for twelve years been leading reviews of research about what really makes a difference in CPD for teachers and for their pupils. She has recently evaluated the provision of 75 CPD providers from across the country, and points out that “the international and national evidence is clear – you have to look at both the support that makes a difference and what teachers contribute to their own and each others’ professional learning.

Too much attention in CPD goes into the content of courses and the things CPD providers do to or for teachers. There isn’t nearly enough thought given to ways of making the learning process sustained, stimulating and connected with pupil learning”.

There are some key principles to follow to improve CPD. Firstly, the process of training must start with a clear identification of need. Pupils work better knowing the purpose of learning, and so do we! Teachers need to be able to identify the cohorts that are under-performing, which topics are being taught less effectively, and which skills their pupils are acquiring less fluently.

Once the needs of the pupils have been identified then the effectiveness of the training can be truly judged. This should be a professional judgement using suitable assessments and other data – an investigative process that begins with aspirations for pupils and teacher engagement.

Secondly, once the need is clearly identified, teachers need to access expertise both within school and from outside. Training that fails to take in to account local knowledge and context is likely to be irrelevant, less effective, and poorly received in the same way that teaching that ignores pupil’s own knowledge is ineffective.

External expertise matters to avoid group think and false glass ceilings, and to make sure precious development time is focused on genuinely effective approaches. This expertise needs to be quality-assured and peer-reviewed – there is no point paying good money for training that others have already found lacking, or which fails to live up to its promises.

Thirdly, training has to be sustained. A one-off jolly to the local hotel may be a fun day full of “tricks” to plonk into your lesson plan; let’s be honest, we’ve all got folders full of notes from such courses that we’ve never looked at again.

You wouldn’t expect a pupil to clear up misconceptions, grasp a new theory, and learn how to apply it in one session, and once again the same is absolutely true of teachers. Great training challenges teachers’ practical theories about learning, helps teachers learn and practice new approaches, and sends them away with ideas to experiment with and refine over time.

Once they’ve tried it out they need to access the expertise again on several occasions to build their own confidence, correct misunderstandings, and overcome barriers.

Lastly, professional development has to be active and collaborative. Us teachers are just as prone to tuning out of a “lecture” and contemplating lunch instead as any pupil. This most certainly doesn’t mean yet more A2 posters with coloured pens though!

New ideas need to be put in to practice, observed, discussed and re-evaluated. Teachers need to work in groups to share ideas, breakthroughs and problems. If one person is going off at a tangent then a group is more likely to bring them back to the core principles. Where one person is having a bad week and tempted to discard the new approach in the face of particularly recalcitrant pupils, the others can offer ideas and support.

Reciprocal vulnerability builds teamwork – if I risk looking silly by trying something new and you do the same we won’t want to let each other down so we keep on going in the face of distractions. Peer observations, focused on the new approach and its effect on the target groups of pupils, become a helpful and welcome way of learning rather than part of an imposed accountability system. The external expert should be brought back in or referred to regularly to ensure the new practice is developing in the most effective way.

It’s a big cultural shift, but endless reports and international comparisons have shown us that teacher professional development is one of the cornerstones to improve education for our pupils. Not only does it improve learning but it increases teacher retention and morale and raises the status of the profession.

The Teacher Development Trust, aims to help everyone in education to use these ideas in their own work. One of our tools, GoodCPDGuide, is a national database of CPD where teachers can review each course, consultant, or event for impact on their own practice, and where providers can apply for quality marks from CUREE to prove that their training really works.

We also work closely with CUREE to help support schools and training providers to build better identification of need, to make training more relevant and transformative, and to improve the dissemination and collaboration around new ideas once back in school.

• David Weston is the founder of the Teacher Development Trust andInformed Education Ltd., and a Maths and Physics teacher at a secondary school in Hertfordshire. Follow David on Twitter:@TeacherDevTrust and @Informed_Edu.

 

ICT spending: proceed with caution

This article first appeared on the Guardian Teacher Blog on 20th February.

ICT spending: proceed with caution

Technology doesn’t guarantee improved learning outcomes – put the pedagogy first

Schools love to show off their new gadgets. In a non-scientific survey of sixteen school prospectuses, I found fourteen of them had prominent images of computer-suites or classrooms with interactive whiteboards. These images of shiny new technology say “our teaching is modern, we’re preparing your kids for the future”.

The last government certainly thought so, with record levels of ICT investment in schools that ran up to £0.5 billion a year. Vast sums have been spent on new computer labs, interactive whiteboards, wireless networks and laptops. In many cases this has had great effects on attendance and behaviour monitoring, but the evidence that it has led to improvements in learning outcomes is thin.

There were, I think, many cases where the technology cart was put before the learning horse, if you’ll excuse the tortured metaphor. Even in today’s frugal climate you still hear stories such as the school which excitedly went out and bought 30 iPads, only for them to sit in a cupboard while the deputy head appealed to colleagues for some ideas of how to use them. A classic tale of technology trumping pedagogy.

As teachers, we all know that learning happens most effectively when students are engaged in an activity that allows them to receive frequent, formative feedback about their skill level, with suitably challenging and varied tasks that sustain their interest. This has to be the primary objective of any lesson, and sometimes it can be aided by careful use of classroom technology. A great example of this is a maths lesson I saw last week where one student was at the front manipulating an interactive online activity on angles, while the rest predicted results and gave feedback via a set of wonderful low-tech mini whiteboards. They had fun, the teacher managed to pinpoint misunderstandings, and everyone progressed.

The trouble is, technology is not always the answer, and it can even harm the learning when used badly. I was recently told about a rather nervous teacher who used to stay glued to the front of the class, with very little chance for interaction with the students, and consequently a number of behaviour problems. The school was working hard to encourage her to venture out among the students, and there were clear improvements being made. The school then installed an interactive whiteboard in her class and in encouraging her to use it, unfortunately exacerbated the original problem as she started to rely on slides and activities that kept her stuck behind her desk once again.

Even the best technology can also cause real trouble when the reliability isn’t 100%. I mentored a PGCE student last year who planned an interesting lesson where students would use laptops to create summary-presentations of an algebra topic. Sadly for him the gremlins struck, and the wireless network failed in the classroom. After a brave struggle to get things fixed, he eventually abandoned the lesson and dived in to some dependable-but-stodgy textbook questions to save the day, and his sanity.

The message here is that technology is not a guaranteed vehicle for improvement. I’ve heard of well-intentioned schemes to buy laptops for all students that have ended in expensive disaster, and of course everyone has seen interactive whiteboards that get ruined when frustrated teachers find they’re not working and try using dry-wipe pens on them. In almost all cases the problem boils down to failure to satisfactorily answer a few key questions.

First, and most importantly, will the purchase enable better quality learning? Things to consider include whether it helps teachers assess and feed-back, whether it encourages active lesson participation from more students, whether it allows students to tackle more higher-order, open-ended questions, and whether it allows students to work more independently and/or collaboratively.

Secondly (and, I suspect, most commonly neglected) is to ask yourself whether you’ve budgeted for the time and resources that teachers absolutely have to have in order to integrate the new technology in to their everyday classroom practice. It isn’t enough to simply run one how-to session. There must be time put aside to modify schemes of work, try out new ideas, observe colleagues in action, feed back, discuss, problem-solve and create new resources. Perhaps you could spend a chunk of your ICT budget to allocate time for these activities for a couple of years. Pedagogy takes time to develop, and is the key to successful classrooms.

Thirdly, is the infrastructure and support present? Teachers require technology to be ultra-reliable. Cutting corners on your network servers and IT technicians could be a major own-goal. Is your purchase rugged and reliable, or will half the set have broken screens and missing keys within months? Perhaps you could improve learning much better by investing this year’s budget on repairing current gadgets and instituting collaborative-planning sessions?

New technology is very tempting, and it’s really important that schools avoid the magpie-effect, ie “ooh look, it’s shiny!”  Put the pedagogy first, give the teachers time, and the learning should follow. As with everything in education, ICT alone is no panacea.

• David Weston is a secondary school teacher and an education consultant at Informed Education. You can follow him on Twitter@informed_edu.

How to create a positive culture in schools and classrooms

Leading a group of people, whether in industry, as a school leader, or as a teacher in a class, you encounter people who are supportive and some who are in general opposition to what you want to do. Anthony Muhammad captures this idea very clearly in his book Transforming School Culture although it is applicable in every situation where you have to manage a group of people.

The key idea is that you can categorise people in three broad groups: believers, inbetweeners and opposers.

The believers are the ones who engage with your ideas and are optimistic about the chances of everyone improving as a result. They will typically engage with their work quietly but enthusiastically, often avoiding challenging more negative people around them as their energy tends to be focused on the task in hand.

Inbetweeners are those who are new in to the group. If it is a completely new role for them then they may take many months to decide where their loyalties lie and the level of their engagement and enthusiasm. Those who have come from a previous establishment will take less time to decide whether to assume a new position or whether to revert to the same type as they were previously.

Finally there are those who fall generally in to the opposition camp. They may be reluctant to follow your ideas and may complain and undermine your leadership or authority. Broadly, this group can be grouped in these four categories:

  • those who oppose some or all of the current ideas and policies because they do not know or believe the reason behind them,
  • those who will not engage with new initiatives due to a lack of trust or belief in the leadership,
  • those who are too anxious to engage with any new ideas due to their own stress or lack of ability to cope,
  • those who define themselves by their opposition to certain ideology, to leadership, or to change.

I’m sure you can identify people in your organisation or students in your class who are clear examples of these types, and others who take up different roles in different situations.

For any leader or teacher it is vitally important that you gradually change the culture of your organisation or class so that the believers hold sway. If the opposition becomes dominant then everything becomes a battle of will – an unpleasant and unproductive situation.

The first important step in improving this balance is to identity your believers. Publicly and privately support and praise these positive individuals and put them with new members of the group or class (the inbetweeners). If you can give your believers the confidence to stand up to the destructive negativity of the opposition then it makes a massive difference to the culture of the group. In fact if someone who is being negative realises that they are losing social status by doing so then it is one of the most powerful ways to change their behaviour. This will only happen following your lead. It is very important that every leader and teacher stands up firmly to reject back-biting and destructive negativity, while being entirely open to reasonable discussion and criticism.

The next step is to try and win round your opposition. The first type simply need to be heard and engaged openly. Often an honest discussion and explanation of both the reasons and long term plan behind any new ideas will be enough to win these people round. When teachers make a change in working style they often have to appeal to the students to be patient, try out the new style, and take it on trust that things will improve. When management impose new requirements that will be initially difficult then once again they may need to draw on trust that has been built up.

The second type are opposing things precisely because they don’t trust the person leading them. Every teacher has experienced a class of students who have low levels of trust and refuse to cooperate with any new ideas as they don’t feel valued and don’t believe that their interests are being considered. The key here is to genuinely and honestly engage and listen, to try and make amends for previous breaches of trust, to demonstrate your trust in your students or colleagues, and to recognise their hard work and effort through both structured and spontaneous praise/recognition. It takes a long time to build trust, but only a short time to lose it. A key task of any teacher or leader is to try and build good rapport and a high level of trust so that at difficult moments of change or stress they can draw on this. The best teachers are seen as fair and trustworthy and their students genuinely believe that they are doing their best for them. This will have been demonstrated repeatedly. The same is entirely true of leaders of adults.

The third group may or may not feel that the leader or teacher is trustworthy and that the rules are sound but they simply don’t believe in their own ability to succeed, and would rather stand in opposition rather than be exposed. Some students typically truant or misbehave when they don’t believe they can do the work required of them. Fear of failure leads to a failure to engage. In some schools you see teachers who are afraid to try new things as they are so lacking in confidence in their own existing abilities that they dare not move away from their existing practice which is marginally less terrifying and depressing than something new. This is a difficult group to win around as you have to first of all build up their own ability and self-confidence. This requires a large amount of trust, commitment and belief from a mentor, teacher or leader. There are deeply psychological elements to be dealt with here, both to gradually build a sense of greater wellbeing and to instil an ability to recognise and deal with internal negativity.

The final type of opposition will usually have started out as one of the previous three types, but in an absence of any suitable engagement they have begun to define themselves as a ‘rebel’ or as someone whose duty it is to oppose leadership or certain ideology. Once in this state of mind it is incredibly difficult for leaders and teachers to engage with this type of person as they (the leader) are viewed as the source of all problems. In order for this sort of person to engage they would have to give up part of their identity, to admit they are wrong, and to effectively apologise for much that they have done. This is incredibly difficult to do. Often the best solution here is to give someone a brand new start elsewhere (as an inbetweener) with a lot of hard work to pair them with believers and build trust. If these students or colleagues have to stay in place then the only other way is to attempt to positively define them in other ways in the hope that they take this new identity on board. For a persistent rebellious student this may be by finding opportunities for them to succeed, by trying new activities, or by encouraging peers to engage first. This type of person will be naturally suspicious that any engagement will be an attempt to get them to give up their identity though.

Leadership roles (including teaching) are incredibly demanding even before these people-management skills are considered, but with a little conscious thought about the type of people you lead or teach you can find more appropriate ways to bring about positive change.

10 ways to keep your teachers happy

Nothing gives a school purpose and energy like an enthusiastic and motivated staff. However, there are so many things that can wear teachers down and this can put a dampener on any prospect of improvement, let along keeping momentum going. As a leader, there are many sound and simple ways for you to keep teachers motivated, enthusiastic and engaged. Here are a few:

  1. Recognise and celebrate passion. Simply put, nobody gets in to teaching for money or fame. Even if they’re tired, unhappy or bitter, every teacher got in to their job because they were passionate about sharing their love of a subject and about helping young people learn and develop in to wonderful adults. Even at the toughest times it is a good idea to ask your staff to recall their career highs and treasured memories, and demonstrate in your actions that you genuinely want them to have more lessons that they love delivering. The best lessons need to have outstanding learning, and should be enjoyable for students and staff. No student ever got enthused by an unhappy teacher. Even at the moments of greatest frustration with a colleague, remember that they got in to this profession for the right reasons.
  2. Start with the positive, and enthuse. Make it a rule that you notice the wonderful things that are going on in your school. Ask people to tell you about their best lessons that day, week, or term, and really listen to them. Be receptive and enthuse with your words and body language. Show that you are happy for them. Ask what you could do to help them have more moments like that. (Leaders who do this actually feel better about themselves.)
  3. Collaborate. Encourage teachers to work together. Offer training in giving positive, useful, constructive advice. Give them the time, space and resources to jointly plan lessons, observe each other and offer supportive feedback. Encourage everyone to share good ideas on staffroom walls, mailing lists and in online forums.
  4. Give time. Scrutinise every new initiative incredibly carefully, and realise that every five minutes spent on paperwork is five minutes less spent on creating quality learning, assessing student work, and meeting students one-to-one. Every initiative has value, but is it really more important than delivering quality teaching and learning? Is there a way of achieving the same outcomes with a much lower impact on time?
  5. Be pro-actively receptive. Having an open-door policy is a great start, although many people won’t feel brave enough to come to you unless a problem has got pretty big. Get out and about, engage, listen, offer help. Sit down with middle managers and staff and ask how they are doing.
  6. Share the bad times. If there’s something that you know isn’t going to go down too well, make sure you’re seen to be suffering at least as much. About to introduce a new requirement in lessons? Make sure senior leaders have to implement it first, and leave it optional for everyone else for a while. Need to ramp up the performance observations? Invite other staff in to observe and constructively support senior leaders’ teaching before you impose your observations on them.
  7. Recognise the key stress times. Ends of terms, report-writing and exam-marking times are really tough, especially for colleagues with lots of classes. Avoid new initiatives and stresses during these times, and if you can be seen to offer to lend a hand with lessons, planning, and duties at these times it will go down a treat!
  8. Be flexible. You need to be accommodating when staff ask for time off. If a colleague has an outside interest then be as flexible as you can. A decision to refuse someone a day off for their championship cycle race will only show you don’t care about them as a person, and will plant the seed of the idea that they need to leave in order to grow and develop their interests.
  9. Develop their CVs. Offer as many opportunities for growth as you can within the school. If there isn’t an opportunity going, you could offer temporary secondments to middle or senior leaderships roles, or you could try arrange a few placements in other schools where they shadow someone in a role they aspire to. Actively develop opportunities for teachers to work on their CVs, and develop a reputation as a school where the enthusiastic teachers can come and grow.
  10. Give credit. Never miss any opportunity to praise staff at your school and give them credit for the success of the school. Praise them to parents, in newsletters, to the media and to students. Praise individuals quietly behind their backs, and praise them to their faces.

What other examples can you give where leaders have created an enthusiastic school?

My Christmas Wish

In September 2005, as my family was reeling from the rapid deterioration of my mother’s health from lung cancer, I started feeling very ill myself. I turned yellow with severe jaundice. At an emergency GP appointment I was told me to take a cab to hospital immediately and the doctor rang ahead to get them ready to admit me. Something was horribly wrong with my liver.

I made an appointment to see one of the specialists at the amazing Kings College Hospital Liver Unit who soon diagnosed me with a rare disease called Primary Sclerosing Cholangitis, a randomly occurring condition without any known cause. My health continued to deteriorate, and I was in and out of hospital with infections. On one particularly awful evening as I lay alone in a hospital bed I was called by my brother to tell me that my mum had passed away with the rest of the family around her. That was one of my all-time lows.

I was put on the waiting list for a liver transplant, and in the meantime scheduled for a operation to put in a temporary measure to try and help my ailing liver. Fortunately this helped me make a temporary recovery, be removed from the transplant list, and I even managed to get back to work in early 2006.

I remained gaunt, tired, slightly jaundiced and had difficulty retaining concentration. I maintained this for two years before being rushed in to A&E in August 2008 for chronic pain, and started to deteriorate again. I went back on the liver transplant waiting list, and had to go on sick leave. Those months were a nightmare of hospital visits and sleepless nights, jumping every time the phone went in case it was ‘the call’ to come in and have the operation. The chance of me getting further complications and infections increased every day.

After a false alarm in early 2009, I finally got the call on the 4th of February. Somewhere in Midlands a family in the middle of despair and grief at the loss of their sister/mother made the breathtakingly generous decision to allow her organs to be used for donation, and I was lucky enough to receive her liver.

My life was saved. After just over two weeks in hospital I was allowed home. After only a few more weeks I was popping in to my school to help out. By April I was back in teaching, by May I managed to get back in to my big hobby of latin-american dance, and I even managed to meet my partner who I had a civil partnership with in 2010.

At the wedding we asked all of our guests to give generously to the Kings College Hospital charity in lieu of gifts, and, most importantly, sign up to the organ donation register and tell their loved ones to do the same.

Every one person who dies (and whose family agree to donate their organs) can save as many as ten other lives, and bring joy and relief to families. All it takes is for you and your friends and relations to sign up to the register, and tell everyone you know that if the worst should happen, they must give their consent.

My wish this Christmas is that you agree to give this most precious of gifts. Sign up today, and save lives.

Merry Christmas!

 

Evan Davis on Education.

By Flickr user Steve Punter (Evan Davis on Flickr) [CC-BY-2.0 (www.creativecommons.org/licenses/by/2.0)], via Wikimedia Commons

Evan Davis is currently presenting a new show on BBC,  Made in Britain which accompanies the excellent book of the same name. He is a presenter on Radio 4’s Today show, BBC TV’s Dragon’s Den, as well as Radio 4’s The Bottom Line. Until 2008 he was the BBC’s chief Economics editor (see his blog).

Evan certainly takes pains to see both sides of the argument, indeed he has been criticised for being too consensual while interviewing for the Today show, when compared to John Humphrys. Over the past week he has been both lambasted for his views that international free trade has been beneficial (if painful) for the UK economy, and praised for the way he ‘exposed’ Frances Maude over the arguments over teachers’ pensions. I had the pleasure of interviewing Evan on Sunday 3rd July, to ask him for more detailed thoughts on UK education, and I began by asking him whether he had considered teaching himself.

“…it wasn’t something I considered then and I haven’t really considered it since university just as I’ve always liked my job and haven’t wanted to change. But I do think that I would enjoy teaching. I could easily imagine going in to teaching at some point, funnily enough”

Evan was keen to encourage teachers to continue their careers beyond leadership, so that experienced teachers could go back to the classroom, perhaps part-time. He also thought that a part-time route may be a way to encourage people in industry and commerce to try out teaching:

“…there should be a route in to teaching for people who want to dabble, where you can see if you would be a good teacher later in your career – to dip your toe in the water in ways that don’t undermine the professional integrity of teachers”

We moved on to the subject of universities, and Evan said that much of our success internationally could be attributed to the deregulation of university fees in the 1980s, although that wasn’t the only thing.

“I think another factor is that, compared to other countries, we have tended to say “we want some excellence” rather than a lot of mediocrity…”

“…as a country we have had some real excellence which you see reflected in the global university league tables where we have a disproportionate number at the very top”

We discussed the effect of foreign students on the domestic ones, and Evan said the situation mirrors that of the Premier League in football with its expensive foreign players, in some ways:

“On the one hand, opening up the league to foreign players means our players get to play with the best in the world, but on the other hand it may mean our domestic players get a little ignored as the clubs are obsessed about getting the best players from abroad instead of thinking how to create the best players at home.”

During the interview I had the opportunity to put a number of suggested questions from my Twitter followers, and one of these was from Aaron Porter, ex president of the NUS, about the effect of fees on students from poorer backgrounds. Evan does worry about the debate surrounding this issue, and its potential to put young people off university. Although he isn’t keen on universities getting overly reliant on marketing, he does think that it is important for school students to fully understand what is happening.

“When you go to university you are making a bet about whether it is going to be worth it or not, and the government is really trying to skew the bet so that if it doesn’t work out then the taxpayer will bear most of the cost. If you end up in less than a ‘middle-class’ job, then you’re unlucky really, and unlikely to pay much towards your university degree. I think that really does need to be explained.”

One of the most fascinating insights was into the university fees market, where Evan compared the current situation to perfume and car-dealerships who set prices to signal something about how they want to be seen, rather than their absolute value, and then come up with ways of offering discounts while retaining their headline high list-price.

“I think it’s so clear that universities have fallen in to that category of using price as a marketing tool. We know that in those markets we don’t want prices to be that high, and the interesting question is: how will they choose to give those discounts? What will be the mechanism?”

We moved on to discuss the school system, and I challenged Evan on some statements written in both his current book, Made in Britain, and an older book, Public Spending, which he wrote in 1998. In these books he suggested our school system could be more effective than it is, and that there are lessons to be learned from supermarkets.

“I think in a really successfully operating sector there always has to be some failure, and some spectacular success. There should always be a mechanism to allow success to grow, and failure to contract,  and we’ve seen that in supermarkets.”

“If you have a sector where new capacity and new entry is very difficult, and a sector where failure is very difficult, then it’s much less likely that you’ll have that natural evolution towards more efficient and better ways of doing things.”

However there was a significant caveat about this:

“… I slightly worry that when a good school expands and takes over a bad school, that instead of having two good schools, you get two bad schools – that the good school is only good because of what it is.”

Evan is clearly a believer in the power of markets, and we discussed the consumers: in this case parents.

“…there’s no reason why a successfully functioning capitalist economy won’t deliver good schools at both ends [of the spectrum]. Whatever type of school it is, it will probably be better if there has been some parental choice. It’s whether or not you have faith in the parents…”

I suggested that the LEA’s role had been to step in where parents were not exerting sufficient influence over a school to cause it to improve.

“The interesting question is whether the LEA really was running it for the benefit of the parents who had no voice, or whether, as in so many industries where the regulator (which in this case is effectively the LEA) becomes captured by the interest of the schools, and by bureaucratic convenience.”

However, he agreed that for capitalism to work effectively in schools, you need parents to be fully able to exert choice, and to be aiming to do the best for their children.

“You would like somebody to be ‘training’ the parents, and perhaps those difficult areas are where someone should be helping the parents help themselves.”

“[Perhaps] we can think of some ‘nudge ways’ to get parents interested in exactly which school their youngsters go to, in to shopping around, putting pressure on schools rather than leaving them be…”

Finally we talked about employability, and about the focus for the school sector to produce more successful adults. Evan stressed that the key skills were numeracy and literacy, which would never go out of date (unlike certain types of specific vocational skills, such as learning how to sell mobile phones, etc.) However he was keen to stress that no matter what the level of skill, the number-one attribute for a student was attitude and enthusiasm. Evan is, I think, a little concerned that some aspects of our school system work to destroy enthusiasm in students:

“… people who are keen, flexible, have good social skills, are able to work constructively with other people – these skills are enormously helpful for anyone looking for a job and I think if schools could refrain from making people unenthusiastic, or grumbling, or lazy, then that would be very, very helpful.”

“The worse thing, of course, is that you might find that we’re currently measuring things that currently crowd that out. Measure the exam results, and you don’t measure the enthusiasm of getting kids to take part in ‘local history day’, you haven’t left time for the history day. Not only haven’t you measured it, but you remove the time for it. That would be a very great shame.”

It was certainly a fascinating interview, and you can read the full transcript here. I’d be most interested to hear your thoughts about Evan’s ideas – do please leave a comment.