Episode 176: This week on Thinking Deeply about Primary Education, the inimitable Richard Selfridge joins me for an exploration of the use of student data and how teachers can (and should) use student data in a ways that are cost-effective (currency = time) and impactful in the classroom. As part of the chat we discuss... The misuse of data (common errors/misconceptions) How data can (and should) be used How to balance time, effort and impact when establishing data use systems ...and much, much more. If you enjoy this episode, please support us by subscribing to our YouTube channel, leaving a review on Apple Podcasts, or making a donation via www.ko-fi.com/tdape. If you have any questions or comments, you can email us at thinkingdeeplyinfo@gmail.com or join our Discord server, where we have a special channel for unseen question submission.
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
Transcript
From the show. Tap a time to play from there.
You're probably wrong and you don't know where you're wrong. Welcome to Thinking Deeply About Primary Education, the podcast that makes time and space to think about pedagogy, teaching and learning professional development.
Anything of interest to time, poorer but enthusiasm rich primary teachers. This week I'm joined by Richard Selfridge. Hi, Richard. Hello there. Hi. It's great to have you back. I mean it's it's been a while since you were on with Jamie talking about assessment. What have you been up to in the in sort of the in the months since we last met? Yeah, so the last time Jamie Pembroke and I were discussing assessment, So since. So Jamie and I have been working even more closely together to the point that I've now joined him working with Insight,
Insight Tracking to do more of the kinds of things which I've been doing for the last while, which is a lot of data, consultancy, so education, data consultant, working with schools, with maps, with organisations just trying to help people who are aware that they would like to make improvements to their use of data and just need professional guidance within that. And so I said I'm going to be doing some more of that for Insight as well as also continuing the other work which Jamie and I have done. We've been podcasting ourselves. We did run the Data Buses
podcast, but we also run conferences, we run training, we run assessment days and so doing a lot more of that and doing it alongside Insight who again you know do a lot of work in that area helping people to manage their data. So yes, so I'm so a few changes I'm doing. So working with Insight and but continuing a few other things I'm doing as well. I am extremely jealous that Insight managed to call their big event disco. You know, that's quite the coup. Oh, that took us quite a while.
We liked the fact that we could come up with it because we knew. I mean, some people, I don't know who these people are, but they think discussing data is is tedious. I heard a wonderful discussion with Stuart Ritchie on his fantastic podcast, which I can, which I can highly recommend. Well, there we're talking about statistical significance and suggesting that people would find this boring anyway. But clearly data is a bit of an interesting one. So Jamie and I decided that we needed to have something to say, well, what we'd like to have a conference like a day, which is just not not just the two of us, other people as well. So Josh Perry is involved and we invite people in the areas where
we do the conferences, but we needed a good name. So yes, the Data in Schools conference shortened to disco. That one the name game. Yeah, that's good. It's going to take some beating, absolutely. So our focus is going to be on uses of student data, because I know that's something you've been spending a lot of time thinking about recently. And I think in my experience, student data gets misused in many ways and again in my experience, causing adverse workload in many instances.
What are some of the common errors or misuses that we as teachers and school leaders should be aware of? Yes, I think again it's there are lots of things that people think about data and about numbers, about information that are when you question teachers, those work in schools and wider organisations about their understanding of assessment and data, they often you find that people are working on sometimes false premises or they're just unsure, they're uncertain.
I think there's a useful analogy here with when we're teaching in primary we're often secondary to, but in primary we're always thinking about what misconceptions might pupils have here. How do I deal with those misconceptions? And I think it's worth thinking about that data in those words as well. What misconceptions might people have and what mistakes might they make? And there are a number of things I think, you know, we've we've moved on in primary in England from a system that was very criterion based. So we had big long lists of things that we would be ticking off to see whether children had achieved certain things.
Or at least we thought children had achieved certain things because all we could see was performance and we were having to try and make our best teacher assessments, which can also sometimes be best guesses as to what children might do. So that. So we've moved on from that, although there's still a remnant to that in the system and we've moved to the situation now where lots of people are using standardized assessments and and they're using those. And again, I have a lot of time for well, well administered standardized assessments. But I think one of the things here is there's a really useful piece done published recently by
Sam Sims. Some of your listeners, other listeners may know who's you know, great researcher and does lots of different things for lots of the the big research bodies. But he wrote a piece which is called, it's got a great title, a proposal for saving 5 million hours per year, one day per teacher of workload without harming pupil achievement. But again I love the fact that in that Sam basically he looks at some really useful things and I think these are the things to consider. You can standardized assessments are very useful. You get a standardized score from a standardized assessment
But because of the legacy of progress people want to look at it 1 standardized score and another standardized score and say well well how has a child progressed using these things. Now there are ways that you can you can give some kind of indication as to the change that might have happened for a pupil. But Sam's blog is really useful that he kind of talks through some of the really good research that we have. FFT Data Lab did a really good post looking at or how do how much change is there? And particularly on at a terminally level from one term to the next in a standardized score in in primary. And it's really useful.
This is something which I talked to the schools I work with a lot to say. You would expect there to be not a great deal of change from most pupils and that's what turned out to be the case. For some pupils there is change and for those pupils it's interesting. The question is how much change is there for a people and at what point is that interesting. Sam actually puts some numbers on it which I think is useful. He he suggests that based on some other research from the Education Down Foundation that really you know a pupils score, it can change about 13 point range over a 13 point range you can look at.
So it could be all the way up, all the way down because of the measurement error, which is inherent within standardized assessments, which again, most most of the people I work with in schools often aren't aware of that measurement error. That's inherent. So Sam basically says, well, how much, you know, how many children do actually make detectable change from one term to the next, from the autumn to the spring. And it's, you know, it's maybe 7% of pupils. And if you look at from the autumn to the summer or a longer period of time, even then it's still only about 6% of pupils make a change, which you could say, you know, within certain parameters was a meaningful
change. So I think that that kind of thing is the thing where people need to think about their use of data. Are you using standardized assessments on a termly basis, for example? Are you actually using that to work out what children have learnt or what they know or you know these things that you might make assumptions that you're doing? Or are you just really using it as a as a performance management tool or a teacher management tool? And is that the best use of data? Because as Jamie Pembrook will tell you, you know you can either get good data or you can use it for performance management. So again, I think there's a
number of things that to to consider that you really need to think about, you know, what inferences can we make and how much time and effort we're going to spend collecting this information. I think the time and effort is massive because I know that it must. It feels like it's all schools shut down for a week for assessment, you know, three times a year. And that's not including the actual statutory national national assessments. And so there's probably quite a big investment and like you say, you know, using data were in
ways that are likely to impact on people's performance management. And even though lots of schools aren't moving away from that kind of idea, you know, probably still happens quite a lot and just by the nature of the bubble we're in. And so I think it's, you know, when I read science blogs, like, again, everyone needs to read this. Everyone needs to hear this message. It's a really big piece for that. I've been pushing a lot. I think it's really useful. Exactly. And you know, and primary schools, I say because I say historically we've wanted to capture some kind of data, at least we're doing it terminally now. And again, the good news is that, you know, five years ago
there were still a lot of primary schools that were doing things, you know, more than terminally 6 * a year or often more often than that. But at least now you know we've got fairly good data from teacher Tap to suggest that most primaries are now doing it once a term. But as you say in that once a term, how you know how much time is being spent on it? I I, I do think it is useful to collect information. But with the schools that I've worked with and the organisations I've worked with for the longest, I'm encouraging them to get to the point where they're only assessing maybe twice a year because they've now they've got a lot of data. They can see that the changes
you can't detect a great deal of change using a standardised assessment. And any assessment change that you do see, you know you you can't make too much too many assumptions from those changes that you do see. And so if you can move to that point and you can be a data confidence school and say it's fine. We will assess our pupils in, let's say you know, typical through primary in year one and then in year 2 and then in year three. So by year four we've got three years worth of data. Now we've also got all the teacher assessments because we're going to ask teachers to assess them. That can be a relatively
streamlined process. So you can do that. So you can begin to to just take control of your data, understand it is really useful to have standardized assessment, but you don't want too much of it because of Sam's block for example. Do you think there are any parallels with the move away from what's known as triple marking in as much as once schools took the leap of faith, they didn't notice any discernible difference and actually you've saved time and can be more impactful. Do you notice that with the schools that do that do make
that that leap? I think so, yes, and for the similar kind of reason. And once you understand, you know triple marking again, I wrote a piece on it a while ago and it's it was quite a thing but it came in because of that sort of fear and and and people wanted to to demonstrate what they were doing to to outside bodies effectively. And that's a little bit of some of the work. That's what some of the workload that's been that we've had within data is because it's been used as an audit function.
So I think there's a bit of that, but I think once people understand a little bit more about you know for example, the design of a standardized assessment, I talk about this a lot When we do discos and we do other things, if it's a if it's a well designed standardized assessment, then it's designed. And my key thing here is the items, the questions on the assessment are those they're designed to, to differentiate between pupils. And the key question they're asking is, are you the type of child who can answer this question correctly, their curriculum informed, But they're not actually trying to work out whether the child knows that bit
of information. They're not diagnostic in that way, and a lot of schools mistake them for being diagnostic tests. Now, you understand that as a teacher, you want to know whether a child knows something you've taught them or they can do something you've taught them. But a standardized assessment isn't the best way or even a particularly effective way of doing that. There are other things that you can do as a teacher that help you to understand what your pupils can do and can't do and what they know and what they don't know. So yeah, so I think it, I think that the time has come for
people to just investigate these things a bit more, understand a bit more. Which is why Jamie and I, we wrote Data Proof Your School, which is a book aimed at leadership in school really. And there's a whole section there about the limitations of assessment so that you understand these things, so that you don't spend a huge amount of time, you know, entering ones and zeros into a into a spreadsheet to try and get some question level analysis, which is probably not very effective use of your time. Of those standardized assessments available, do you have a preference or is is the is the quality much the same
because their samples are reasonably large? There are certain ones which I like again this. It's a really interesting history as to as to how they've developed as well. And that's something which I've found fascinating of late because again standardized assessments were and we typically, you know, we have them in English, oh sorry, in reading and in maths really you can get them a couple of other subjects, the hierarchical subject, but not many. But we're talking about reading and maths. And if you go back to 10 years ago, there weren't that many standardized assessments that were available in schools and most of those were annual ones
because schools were assessing in different ways because of the the levels and framework. So they were assessing in different ways. But then as soon as levels went away a whole bunch of companies started producing terminally test because that's what schools wanted. So that's an interesting bit of you know once you you once you understand that you think OK, so why are the terminally test is that because that's the best thing to do Because before there was all this focus on standardised assessments, we were just doing them once a year but in the in the transition out of levels we began doing them three times a year.
So there's some things to be said there. I think there's a couple of things that my main things I I don't really have a big preference about them because looking at them if it's a well standardised assessment, if it's you know reasonably well aligned to the curriculum, so it should be testing roughly what the children know. It gives you a good indication as to whether children are achieving within the the broader curriculum or not. So I don't have too many issues with that. Some of them are you know more tightly designed. So some of the assessments tend to be use a lot of questions items from the current year. And so you hear for some
assessments that people will say, oh, these aren't very good at assessing my pupils who have special educational needs disabilities or who English as an additional language or some additional learning need. Because often these tests are quite, they're quite skewed towards the current year because schools want to use them diagnostically even though they're not designed to do that, but that's how they want to use. Other assessments will be a little bit less weighted towards the current year and there'll be a bit more, you know all the assessments will tend to be have a number of items from this
year's curriculum and previous years curriculum, but some of the ones have a have a broader spread. So it depends on where you are as a school. I don't have a real preference. My main plea to people is that you actually read the rubric, you understand what the test provider tells you about, particularly about the timing of assessments. I I work with a lot of schools who say oh we do this particular assessment and we do it at this particular time and we do it at this time. Usually you know the week or two after the half term because somebody wants to put some numbers into a spreadsheet and
then you look into the rubric of the assessment and you realise that the assessment is designed to assess the whole terms. Learning because it's quite geared towards this term. So therefore it has some items in that you haven't covered in in your curriculum yet. So I think rather than saying that one assessment is better than another, it's I just urge people to read the rubric, understand when the assessment should actually be administered because that will, it will do, it will just yeah. As with all standardized assessment, the standardization is important. You have to kind of you've got to follow the process to get
good results. The We haven't covered this yet comes up quite a lot in conversations, and teachers sometimes will ask me which our leaders will say, oh, we're looking at an assessment, what should I get in? And so I think that look at the rubric advice is going to be my default to go to because there are too many reasons why you could choose one thing over over another. And the other thing is, you know, read the rubric, make a choice and then once you've chosen assessment, try and stick with it as long as you can. You know assessments do they do
degrade over time. There's various issues. If people have never heard about the Flynn effect, they should go and find out about the Flynn effect. Guess what? People are getting cleverer over time in the western world and the world generally as the world becomes more complex. However, if you can use an assessment video, select an assessment and use it and do it for 357, 10 years, even you will. The information will become increasingly useful to you because because you'll just have a bigger body of of data which you can then analyse and use. It worries me that I I work with
lots of schools and go into lots of schools and you ask schools about what they're doing and what they're doing is something which they've started doing recently and you want these things to be bedded in particularly assessment you want to get bedded in because there's so many benefits to doing that. I. Mean. It would be amazing to see that and to see if anyone actually was tracking. So if anyone's listening and they and they do want to talk about their experience of using the same system for 10:00-ish years, you know, let let us know. In your opinion, how should student data be used? What should be collected and can
a balance be struck between time and impact? Yes, I think I it is a it's a key thing isn't it? I say for those who aren't aware of the work which I have done for the last 10 years, I've been talking about data about 10 years ago I I I just started writing and talking and to some extent ranting about data and data use because I was so amazed what people were doing and thinking. And for a long time people were really interested in in any alternatives. They just wanted to stick doing what they were doing. But for the last while I've been really focusing on, OK, so So what should we actually be
doing? What would be useful And I think the key thing here that I probably distill it down to you, what you really need to do is to move on from a progress mindset where you're looking at point A, point B and you're saying that they were measured and they were 17 at this point and now they're 22 and that's the difference. So moving away from that progress mindset and moving to an action mindset and trying to understand, OK, So what are we actually doing? You know, we're all familiar with the fact that the whole Ofsted So what to think at the moment, but what are you actually doing as a result of this date?
And the widespread observation seems to be that for a long time a lot of data was collected. It was put into a box somewhere or file and not very much happened and I think we need to move over that. So in terms of how student data should use be used, I think the key thing is, is to be thinking about building pictures over time and not looking at these little snapshots of the last time we took a photograph of them were here and now they're here. You know if you're a year five teacher you should know more than what their last results in year fours. You should know what these children did you know in.
If you still, you'll probably still have key stage 1 results from year two at the moment, so you know what happened there, what happened to the front screening, check what happened to these children in reception, what happened in their early learning goals. You should be able to look back to that if you need to. And for some pupils you probably do need to, because those pupils are complex and you need to try and understand where the gaps might be or what their learning needs might be. So you need to build a picture over time. And I think that's the key thing about thinking about pupils more holistically and then trying to work out, OK, which of these pupils are actually, they're
they're fine. They're doing really well in school. They're they're here, they're in class, they're doing what we want to do in class. And every time we check them, they seem to be OK because that's the case for most pupils. Most pupils are doing well in our schools. We know that there's lots and lots of evidence to say that the vast majority of pupils are fine. They're doing really well and we should acknowledge that and then move on because we don't need to spend a lot of time in a pupil progress meeting or in a discussion about anything about the peoples who are great, Which of you pupils don't we need to worry about great.
Which pupils do we need to have a think about? We've got a few peoples who are pupil number of pupils who are at the front end of things. And for some reason whenever you, you know, if you do a standardized assessment, these are the children who are knocking out of the park, you know, they're getting 115 plus in assessments. That's great in primary. I'm not quite sure what you do with them and I'm always interested in hearing what people do with children who are at that ahead of the pack. And I'm always interested to know whether those pupils are the oldest in the class because that's an interesting question.
So therefore age data is really useful, particularly in primary, particularly as when the children are younger, but all the way through to year six it's useful. So I think it's it's that sort of building a picture move. All the fine pupils recognize who they are and say they're great. All of our curriculum work that we've done and everybody's done huge amounts of work on that, that's working for them, but these pupils, it's not working for. And then building up that picture and then drilling into it and saying, OK, So what gaps might this child have? Which areas have they struggled with? What have they got better at and how did they get better at it? Might that help another child in
this class or one of the other classes or one of the other colonels. So it's that kind of thing. It's building pictures and figuring out who who isn't succeeding within the curriculum and then working out what are we actually going to do? And then that's the So what thing, what are we actually going to do about? It Aztec, it reminds me of what Chris always talks about reading and when there's the, I don't know, almost like a tendency to assume that phonics hasn't worked. When actually, if you think about the reading rope and the different elements of reading, it's almost like being really
forensic about what might be going on with these pupils and almost like, is that the sort of parallel you're drawn like to to get that far down into where we, how can we help these pupils. Exactly. Once you realize I don't have to worry about all of the pupils in my class. I'm only really, I've got a class of 30, let's say. I'm only really having to drill down into 6-7, maybe 8, you know, around about that number of pupils. But for those pupils you should be spending a bit of time and really thinking, OK, So what is it? You know, as you say you know, understand the reading rope, understand those different areas of reading, understand the
different elements of, you know, the core subjects, writing and maths particularly, and then thinking, OK, So what is it that we need to do? What can we change here? Or so that these people has the opportunity to learn the things we want to learn, or that they get the support to help them to develop the independence that they need to be able to learn? So it's those kinds of things. Because all pupils are individuals, we've now hopefully got to the point where people realize that there's no such thing as a special needs child and you can't group special needs children. All you can say is this whole group of children, they have
some additional needs, but all those needs are separate. So we have to get down an individual and work out what we're going to do for the individuals. There are ways that you can support those individuals that I think are more effective than others and often that is to try and put that support in class as much as possible. So you make changes at timetable level and at at curriculum level and you say OK for this year four class for example, who you know, so current year fives for example, who who were out of school during the pandemic. So, so they missed a lot of
phonics teaching. So whilst they've probably learned to read and whilst you know the majority of them, you know, I've been teaching a year five class recently. You know, most of the children have got through it and they've worked out and they they're doing OK. But there are still big gaps in there and you can kind of see their big gaps in there. So you need to go in there and you know, for that year five class, they needed actually to have within their timetable, they need some timetabled curriculum, phonics curriculum. So they actually need to understand, you know, how we join the letters together and how these different cells work together and and so on.
So yeah, so you need to think about it at that level, you know, So what, what changes can we make and can we do I? Mean that makes total sense and as a maths person as well thinking about which bit of math is it that actually unlocks the rest, You know, because I think you mentioned earlier on, you know the hierarchical subjects do well with assessments and maths being that almost linear journey you can. You know, when I talk to secondary sort of heads of maths, they always talk about how they go to Year 5 maths when pupils are struggling in secondary school. Yep. And actually I say that, well, no, you need to go way, way further back because year five is the hardest maths in the primary.
Exactly. The thing which I say is basically order up to year four you're working with whole numbers pretty much. And you know and children should be you know by the end of year four that's they really have got the idea with whole numbers. Once you get into year five suddenly you get into the whole bit of where you say yeah but that's not the whole picture children. There's bits of numbers and there's some of these numbers that are on the wrong side of 0 just to everybody's point point of view. And then yeah, you're quite right. It gets all quite complicated and it's very hard to to understand. Fractions of all kinds, decimals, you know, fractions
and percentages and so on. If if you're, if you're not rock solid in calculation, in number, in you know, shake space, those kinds of things. I mean, it feels like the this kind of shift actually shouldn't take too much effort from schools. I mean, when you're working with people, do you find they need to make wholesale changes or can they just tweak things to get towards the point where actually they're being more effective in their practice? It's it's a gradual change again and I've done enough work with schools and and to understand that you need to be really clear
what changes you're going to make and have a timetable for them that is feasible and that you don't make wholesale changes. It's the whole Chesterton's Fence thing where don't remove something if you don't quite understand why it was put there to start with and making wholesale changes without really having thoughts about the consequences is tricky. Again, there's a great EF bit of guidance that came out recently about managing changing in schools that I think is really useful.
It builds on the assessed plan do review cycle, which that we're all familiar with, but you know, basically says a similar kind of thing. You need to work out what is you want to change. You need to make sure that you then, you know, put some change in place and then assess whether it's worked and so on. So when I work with people, I say don't change a lot of things, but there's a few things you need to do. You know, there's a few. You want high quality data so you can need to work out what data you need, What do you actually need. This will be a wider set of data than you've probably been using because you have been encouraged to just focus on progress.
Pretty much. You'll have forgotten about the fact that some of born children are systematically different from autumn born children, you know, because we forget about them. It's amazing how often that happens. There'll be all kinds of other bits of information that you might not have focused on The fact that a child might have had a medical issue three years ago that's not captured in your system anywhere. And therefore the teachers further up to the school just, you know, are not well, they don't understand that. So a child's got misconceptions because they've missed some schooling or they weren't able to focus as much. So those kinds of things I think. But no, the things that when I'm working with schools is to say
you should really. There are good standardized assessments for maths and for reading, so you should really get those sorted out. You should think about what you're doing with writing. There are ways of assessing writing that are more efficient. You should certainly look at no more marking and consider whether you're going to do some kind of comparative judgment in the foundation subjects. There are other things that you can do so that you can see development over time, more progress over time development. Are these people sticking with the curriculum? Are they able to do more? Do they know more? All those things that we often talk about. So I think there's a number of things there. But but at the same time, you also have to work out well what's actually working in the school because one teacher or
one department or one Group 1 cohort, they might be working really well and they might have some really effective practices that they can share with colleagues. So I think it's that sort of gradual process of just basically saying to people, what are you doing at the moment? What do you want to do? How are you going to get to where you want to be through that, I think? That'll both be really reassuring and and really helpful for leaders who are considering these changes to know that actually it's, it sounds, you know, very manageable. And I mean just on the whole, umm, summer born. What did we did?
We discuss Malcolm Gladwell's. I know, I know. Malcolm likes to round off the edges. Did we discuss his hockey players and footballers? We have. Done. No, we didn't do last time. But again, it's it's a it's a really indicative and it illustrates the issue really well. You've read the the piece about the ages of professional hockey players in the States, ice hockey players. It's extraordinary. Yeah, I mean, I think whenever I read Outliers, that was one of the it's just sort of, you know, you know, you're making connections between what you're reading and what you you do on a daily basis and it's like, wow, yes, you know.
The basic, you know, the argument that Gladwell uses using a lot of data is to say if you look at professional hockey players in the in the National Hockey League in the States, a huge number that more than 50% of them are born in the first quarter of the year. And part of the reason for that is because they're put into a cohort, they're the oldest children, so they're the biggest children, usually physically bigger. As a group, they're physically bigger individuals. Again, none of this is about individuals. It's about a group. So as a group, they're bigger than other children. And because they're bigger, they're probably stronger. They're probably more able to do things, so they look like
they're better. So they have key things that they start to get better coaching. They start to get better coaching relatively early on, so that by the time they these these hockey players are 14/15/16, they've had much, much more intensive coaching from more highly qualified coaches. They've played with other other hockey players who've had good coaching. So they've played at a higher level so that by the time they get to 60, they're so much better as a group than the autumn born, particularly the winter board.
The last quarter of the year last, yeah, the last quarter of the year that was born there. That isn't to say that there are some hockey players from that last quarter. There definitely are, but they're anomalies. They're unusual, and it's exactly the same in a class in school. It's really worth knowing who's the oldest, who's the youngest, what's the rank order in your class. And you would expect the older children to be able to do more and know more because they've been around longer and you would expect the younger children to be to know less and to be able to do less.
That's not, it's not rock solid at individual level. You get loads of brilliant summer born children and loads of children in autumn born who who struggle. But understanding that the population trends helps you to begin to understand this is it's not difficult information to collect, it's basically within your school system. So bring it in, do some very quick analysis and then you've got some good questions to ask. You'll soon publish, and I think I misremembered this once. It's like it's it's a guide to using student data. What's the official title?
It's a little guide to using student data. So I've written a couple of books for Sage and they they have a, they've got a really great strand. It's really there's some brilliant little books which are called Little Guides 2 and which I can highly recommend. They're really good, but they're quite short books, they're quite nuggety and they're aimed at. Busy teachers, What prompted you to write the book and what do you hope it will achieve? Yes. So the book which I've written is Little Guides Using Student Data, which is published June
this year to June 2024. And it was prompted because. So I've written a couple of books. The first book I wrote was called Data Bus Busting for Schools and largely it was a big thing saying stop using statistical significance badly, please Ofsted, this is terrible. It's not making it, you know, you're misusing things and it's it's misdirecting people and they're spending a huge amount of time on things which are not helpful to pupils. So that was largely written at kind of a policy level. It's just still a great book and I still recommend it.
The beginning of the end. The Middle's got lots of maths, but you might find that interesting. I like maths but that book was quite maths, see, and lots of people in school said we don't have time to read it. So the second book which I worked with Jamie Pembroke, is Data Proof Your School. And that's firmly aimed at busy head teachers, busy senior leaders who who just want to. OK, so I want to understand the problem. I want to understand some of the wider issues and then I want to understand what I can do. And effectively it's a how to guide to data proofing your school, which is to to say to take control of your data, to use your data to actually make
differences for children in schools, which is what that's about. So having done those, the things which I've been wanting to do for a long time now that I've got to the point where people again, you're feeling that you're pushing into a little bit of an open door. People recognize, well, actually, yeah, we could be using this data more efficiently. We could be, rather than feeling hostile about data, which is certainly how I felt about the way it was being used in the 20 Tens, people got a bit more open. So I talked to Sage about doing something which said, OK, let's let's have a practical guide for teachers to say this is the kind of thing you should do. So there's a number of things
which I think, you know, as a working teacher, lots of teachers use things. One of my this is my little anecdote for this. You speak to a lot of secondary school teachers who often say to you kind of joking when you're in the pub or somewhere in a, you know, a relaxed social environment. What is it that you teach these children in primary school? How can they turn up here? That's a whole bunch of them. You know, they can't use capital letters. They can't write sentences. What's the problem here? Now my I thought about this at great length and I kind of thought actually, I wonder, is this related to something which I'm aware of in the classroom, which is that for a lot of pupils, they just don't quite
know what the letters look like. So that's a it's a key thing, you know. So we talk about misconceptions and you know, think something you might just not have learned. If you don't know what a capital Q looks like, then you can't write that down. You know, if you're not sure what you know a capital H looks like, then you're not going to write a capital H, you're going to write a lower case H because you've probably seen more lower case HS and you're probably used to writing the lower case alphabet. You don't probably use capital HS too much. So therefore it's a really useful thing I think as a teacher and I think it's essential that you know which of
the children in your class don't quite know the alphabet yet. It's amazing how many children in primary it's. I mean it's a huge number but it's it'll be 10 to 20% of the class where they just, they don't know the alphabet song or they've forgotten it. They don't know the order of the letters. They can get up to maybe I and J and then after that, I don't know if this is your experience. Some of them, it just it falls apart. So I think it's a key bit of information. Now you can capture that information quite easily, and whenever I work with classes I always get the children, particularly in an English book, any book that involves writing
in the Backpage, one of the earliest tasks they asked them to do as a do Now type task is just write the alphabet, lowercase, uppercase, and then write the numerals as well. You usually have to explain what numeral means because they don't know what that is, but then get them to write those as well. And again I I've yet I think I've yet to meet a primary school teacher who doesn't recognize the fact that a lot of pupils letter formation is is either inefficient or inaccurate and that's the key and I think This is why when children get to year seven-year eight and they don't use capital letters it's
because they don't know what they look like. So that's key information and it's a really simple bit of information you can get. And I think this is the that's the kind of it's there's lots of little things like that in the using student data where these are quick, easy bits of data that you can gather. You don't need to collate this information. It doesn't need to be put into any system. You know, nobody in senior leadership needs to see this. But you as a teacher should know there are certain things that I should be doing. I should be checking their alphabet, I should be checking their neurons, I should check, you know, whether they know, you
know the names of common shapes in maths, those kinds of things. You know there's lots of little things. Do they know what the standard algorithms are for, you know, addition, subtraction, multiplication, division. And as they go through school, do they know them that are appropriate at their age, you know, and just ask the children, get them to do it and then work out. Most of them will be fine, but the ones who aren't, you need to know they are. So I think those are the, those are the kind of the key things which has made me think in terms of, you know, what we should do. But then there are other things as well, I think as well. As a teacher, you need to
understand a little bit about, you know, how you should gather data in what data you should have at your fingertips, you know. So if you're a year four teacher, you should have phonic screening check scores, you should have access to early learning goals, information. You should be able to see which of the pupils in your class were great, were not great, and you should have some sense as to how things have changed over time. But then you also need summaries of those you know, and you need to make sure that you. I'm a huge fan of an annotated seating plan and actually
putting useful information onto your seating plan that you're going to use to help you to understand your class. And the key thing, I think is imagine that you had a supply teacher who's going to teach your class for a day. Now, you know, in primary, your class inside out, you know all of the little issues. You know the friendship issues. You know who's left-handed. You know who wears glasses. You know who doesn't like wearing their glasses, so probably isn't wearing their glasses. You know, who doesn't like writing their left hand. So this week has decided to write with their right hand. You know, all these little bits of information about your class. You know which child was ill for six months in year 2 because you
should have found out that information. So you've got a supply teacher who comes into your class. How are you going to get, how are they going to know which of the children they really need to be aware of? Because most of the children would be fine, but some of them need something extra, and it's that. I think it distills down to that. If somebody else is going to teach your class, what would they need to have at their fingertips? Because that's what you need to be always working towards. So is the idea that if enough teachers have this information then you can drive system change upwards?
And I asked this as someone who basically they were banging their head against the wall sometimes in school. And is that your plan? Is that your hope? Well, it's kind of wider than that, yes. So there's a whole bunch of of of kind of really, I think key things that that teachers in classrooms should be doing so that they they can generate the information which they need to understand. It's all about that formative information about trying to figure out what can they actually do, what can I what have I seen them doing? What can I get them to show me that they can do? So I I'm. I'm and I'm aware that they've learnt it's all about, you know, using do now tasks.
It's about using the things that are quick, easy. You know all of this. You know all of the research that we have into retrieval practice for example, it's embedding those kinds of things. So it's that. But it's also, there's a bit in the book about helping classroom teachers who probably haven't had time to read data, proof your school or do much training on standardized assessment. There's a bit in there about the benefits and the limitations of standardized assessments. There's a bit about understanding issues to do with, you know, the questions around question level analysis and so on. So hopefully the teachers can be empowered to say I actually, you
know, is is this a reasonable use of this information? Is this a reasonable use of this data? So this one I say is is very much aimed at just supporting those in class. And I think, you know, the more that teachers in classrooms, classroom teachers become confident or more confident with with their deities, the more that they'll be able to to question some of the things which might be being pushed down on. When you wrote your first book, did you have in mind that you would hit almost these three essential sort of pillars of the? When I wrote the first book.
So around about that time, I've done quite a lot of work with them, with David died out and I had lots of conversations with him and he was always interested in saying, So what should we do? And I'm saying, yeah, but David, until people recognize that there's a problem, there's there's not much point saying to them you need to really take. I mean, I started off quite early on saying why do people not use age data in primary school? It just doesn't make any sense to me at all. Why do we not really do you know, so for example, you know you should you should know these things. And so, so I sort of started doing that. But but it turned out that actually people was quite so embedded and wedded to the idea
that we could measure progress that you just did a lot of work to help people to understand why that was problematic and why the assumptions that they were making were not, they were not reasonable assumptions. So, so yes, it was kind of always at the back of my mind to say, how can we do that? How can we do this? And it's, I say, so yeah, I think there are lots of things that you can do in classroom and you want to almost reclaim data as being a positive thing because again, I've been teaching 20 years. And for those of us who've been around that length of time,
longer data did become a bit of a cudgel that people were using. And so it got a bad name and people were a bit afraid of it or disliked it or suspicious of it. And I don't think that's the case. You know, I say this at discos all the time. You can't teach in England without assessing your pupils. But everything that we do is based, you have to assess your pupils, teacher assessments, is is, is vital. You're probably wrong and you don't know where you're wrong. So you need some kind of independent ways of checking to see whether you're wrong or not. But you can't teach in England
without assessment. Not France, where you know, famously it's still a bit of a case this but but famously de Gaulle would say that he knew what children were learning at any given. Point on a Tuesday in April. Can't remember what the quote was because that's how you to teach what they used to teach. In practice. They've changed slightly, but it's still very much a dictated system there. Whereas here, you know as a teacher you're you're expected to understand your class and to teach them accordingly. And I think it's it's key that you get that information. So yeah, so I've always wanted
to focus on better use of data in the classroom. So it's nice to finally get to the point where I've managed to distill all of this and put it into an easily readable guide which you know you can sit down and read in the afternoon. It's not. It's not a long run. When should teachers expect to be able to access it or buy it? Well, yeah, I say it's due to be published next month. So I'm expecting by probably by the third week of June it should be available. It's certainly be available for the beginning of the new term and loads of keen people will be able to read it over the summer. I'm hoping I'm really looking forward to seeing the feedback from from it because again I'm
hoping that other people say oh actually yeah, the thing which I do is this something which which you know I say I've researched fairly extensively on this one talk to lots of people about what they do in the classroom but it'll be interesting to see what what response it gets. I I imagine there will be a fantastic response on that and I think you can look forward to lots of you know the the if a book's going well during the summer it'll be beside the Lilo or the the the daiquiri in the in the all inclusive holiday sort of I'm trying to think what the word is the poolside, that's the poolside edgy book.
If teachers and leaders take away one thing from this chat, and perhaps one thing from the book as well if they crossover, what do you hope it is? The main thing is to focus on the children who you need to really understand because they're complex. There's something that's getting in the way of them being able to access and thrive within your curriculum and you need to understand the big picture of those pupils. The idea that this child, you know a child in year three has been assessed as working towards
and therefore the new teacher should just be able to push them into working at just by teaching harder is I'm hoping something that people will, they'll move away from. They'll understand a child who is not succeeding with our curriculum, who's struggling within the curriculum, is not doing what we want to do. Ultimately, they're not going to get to this point. Doesn't look like they're going to get to where we want to get into stage two, that we need to really drill into the child, work out what's their journey been so far. Which areas have worked.
Which areas haven't worked. Which areas look do we look like we need to make some changes for. And then make the changes for those children, as you know, And again a few children, but try and make those children in a way that that will be actually something that a teacher can do, you know. So in the book, it's very much, you know, you need a seating plan to understand what you're doing on the other side of your seating plan. I suggest using an A4 sheet of paper or an iPad. Couple of pages. On the second page, this is what I'm actually doing. What I'm doing is I'm doing this for this child. I'm doing this for this child
and this for this child, for the group, for the class. This is what I'm doing. And that you keep a list of that and it's really front of mind. We need to at every point of the school day do a bit more work on number, on division algorithms, on alphabet, on whatever it is. So all those little bits of time that you get in your class when you're lining up, when you're getting ready for things, when child's finished their bit of work, you give them a task that that you know will actually help them to do the thing which you know they need help.
So that that's kind of what I'm hoping people will do. So really understand the big picture for a child and for the children who need it, and put those things in place so that something actually happens that will change something. I'm spending on things that will make a difference. I mean, yeah, absolutely fantastic. I look forward to reading it. Will you join us again and perhaps some of the others who are regulars? And if we read it and think actually there's a thread, I would have done. Oh, absolutely. I'd love to hear people's thoughts. And again, I'm I'm hoping as I'm really hoping that it that it,
it sparks a conversation amongst, you know, primary and secondary teachers as well to say, OK, what information is it that that I gather that I find really useful that help, you know, because there are areas that that I probably haven't booked. As I say, it's a short book. I've made it quite focused, but I'm really yes. I'd love to come back and discuss people's thoughts. Fantastic. All they have to do really is to say thank you very much for joining me. That's an absolute pleasure. It's very, very good to join you indeed. Thank you. And everyone at home. Until next time, thanks for listening.
Learn more about The Story of Maths and ACEL Pro - www.alta-education.com/tsom-overview and...
Learn more about The Story of Maths and ACEL Pro - www.alta-education.com/tsom-overview and...
Learn more about The Story of Maths and ACEL Pro - www.alta-education.com/tsom-overview and...
Learn more about The Story of Maths and ACEL Pro - www.alta-education.com/tsom-overview and...
Learn more about The Story of Maths and ACEL Pro - www.alta-education.com/tsom-overview and...