Press "Enter" to skip to content

Tag: Peer

Studiosity Partner Forum 2023

Studiosity usage at Sheffield
Photo of Sheffield’s Studiosity Dashboard

Attended the second Studiosity Partner Forum in London today, which had representatives from 14 UK HEIs out of the now 23 who are Studiosity users. The opening keynote was delivered by Rebecca Bunting, Vice Chancellor at the University of Bedfordshire, who talked about issues current in HE, with a focus on access and participation. She made good points on the limitations of students going to university, which includes not only things like entry requirements and location, but also what people are able to study once there and how the cost of living crisis is impacting choice. She talked about how this can impact on student retention, which HEIs are held accountable for, but there are often very good reason why students may have to leave their study. Finally, she talked about the concept of the “sticky campus” – keeping students on campus – which is something else universities are often held accountable for as a desirable thing, but which doesn’t work for students in their 30s or who have fulltime jobs, families, etc. Those students want, and need, to be on campus to do what they need for their studies and then get away again as soon as possible. At Bedfordshire, the majority of their students are over 30.

Next was a product update session from Isabelle Bristow, Studiosity’s Managing Director for the UK and Europe. The peer support service which was in early development last year will be available in July as ‘Student Connect’, in which third year students can mentor and guide first year students after training from Studiosity and the university. These mentors are paid at a rate set by the university, and all chat and calls are managed through Studiosity to ensure privacy and confidentiality. Unfortunately this isn’t something we will be able to explore at Sunderland, as we are continuing to keep Studiosity focused at IFY and new undergraduates. Isabelle also talked about a new Writing Feedback feature which will help students to identify where they have used higher order thinking skills – at least in part designed to counter and mitigate the use of generative AI writing.

Simon Reade and Matthew Hare from Sheffield Hallam University then presented on their data dashboard which uses data from the Studiosity API and other sources, and outputs to Tableau. One such chart, showing usage changes over a number of years, is shown (badly) in the photo above. This was a very interesting session for me, as we have just done this ourselves using Power BI. Some of their findings / experience felt very familiar – high usage in Health subjects, low in their Business, Technology and Engineering College (strange bedfellows, but our Business folks can also be hard to engage with new technology and interventions). Another observation they made was that Studiosity seems to hit more demographic groups than those which traditionally access support services, a good thing.

After lunch, Dr Andy Gould from SOAS talked about how they are responding to AI which led into an open discussion. Andy referenced Jisc, who in their response said that a crisis could be used as a driver for change, similar to what I and others said about the pandemic response. The problem is the sector seems to be in perma-crisis. They have co-created a student guide containing a list of ‘dos’ and ‘don’ts’ as best practice. Andy also talked about the idea of academics using ChatGPT to write student feedback, something students were very against, unsurprisingly, and finally noted that some students have reporting using a paraphrasing service I won’t name to try and ‘launder’ AI produced writing.

Other random points and observations made throughout the day in discussions with colleagues included a note from one institution that has seen Studiosity seemingly widen their participation gap, possibly as a result of higher achieving students engaging with the service to a greater extent. Much of our discussions were on the nature of students wanting to have a personal connection when it comes to seeking support, something Studiosity delivers well, and which may indicate strong use of the new Student Connect service when it goes live. Referencing was noted as by far the most in demand area for support, and again something that may draw them to peer support. Finally, there was a comment about how in some subject areas, such as engineering, students may not get any conventional written assignment until their 3rd year, with 1st and 2nd year assignments focusing on group work. This is an important point for me, and Sunderland, to be aware of as it may help to explain weak uptake in certain areas.

Leave a Comment

Moodle Munch: Nov. 2021

Leaner Analytics Data Sources
An overview of the various data sources going into DCUs learner analytics system

They’re experimenting with the format a little, as this week saw three 5 minute talks from different departments on the subject of peer assessment. One theme that came out of all the sessions was the need to use anonymised marking for student confidence in the fairness of the process. I was particularly interested in Robert Gillanders experience of using negative marking as a motivator – for every 3% that students deviated from the mean in their peer marking, their own grade was reduced by 1%. I’m very curious about how this worked in practice and how ethical considerations were handled, and Gillanders has published a paper on this which I’m going to have to read.

The second session was on learner analytics from Cormac Quigley who talked about how they have taken data from multiple sources, only one of which was Moodle, and combined in Microsoft Power BI to produce a comprehensive learning analytics system, with the data and reports made available to staff via Teams. However, they also talked about the basic reporting functionality of Moodle, how you can combine grade book functionality with progress bars to create effective results for staff and students.

The full Moodle Munch archive is available online here.

Leave a Comment

PG Cert AP: Day 11

peer_teach

And so we come to the infamous peer teach session! In which we were each given seven minutes to teach on anything we wanted by whatever means we desired, followed by seven minutes of questions and answers, not about the content so much as observations about our teaching style.

Some interesting topics and techniques as you can imagine, from the health benefits of juicing with taste testing, to a presentation on everything you would ever want to know about the Fender Stratocaster. I taught some philosophy, in a session I called ‘Something Nietzsche Couldn’t Teach Ya: A potted history of Western philosophy from 470 BCE to (almost) the present day … Via the medium of song!’

I created a presentation using Storyline that took Monty Python’s Bruces’ Philosophers’ Song and added breaks after each philosopher was introduced in which to talk about their key contributions. In the presentation itself I had some bullet points fly in along with displaying some basic biographical information. It was well received, and I was able to field all the questions I got, though sometimes with reference to the notes I had prepared as there are things in the song which I haven’t studied.

One little thing I did struggle with was time management. The seven minute format was chosen for a reason, to see how well you can manage your topic into the available space. Though the song is very short, I had about a minute of content for each philosopher which took me over. Anticipating this, when I received my six minute warning I was ready to skip to the end and the final slide which I wanted to leave people with – about Socrates decrying modern technology! Watch the full presentation here if you wish.

Leave a Comment

PG Cert AP: Day 5

A very interesting morning session for the technology module, EDPM08, covering uses of technology to support self and peer assessment. The great thing about the tutor on this module is that they don’t just know their stuff, they back everything up with research proving that what they’re talking about works. That’s definitely something to keep in mind and aspire to in my own teaching.

First there was a discussion about peer marking, and research that shows that it only takes a surprisingly small number of peer grades to be averaged for it to approximate the grade of a tutor. That’s something that could prove very useful in the assessment for the ArtWorks MOOC that I’ve been assisting to develop. Then we covered the value of real-time formative feedback assisted by quiz tools such as Socrative and Poll Everywhere. And finally, not strictly supported by technology, there was a discussion about comparative marking, giving tutors two papers and deciding which of the two should get a higher mark, but without actually grading them. An interesting idea that I would like to look into further to find out more about how it works.

There was also a nice, almost throwaway remark about the concept of ‘desirable difficulties’, and anecdotal evidence that students learn more from bad lecturers as it makes them have to work harder to make sense of what is being taught. A kind of unintended experiential learning!

The afternoon session was back to the core module, EDPM05, and the use of reflection on teaching and learning. This was facilitated through an iterative exercise where we discussed where and how reflection takes place, wrote down ideas on sticky card and then worked the cards round on a board to reach some conclusions as a group.

Leave a Comment

PG Cert AP: Day 4

Two sessions today, delivered by two guest lecturers on different topics. The morning was devoted to peer observation and discussed the exercise in general terms, the balance which needs to be struck between institutional and individual focus, and between negotiated and imposed criteria, and then on how it works here at Sunderland specifically. Here there is a standardised form which is part of the academic quality handbook, and everyone has to be peer observed a couple of times every year. One of the assessments for this module is for me to be observed, conduct an observation and write a reflective piece on the experience.

This was followed by a discussion on various quality frameworks and their different purposes which we assessed on a scale of institutional / individual focus, and negotiated / imposed criteria:

  • UKPSF: About an individual’s professional teaching;
  • NSS: The National Students Survey about their experience;
  • TEF: The impending Teaching Excellent Framework which is designed to capture the performance and effectiveness of institutions;
  • DfE Teacher Standards: About the role and responsibilities of teachers;
  • Oftsed Observation Matrix: About the quality of learning as a result of teaching.

Our lecturer in the afternoon began with a discussion on different types of knowledge in practice, including research based evidence, tacit knowledge (from the work of Michael Polanyi who gives, as an example, the ability to ride a bicycle but difficulty in explaining how), and postmodernist approaches which argue that knowledge is socially constructed and thus particular to a given set of social and historic circumstances.

This was followed with reflective practice, the usual suspects, Gibbs and Schon, and a new one for me, Jan Fook, who writes about critical reflection and the need to unearth and examine the deeply held assumptions underlying our experiences.

Finally there was a discussion about his own research in auto-ethnography, a disciple which combines anthropology with biography to record the experience of being in a particular culture.

Leave a Comment