Press "Enter" to skip to content

Tag: Studiosity

Studiosity Partner Forum 2024

I attended my third Studiosity Partner Forum today, which kind of began last night with a dinner and discussion about generative artificial intelligence led by Henry Aider. Generative AI and Studiosity’s new GAI powered Writing Feedback+ service was of course the main topic of conversation throughout the event. Writing Feedback+ launched in February, and they have reported that uptake is around 40% of eligible students, which compares with 15-20% for the classic Writing Feedback service. The model has been built and trained internally, using only writing feedback provided by Studiosity’s subject specialists, no student data. The output of WF+ is being closely quality assured by those agents, and they estimate that quality is around 95-97% as good as human provided feedback.

David Pike, from the University of Bedfordshire presented on their experience with the service in the afternoon. They made it available to all of their students in February, around 20,000, and usage has already exceeded usage of the classic Writing Feedback service since September last year. The average return time from WF+ is around one and a half minutes, and student feedback on the service is very positive at 88.5%. However, he did also note that a number of students who have used both versions of the service stated that they preferred the human provided feedback.

On the flip side of AI, last year Studiosity were exploring a tool to detect submissions which had been written by generative AI. That’s gone. Nothing has come of it as they found that the reliability wasn’t good enough to roll out, especially so for students who have English as a second language. No surprises for me there, detection is a lie.

The keynote address was delivered by Nick Hillman from the Higher Education Policy Institute (HEPI), who talked about their most recent report on the benefits and costs associated with the graduate visa route. It’s overwhelmingly positive for us as a country, and it would be madness to limit this.

Other things which I picked up included learning more about Crossref, a service for checking the validity of academic references; a course on Generative AI in Higher Education from Future Learn was recommended; and Integrity Matters, a new course developed by the University of Greenwich and Bloom to teach new students about academic integrity.

Finally I was there presenting myself, doing my Studiosity talk about our implementation at Sunderland and the data we now have showing a strong positive correlation between engagement with Studiosity and student outcomes and continuation.

Leave a Comment

Studiosity Partner Forum 2023

Studiosity usage at Sheffield
Photo of Sheffield’s Studiosity Dashboard

Attended the second Studiosity Partner Forum in London today, which had representatives from 14 UK HEIs out of the now 23 who are Studiosity users. The opening keynote was delivered by Rebecca Bunting, Vice Chancellor at the University of Bedfordshire, who talked about issues current in HE, with a focus on access and participation. She made good points on the limitations of students going to university, which includes not only things like entry requirements and location, but also what people are able to study once there and how the cost of living crisis is impacting choice. She talked about how this can impact on student retention, which HEIs are held accountable for, but there are often very good reason why students may have to leave their study. Finally, she talked about the concept of the “sticky campus” – keeping students on campus – which is something else universities are often held accountable for as a desirable thing, but which doesn’t work for students in their 30s or who have fulltime jobs, families, etc. Those students want, and need, to be on campus to do what they need for their studies and then get away again as soon as possible. At Bedfordshire, the majority of their students are over 30.

Next was a product update session from Isabelle Bristow, Studiosity’s Managing Director for the UK and Europe. The peer support service which was in early development last year will be available in July as ‘Student Connect’, in which third year students can mentor and guide first year students after training from Studiosity and the university. These mentors are paid at a rate set by the university, and all chat and calls are managed through Studiosity to ensure privacy and confidentiality. Unfortunately this isn’t something we will be able to explore at Sunderland, as we are continuing to keep Studiosity focused at IFY and new undergraduates. Isabelle also talked about a new Writing Feedback feature which will help students to identify where they have used higher order thinking skills – at least in part designed to counter and mitigate the use of generative AI writing.

Simon Reade and Matthew Hare from Sheffield Hallam University then presented on their data dashboard which uses data from the Studiosity API and other sources, and outputs to Tableau. One such chart, showing usage changes over a number of years, is shown (badly) in the photo above. This was a very interesting session for me, as we have just done this ourselves using Power BI. Some of their findings / experience felt very familiar – high usage in Health subjects, low in their Business, Technology and Engineering College (strange bedfellows, but our Business folks can also be hard to engage with new technology and interventions). Another observation they made was that Studiosity seems to hit more demographic groups than those which traditionally access support services, a good thing.

After lunch, Dr Andy Gould from SOAS talked about how they are responding to AI which led into an open discussion. Andy referenced Jisc, who in their response said that a crisis could be used as a driver for change, similar to what I and others said about the pandemic response. The problem is the sector seems to be in perma-crisis. They have co-created a student guide containing a list of ‘dos’ and ‘don’ts’ as best practice. Andy also talked about the idea of academics using ChatGPT to write student feedback, something students were very against, unsurprisingly, and finally noted that some students have reporting using a paraphrasing service I won’t name to try and ‘launder’ AI produced writing.

Other random points and observations made throughout the day in discussions with colleagues included a note from one institution that has seen Studiosity seemingly widen their participation gap, possibly as a result of higher achieving students engaging with the service to a greater extent. Much of our discussions were on the nature of students wanting to have a personal connection when it comes to seeking support, something Studiosity delivers well, and which may indicate strong use of the new Student Connect service when it goes live. Referencing was noted as by far the most in demand area for support, and again something that may draw them to peer support. Finally, there was a comment about how in some subject areas, such as engineering, students may not get any conventional written assignment until their 3rd year, with 1st and 2nd year assignments focusing on group work. This is an important point for me, and Sunderland, to be aware of as it may help to explain weak uptake in certain areas.

Leave a Comment

UKAT Annual Conference 2023

The University of Sunderland has done a lot of work over the past few years to standardise and professionalise our personal tutoring provision and align it with UKAT, the United Kingdom Advising and Tutoring association. It was from this that the Studiosity project began, and when our Pro VC for Learning and Teaching put out a call towards the end of last year for us to attend and present at this year’s conference en masse, I submitted a proposal for my Studiosity pilot year presentation – now in what I hope is its final form, including impact on attainment and progression for the pilot cohort.

Conference sessions I was able to attend as a participant were:

  • UKAT Curriculum Taster Session, by Karen Kenny of the University of Exeter which allowed me to complete an introductory module.
  • Empowering Under-Represented Voices, by Rachael O’Connor from the University of Leeds which included a discussion on how tutors can reach and support those students.
  • Considerations Around Academic Misconduct, by Luke Jefferies from the University of East Anglia – a really good session that deconstructed notions of ‘cheating’ and discussed some of the unspoken and unacknowledged factors which feed into academic misconduct. I had not considered, for example, that in some cultures it is a sign of respect to directly quote others, rather than being taken as plagiarism as it is in UK HE.
  • Lighting Talks on the significance of graduate attributes, an evaluation of the impact of mindset interventions, and the impact of specialist academic tutors from my colleagues at our London Campus.
  • Technology in Advising SIG, by Pete Fitch of UCL who led a discussion on what technologies we are using to support tutoring, including learning management systems, ePortfolios, and bespoke timetabling and appointment booking systems.
  • Understanding Student Finances, by Charmaine Valente from the Student Loans Company who talked about the current loans system in England and Wales which is helpful for PATs to know about to be able to inform students.
  • Academic Coaching at the University of Wolverhampton, by James Jennings who talked about the dedicated academic coaches they are employing at Wolverhampton to provide dedicated support and pastoral care for students.
  • Critical Thinking and Tutoring, by George Steele of Ohio State University which was an interesting session to see some of the differences in perspective in the US system, such as students choosing an institution first without knowing what they want to major in. Part of the role of tutors there is to guide students and help them make that decision.
  • Active Listening for Effective Personal Tutoring, by Angela Newton from the University of Leeds who led an interactive session exploring and evaluating our listening skills.

Attached photos are from the opening keynote speech, George Steele from Ohio State talking about reflective thought, and examples of the Welsh language not trying very hard (I feel like I can get away with this joke by being Scottish).

Leave a Comment

Studiosity Research Outcomes

Screenshot showing improved attainment for Studiosity users
Screenshot showing improved student attainment where Studiosity was used

In this presentation Professor Liz Thomas, who has previously done impact analysis for Studiosity, presented her latest research on the experience of UK institutions using the service since it launched here in 2016/17, and now includes 22 UK HEIs.

The screenshot I’ve included above shows improved attainment rates of students who have used Studiosity versus those who did not, and looks very similar to the charts we produced here after our pilot year. Caveats abound of course. I’ve said “correlation ≠ causation” more times that I can count of late, and it is perfectly possibly that the students who engage with Studiosity would have been high achievers in any case, or would have engaged with other interventions to improve their work. But it certainly seems like there is something there, and the research also showed that in the groups of students who engaged with Studiosity, the attainment gap between white and BME students was reduced, and for one institution completely eliminated.

Other findings from the research included that 54% of usage takes place outside of conventional office hours, usage peaks in April (and on Wednesdays), and both professional and academic staff reported a benefit of the service as being able to refer students to a specialist service which freed up time for them to concentrate on other areas.

One point of discussion was around low engagement and how this can be improved. It was noted that students need the opportunity to be able to include a draft submission to Studiosity in good time, and it was suggested that use of Studiosity be built into assessments to allow for this. This very much echoes the findings of my colleague in our Faculty of Health, Science and Wellbeing, Jon Rees, who wrote about his experience on the University’s Practice Hub.

Leave a Comment

Studiosity: It Works!

Photo of entrance to London Campus
Photo of the entrance to our London Campus

It sometimes feels like Studiosity has taken over my life over the past couple of years, but it works! And I have the data to prove it. Some analysis recently completed after our first full year of usage showed clear correlation between student success, as measured by progression and outcomes, and engagement with the Studiosity service. I can’t exactly share University data of course, but I was recently interviewed by Studiosity about this work and a news article has now been published on their website about it.

Leave a Comment

UUK Access, Participation and Student Success Conference 2022

I was honoured to be invited to attend the UUK’s Access, Participation and Student Success Conference 2022 by colleagues at Studiosity, to present a case study on why and how we have implemented Studiosity at Sunderland over the past year. This was a variation of my presentation for InstructureCon, with the technical slides de-emphasised and new sections added about how the Studiosity project ties in with our wider personal academic tutoring project and the University’s Student Success Plan 2025. My presentation was well-attended and I got some good questions and feedback, and as an attendee at the conference I got a lot out of the other sessions I was able to attend.

Kaushika Patel, Deputy PVC Equality, Diversity and Inclusion at De Montfort University, presented on closing ethnicity awarding gaps, something which is an issue for us at our London Campus in particular which has a much more diverse student intake. Kaushika’s talk was about what progress has been made since the 2019 UUK and NUS ‘Closing the Gap‘ (PDF, 2Mb) report. My first photo above shows that there has been some progress, with the overall gap decreasing from 13.2% to 8.8%, but there is also a particular issue with 1st class awards, where the attainment gap between BAME and white students is 9.6%. Kaushika made some practical suggestions about what we can do going forwards, including signing up for the Race Equality Charter. I’ve picked that one out as I was disappointed to find that Sunderland was not a member, though I’ve spoken with our EDI lead and been assured it is on the agenda of our BAME staff group.

I also got a lot out of Nathalie Podder’s passionate talk about how the cost of living crisis is affecting students. Nathalie is the Deputy President (Welfare) at Imperial College Union and her presentation was based on consultations with students at Imperial College London. My second two photos show their ‘Findings’ and ‘Government Recommendations’ slides. Among the findings are that 95% of students are concerned about the cost of living crisis, 58% are worried about their ability to pay rent, and 20% about being able to pay utility bills. Their recommendations for the government included starting a new hardship scheme for students, reinstating maintenance grants, raising NHS bursaries and regulating landlords who own student properties.

Leave a Comment

Investing in Student Success: Studiosity Meta Analysis

Slide showing various success measures for Studiosity
Various success measures for Studiosity

Today I attended this presentation on research conducted by the Nous Group with Studiosity, on a meta analysis of the effectiveness of Studiosity and a methodology of converting that data into a return on investment figure in cold, hard cash. I’m not sure how confidential this is, so I won’t go into any great detail here, but I expect the report will be on Studiosity’s website in time. I believe this study looked at data from the whole of the one million students who have now used Studiosity.

The screenshot above shows some headline performance measures, including that students who used Studiosity had a 6-16% higher rate of programme retention, got grades that were 15% higher, and 88% reported increased confidence in completing their assignments. I am hoping I will soon be able to put a slide of this nature together showing the performance impact at Sunderland.

The second part of the presentation was on converting this data to a return on investment measure. Assuming that you can show improvements in retention, progression and attainment after adopting Studiosity, there is a big open question on how much weight you can attribute this improvement to Studiosity, and how much is attributable to other factors. Nous presented their ROI calculations based on a number of assumed percentages to address this.

Leave a Comment

I’m ICONic

My Studiosity presentation title slide
Title slide of my most excellent presentation

I’m also a “Top Pick”, for InstructureCon 2022 (ICON22) – according to the email announcement about the agenda being published.

I’ve attended InstructureCon, or CanvasCon as it once was, pretty much every year since Sunderland went over to Canvas in 2017, and I’ve always wanted to present but didn’t feel like I had a good enough topic. This year I’m proud to announce that I will be presenting on our experience of implementing Studiosity through Canvas over the past year, supported by my spiritual other half at our London Campus, Evi.

Our presentation is attached below, and I’m sure our actual presentation will be available online after the conference. Alas, it is a recorded one, much as I would have liked the University to send me off to Barcelona to present in person. (Damn you, Dan!)

Studiosity: A New Student Support Service in Canvas (PPT, 5.5 Mb)

Leave a Comment

Studiosity Partner Forum 2022

My first in-person conference in two years at the University of Roehampton’s gorgeous campus was a chance to learn about Studiosity’s plans for the future, to network with colleagues at other UK HEIs using Studiosity and compare notes, and pretty randomly, I was able to get a tour of Roehampton’s new library building during lunchtime (it’s lovely).

On those future plans, we’re going to see an enhanced version of the student feedback view in the next couple of months which is going to allow their subject specialists to insert short videos and infographics explaining particular grammatical concepts, issues with spelling, and so on. They are also introducing a new ‘Student Connect’ tool which will help to facilitate peer-to-peer student support. This is currently in beta testing, and two UK universities are part of this evaluation.

The keynote address was by Sir Eric Thomas, who sits on Studiosity’s Academic Advisory Board, and he made a great point that, looking at historical precedents from past plagues, people at the time always think, “this is going to change everything, we can’t go back to how things used to be”, but invariably things do go back to exactly how they were once the threat is over. He speculated that this was because plagues and pandemics leave physical infrastructure unchanged, in contrast to wars, where the physical act of rebuilding allows for societal changes to be literally built in. However, what may be different as we ‘re-build’ after Covid, is that new communication technologies such as Teams and Zoom have come into their own and already effected change in how we live and work. The permanence of these changes is something that lingers in my mind as I contemplate my future.

Good opportunities for informal chats with colleagues at more advanced stages of Studiosity use, and no easy answers to be had in terms of managing use and expectations, and showing causal links between use of the service and student retention and attainment, something I’m in the midst of grappling with now as we approach the end of our pilot.

Leave a Comment