Press "Enter" to skip to content

Month: June 2024

AI-Augmented Marking

Chart showing correlation of human and KEATH.ai grading
Accuracy of KEATH.ai Grading vs. Human Markers

This was a HeLF webinar facilitated by Christopher Trace at the Surrey Institute of Education, to provide us with an introduction to KEATH.ai, a new generative AI powered feedback and marking service which Surrey have been piloting.

It looked very interesting. The service was described as a small language model, meaning that it is trained on very specific data which you – the academic end user – feeds into it. You provide some sample marked assignments, the rubric they were marked against, and the model can then grade new assignments with a high level of concurrence to human markers, as shown in the chart above of Surrey’s analysis of the pilot. Feedback and grading of a 3-5,000 word essay-style assignment takes less than a minute, and even with that being moderated by the academic for quality, which was highly recommended, it is easy to see how the system could save a great deal of time.

In our breakout rooms, questions arose around what the institution would do with this ‘extra time’, whether they would even be willing to pay the new upfront cost of such a service when the cost of marking and feedback work is already embedded into the contracts of academic and teaching staff, and how students would react to their work being AI graded? Someone in the chat shared this post by the University of Sydney discussing some of these questions.

Leave a Comment

Lumi H5P Editor

Screenshot of Lumi interface
Screenshot of Lumi Interface

Just a wee quick one to share Lumi, a new discovery I’ve made today via the always useful ALT Members mailing list.

This is an offline, desktop app for creating H5P content. All the content types of H5P are there, it looks and works exactly as it does through a web interface like WordPress, and content you create can be exported as either HTML files or as a SCORM package. That latter option makes it very useful for us, there are definitely use case scenarios for it here at Sunderland where we don’t have the direct Canvas integration. Viva SCORM!

Leave a Comment

ALT NE User Group: June 2024

Northumbria Uni library ceiling with power 'blocks' from the ceiling, and a humours 8-bit Mario hitting one of them
I’m not the only one who sees this, right?

Northumbria’s turn to do hosting honours this time around. It’s been a while since I was on my old campus, and I was shocked to see that the Library refurb ran out of money to finish the ceiling. I did like the ceiling mounted power extensions that look like Mario coin blocks though. Solves the problem of tripping over or accessing floor panel extensions, but introduces new problems for the vertically challenged. Julie said she couldn’t reach them to pull them down, while I, on the other end of the spectrum, had to duck and weave to avoid bonking my head on them at times. I wouldn’t mind if they actually dispensed gold coins, but no such luck.

Anyway, that’s enough shade thrown at my previous employer, time to be serious. Generative AI once again dominated our morning discussions, with a presentation by Tadhg, an academic at Northumbria, who has revamped their Business module with content related to Generative AI, teaching students how to use it to help write research proposals. This was followed by Ralph in their learning technologies team who has been using D-ID and Elevenlabs to create animated videos to supplement written case studies for students in Nursing. Dawn from Northumbria’s Library service then gave us a talk on their experience of Adobe Creative Campus, and reported a much more positive experience than Teesside.

After lunch we had some open discussions on digital exams. Newcastle are using Inspera to facilitate a proportion of their exams, and have mixed feelings about it. I was pleased to note that they have strongly pushed back on using online proctoring on ethical grounds. Emma from Teesside led a discussion on WCAG changes which prompted us to discuss getting the balance right between supporting all students along the principles of UDL, while being practical and having to work within the technical and cultural limits of the systems we have to use and processes we have to follow. Student record systems only allowing one assignment per module, for example.

Finally, Craig from Northumbria gave us a demo of some interactive 360 degree content they have created, including surgical simulations, nursing scenarios, and examining crime scenes. They are producing this content such that the scenarios can be accessed via any web browser, at the expenses of immersion, but they are also exported into a format that can be used with their bank of Vive VR headsets for students to get the full experience.

Leave a Comment