Press "Enter" to skip to content

Tag: AI

ALT NE User Group: June 2024

Northumbria Uni library ceiling with power 'blocks' from the ceiling, and a humours 8-bit Mario hitting one of them
I’m not the only one who sees this, right?

Northumbria’s turn to do hosting honours this time around. It’s been a while since I was on my old campus, and I was shocked to see that the Library refurb ran out of money to finish the ceiling. I did like the ceiling mounted power extensions that look like Mario coin blocks though. Solves the problem of tripping over or accessing floor panel extensions, but introduces new problems for the vertically challenged. Julie said she couldn’t reach them to pull them down, while I, on the other end of the spectrum, had to duck and weave to avoid bonking my head on them at times. I wouldn’t mind if they actually dispensed gold coins, but no such luck.

Anyway, that’s enough shade thrown at my previous employer, time to be serious. Generative AI once again dominated our morning discussions, with a presentation by Tadhg, an academic at Northumbria, who has revamped their Business module with content related to Generative AI, teaching students how to use it to help write research proposals. This was followed by Ralph in their learning technologies team who has been using D-ID and Elevenlabs to create animated videos to supplement written case studies for students in Nursing. Dawn from Northumbria’s Library service then gave us a talk on their experience of Adobe Creative Campus, and reported a much more positive experience than Teesside.

After lunch we had some open discussions on digital exams. Newcastle are using Inspera to facilitate a proportion of their exams, and have mixed feelings about it. I was pleased to note that they have strongly pushed back on using online proctoring on ethical grounds. Emma from Teesside led a discussion on WCAG changes which prompted us to discuss getting the balance right between supporting all students along the principles of UDL, while being practical and having to work within the technical and cultural limits of the systems we have to use and processes we have to follow. Student record systems only allowing one assignment per module, for example.

Finally, Craig from Northumbria gave us a demo of some interactive 360 degree content they have created, including surgical simulations, nursing scenarios, and examining crime scenes. They are producing this content such that the scenarios can be accessed via any web browser, at the expenses of immersion, but they are also exported into a format that can be used with their bank of Vive VR headsets for students to get the full experience.

Leave a Comment

Studiosity Partner Forum 2024

I attended my third Studiosity Partner Forum today, which kind of began last night with a dinner and discussion about generative artificial intelligence led by Henry Aider. Generative AI and Studiosity’s new GAI powered Writing Feedback+ service was of course the main topic of conversation throughout the event. Writing Feedback+ launched in February, and they have reported that uptake is around 40% of eligible students, which compares with 15-20% for the classic Writing Feedback service. The model has been built and trained internally, using only writing feedback provided by Studiosity’s subject specialists, no student data. The output of WF+ is being closely quality assured by those agents, and they estimate that quality is around 95-97% as good as human provided feedback.

David Pike, from the University of Bedfordshire presented on their experience with the service in the afternoon. They made it available to all of their students in February, around 20,000, and usage has already exceeded usage of the classic Writing Feedback service since September last year. The average return time from WF+ is around one and a half minutes, and student feedback on the service is very positive at 88.5%. However, he did also note that a number of students who have used both versions of the service stated that they preferred the human provided feedback.

On the flip side of AI, last year Studiosity were exploring a tool to detect submissions which had been written by generative AI. That’s gone. Nothing has come of it as they found that the reliability wasn’t good enough to roll out, especially so for students who have English as a second language. No surprises for me there, detection is a lie.

The keynote address was delivered by Nick Hillman from the Higher Education Policy Institute (HEPI), who talked about their most recent report on the benefits and costs associated with the graduate visa route. It’s overwhelmingly positive for us as a country, and it would be madness to limit this.

Other things which I picked up included learning more about Crossref, a service for checking the validity of academic references; a course on Generative AI in Higher Education from Future Learn was recommended; and Integrity Matters, a new course developed by the University of Greenwich and Bloom to teach new students about academic integrity.

Finally I was there presenting myself, doing my Studiosity talk about our implementation at Sunderland and the data we now have showing a strong positive correlation between engagement with Studiosity and student outcomes and continuation.

Leave a Comment

ALT NE User Group: March 2024

GIF of Jonny 5 reading a book really fast
Now this is the kind of AI I was promised as a kid

The latest ALT North East User Group was hosted at Middlesbrough College, and had a very generative AI heavy agenda. But first, Tamara at Middlesbrough presented on ‘ED Tech and Pedagogy’ which was quite similar to a TEL and pedagogy session I do on our PG Cert, and I picked up a few points that I can integrate into future presentations. Including the argument that it is really Gen Z who are the first true digital natives which will be useful as I still use Prensky’s original talk to explore the idea that different generations approach technology differently.

Next we had a round robin session on how we are approaching AI at our respective institutions. I talked about the in-year changes we made to student regulations in response to the release of ChatGPT, something Middlesbrough College have also done, and Northumbria are using a cover sheet template for student assignments for them to delicate if and how they have used AI to help with their work. Quite a few of us are pressing forwards with Microsoft Co-Pilot now that it is available.

Ross from Durham then presented on an AI chatbot they have created using Cody AI to assist students on a large module where, for various reasons, information is located in different places, including Blackboard and SharePoint. Cody looks interesting. It’s using various models under the hood, I’m sure Ross said models from multiple provides were available, but I only saw OpenAI based ones in their demo. You train the chatbot on your own data which you upload to Cody, and sharing that data and use of the model back with OpenAI is allegedly opt-in. (Perhaps I’m being overly cynical, but I wouldn’t OpenAI on this.)

Finally, after lunch, I presented on something not AI, but EDI – the Equality, Diversity and Inclusion Portal which I have created at Sunderland in partnership with our EDI team in an effort to widen access to our various EDI educational resources.

Leave a Comment

ALT NE User Group: November 2023

My turn to do the hosting honours today, for the first time since before we had that pesky pandemic. My carefully planned agenda went completely out the window during the first item, but everything still managed to run pretty smoothly, and splurging the boss’s cash on the catering after getting the venue for free was a result, as the food was roundly praised.

We began with institutional updates from attendees. I thought as it was the first meeting of the year a quick round of updates would be good to have. I asked for one slide or five minutes each, got something like 17 slides from one bod, and this half hour item ran to well over an hour. But it was good, and I learned that we are all dealing with the problem of digital skills of staff and trying to make improvements there, and what the Blackboard and Anthology merger has done for AI in Blackboard. Staff now have access to an AI Design Assistant which will create entire course outlines and structures which serves as a great starting point. Middlesbrough College are trialing Microsoft’s Copilot tool in Bing, and have made it available to all staff and students, and Newcastle have seen a big increase in digital exams which are now at 40%.

After the roundup, I had one of my team do a demo of the Clevertouch boards we rolled out last year, then a learning design / content development showcase which provided an opportunity to share examples of best practice. In the afternoon we had a discussion on the role of ALT and where we sit within it, and a tour of Sunderland’s new anatomy suite. We have a new Anatomage table with a number of additional models, including some fine detail scans which have digitised certain features down to 0.1mm.

Leave a Comment

The End is Not Nigh


Pecuniam populo antepone

Yesterday I had the dubious pleasure of catching a bit of Rishi Sunak’s chat with Elon Musk about the future of AI, and it was dreadful. Absolutely no criticality whatsoever, Sunak just blindly accepted everyone Musk told him. This is something which bothers me so much that over the past few months I sort of accidently wrote 2,500 words on why the robots will not be taking over anytime soon, but instead of publishing it here I sent it on to the ALTC Blog for consideration, and it was published today – you can read it here. I should think of the ALTC Blog more often and try to get more of my ramblings published there, it’s been a while. They even gave me a badge.

Anyway, the short, short version is that no matter how impressive ChatGPT may seem, it’s not doing anything very new or revolutionary, and that particular kind of artificial intelligence has pretty much gone as far as it can. There is absolutely no path from where we are today to general artificial intelligence which can rival or surpass human intelligence. None. Whatsoever. The real threat of AI we should be worried about is how it is being used to displace and make precarious workers in certain industries to further increase the capture of wealth by the top 1%. This is one of the issues which SAG-AFTRA are striking on, specifically the practice of replacing background extras in film and TV with AI generated images. This is the time to be fighting back and supporting campaigns like this, because our politicians are certainty not up to the challenge, even if it does mean you have to wait an extra few months for Dune: Part 2.

ALRC Blog Contributor Digital Badge

Leave a Comment

UoS Learning and Teaching Conference 2023

Learning and Teaching Conference, 2023
The big boss up on stage, doing the introductions

Another out of this world conference this year, but alas nobody who was one degree of separation from walking on the moon this time, as our attention instead turned to… yes, you guessed it, generative artificial intelligence.

The morning keynote was given by Thomas Lancaster of Imperial College London who has done a lot of research over the years on contract cheating, and who has now turned his attention to the new AI tools which have appeared over the past year. Interestingly, he commented that essay mill sites are being pushed to students as much as they ever have, but I suspect that these agencies are now themselves using generative AI tools to displace already low paid workers in the developing world who were previously responsible for writing assignments on demand for Western students.

The first breakout session I attended was ‘Ontogeny: Mentoring students to succeed in a world of AI’ by Dr Thomas Butts and Alice Roberts who discussed how medical students are using GAI and the issues this is causing in terms of accuracy, as these models are often presenting wrong information as truth, which has particularly serious consequence in medicine. There was an interesting observation on culture and social skills, that students now seem to prefer accessing the internet for help and information rather than simply asking their teachers and peers.

The second session was ‘Enhancing the TNE student experience through international collaborative discussions and networking opportunities’ by Dr Jane Carr-Wilkinson and Dr Helen Driscoll who discussed the Office for Students’ plans to regulate TNE (trans-national education), though no-one quite seems to know how they are going to do this. Including the OfS. This was an interesting discussion which explored the extent of our TNE provision (I don’t think I had appreciated the scale before, over 7,000 students across 20 partners), and the issues involved in ensuring quality across the board.

There was also a student panel discussion who were asked about their use of GAI and understanding of the various issues surrounding plagiarism. They demonstrated quite a robust level of knowledge, with many of them saying that they are using ChatGPT as a study assistant to generate ideas, but I did groan to hear one person talk about the "plagiarism score" in Turnitin and how "20% plagiarism is a normal amount", and they don’t worry until it gets higher. The myths penetrate deep.

The final afternoon keynote was given by Dr Irene Glendinning of Coventry University who talked about her research on the factors which lead to plagiarism and cheating. This included a dense slide on various factors such as having the opportunity, thinking they won’t be detected, etc., but nowhere on there were cultural factors identified, and the way that higher education in the UK has been marketized over the recent past. I’ve certainly came across comments along the nature of, if students are paying £9,000 a year on tuition, why not just pay a few hundred more to make assessment easier or guarantee better results? But I’m noticing more and more that people don’t seem to be willing or able to challenge the underlying political decisions anymore.

Leave a Comment

ALT NE User Group: June 2023

A photo of Durham's lightboard in action
Durham University’s Lightboard, a very cool (but smudgy) piece of tech

Hosted by my lovely colleagues at Durham, this ALT North East meeting began with a discussion of the practice of video assessment. I talked through what we do at Sunderland using Canvas and Panopto, covering our best practice advice and talking through the things which can go wrong. The problem of a VLE having multiple tools for recording / storing video was one such headache shared by all of us, no matter what systems we are using.

We then moved on to a discussion about Turnitin, ChatGPT and AI detection, pretty much a standing item now. Dan shared with us a new tool he has come across, which I’m not going to name or share, which uses AI to autocomplete MCQs. A new front has emerged. Some bravery from Northumbria who must be one of the few HEIs to have opted in to Turnitin’s beta checker, and New College Durham are going all in on the benefits of generative writing to help staff manage their workload by, for example, creating lesson plans for them. A couple of interesting experiments to keep an eye on there.

After lunch we had demonstrations of various tools and toys in Durham’s Digital Playground Lab. This included a Lightboard. This is a really cool and simple piece of tech that lets presenters write on a transparent board between them and the camera using UV pens. I came across this a few years ago, before the pandemic I think, but it’s a strange beast. It’s not a commercial system, but open hardware, so anyone can build one for themselves at little cost. Unfortunately at Sunderland, and I suspect at many bureaucracies, this actually makes it a lot harder to get one than just being able to go to a supplier. So it never happened, but at least today I got to see one live.

Another bespoke system demonstrated was a strip of LED lights around the whiteboard controlled through a web app which allows students to discretely indicate their level of comprehension. We had a short tour of the Playground’s media recording room, watched some video recordings of content created in VR to, for example, show the interaction of the magnetic fields of objects, a demonstration of Visual PDE which is an open source web tool for demonstrating differential equations, and Kaptivo, a system for capturing the content of a whiteboard but not the presenter. You can see the Kaptivo camera in the background of my photo, behind the Lightboard.

Leave a Comment

Studiosity Partner Forum 2023

Studiosity usage at Sheffield
Photo of Sheffield’s Studiosity Dashboard

Attended the second Studiosity Partner Forum in London today, which had representatives from 14 UK HEIs out of the now 23 who are Studiosity users. The opening keynote was delivered by Rebecca Bunting, Vice Chancellor at the University of Bedfordshire, who talked about issues current in HE, with a focus on access and participation. She made good points on the limitations of students going to university, which includes not only things like entry requirements and location, but also what people are able to study once there and how the cost of living crisis is impacting choice. She talked about how this can impact on student retention, which HEIs are held accountable for, but there are often very good reason why students may have to leave their study. Finally, she talked about the concept of the “sticky campus” – keeping students on campus – which is something else universities are often held accountable for as a desirable thing, but which doesn’t work for students in their 30s or who have fulltime jobs, families, etc. Those students want, and need, to be on campus to do what they need for their studies and then get away again as soon as possible. At Bedfordshire, the majority of their students are over 30.

Next was a product update session from Isabelle Bristow, Studiosity’s Managing Director for the UK and Europe. The peer support service which was in early development last year will be available in July as ‘Student Connect’, in which third year students can mentor and guide first year students after training from Studiosity and the university. These mentors are paid at a rate set by the university, and all chat and calls are managed through Studiosity to ensure privacy and confidentiality. Unfortunately this isn’t something we will be able to explore at Sunderland, as we are continuing to keep Studiosity focused at IFY and new undergraduates. Isabelle also talked about a new Writing Feedback feature which will help students to identify where they have used higher order thinking skills – at least in part designed to counter and mitigate the use of generative AI writing.

Simon Reade and Matthew Hare from Sheffield Hallam University then presented on their data dashboard which uses data from the Studiosity API and other sources, and outputs to Tableau. One such chart, showing usage changes over a number of years, is shown (badly) in the photo above. This was a very interesting session for me, as we have just done this ourselves using Power BI. Some of their findings / experience felt very familiar – high usage in Health subjects, low in their Business, Technology and Engineering College (strange bedfellows, but our Business folks can also be hard to engage with new technology and interventions). Another observation they made was that Studiosity seems to hit more demographic groups than those which traditionally access support services, a good thing.

After lunch, Dr Andy Gould from SOAS talked about how they are responding to AI which led into an open discussion. Andy referenced Jisc, who in their response said that a crisis could be used as a driver for change, similar to what I and others said about the pandemic response. The problem is the sector seems to be in perma-crisis. They have co-created a student guide containing a list of ‘dos’ and ‘don’ts’ as best practice. Andy also talked about the idea of academics using ChatGPT to write student feedback, something students were very against, unsurprisingly, and finally noted that some students have reporting using a paraphrasing service I won’t name to try and ‘launder’ AI produced writing.

Other random points and observations made throughout the day in discussions with colleagues included a note from one institution that has seen Studiosity seemingly widen their participation gap, possibly as a result of higher achieving students engaging with the service to a greater extent. Much of our discussions were on the nature of students wanting to have a personal connection when it comes to seeking support, something Studiosity delivers well, and which may indicate strong use of the new Student Connect service when it goes live. Referencing was noted as by far the most in demand area for support, and again something that may draw them to peer support. Finally, there was a comment about how in some subject areas, such as engineering, students may not get any conventional written assignment until their 3rd year, with 1st and 2nd year assignments focusing on group work. This is an important point for me, and Sunderland, to be aware of as it may help to explain weak uptake in certain areas.

Leave a Comment

Using AI in Education: A Student Voice

Screenshot showing different results for weather in Egypt on Google and ChatGPT
Screenshot of a search query in Google and ChatGPT

A second session from the University of Kent on AI / ChatGPT, this time student-led. It was good to hear the student voice on these developments, and I found it reassuring that they are identifying the same issues and raising the same concerns as staff. More than one of the student presentations talked about how ChatGPT is already displacing Google and other search engines as the first place they are going to find answers. Like in the screenshot above, which shows the difference in results when searching for the temperature in Egypt from Google on the left, where you get a list of links to follow through, and ChatGPT on the right which provides a far more detailed answer in a written form. The problem is, as identified in one of the presentations but not the other, is that there is no way to verify the data which ChatGPT is presenting as truth. With the Google results you can evaluate the sources and verify against others; ChatGPT is a black box.

There was another good presentation from a student at Northumbria who has done some early research with students who have used ChatGPT to find out why and what they are using it for. The results being that they are mostly using it to check their own knowledge (problematic if you can’t trust ChatGPT to give you true answers), and to generate ideas. They are also using it outside of education to, for example, help write CVs and job applications. This makes me feel like we are always going to be on the defensive, reactive as one student said. While the education sector tries to grapple with the technology and debates banning it on one hand and thoughtful ethical use – while protecting academic integrity – on the other, other areas of society plough on regardless and heedless.

In another presentation a student talked about experimenting with ChatGPT to produce a response to one of their assignments and, echoing Margaret Bearman’s point from the teacher led session last month, they found that the result lacked critical analysis, and believe it would have been a clear fail.

I was pleased to note that ethical issues were being raised by students, though largely in the context of equitable access. With GPT 4 and priority access going behind a paywall, the students who can afford to use it will, and those who can’t will find they have another new and innovative way of being disadvantaged. How long before we see the first university or college purchasing a license for all of their staff and students?

Once again all of the presentations were recorded and are available as a YouTube playlist.

Leave a Comment

ALT North East User Group: March 2023

Various responses on Padlet showing our thoughts on AI. It's a tad negative.
A screenshot from Padlet showing our thoughts on generative AI. It’s a tad negative.

We’re getting back into a stride now, with the second meeting of the academic year at Teesside. After introductions and updates from each of the core university groups, Malcolm from Durham kicked us off with a conversation about Turnitin and how we all feel about it. From a survey of the room, most of us seem to be using it rather apathetically, or begrudgingly, with a few haters who would love to be able to do away with it, and no-one saying they actively like the service. Very revealing. So why do we all keep on using it? Because we all keep on using it. Turnitin’s database of student papers pulls like a black hole, and it will take a brave institution to quit the service now. Of note was that no-one really objected to the technology itself, especially originality reporting, but rather their corporate disposition and hegemonic business model.

Emma from Teesside then talked about their experience of being an Adobe Creative Campus, which involves making Adobe software available to all staff and students, and embedding it into the curriculum. Unfortunately, Emma and other Teesside colleagues noted the steep learning curve which was a barrier to use, and the fact that content had to sit on Adobe servers and was therefore under their control.

Next up was my partner in crime, Dan, reporting on Sunderland’s various efforts over the years to effectively gather student module feedback. This was a short presentation to stimulate a discussion and share practice. At Newcastle they have stopped all module evaluation, citing research on, for example, how female academics are rated lower than male. This has been replaced with an ‘informal check’ by lectures asking students how the module is going, are you happy, etc. They are being pushed to bring a formal system back due to NSS pressures, but are so far resisting. At Durham they are almost doing the opposite, with a dedicated team in their academic office who administer the process, check impact, and make sure that feedback is followed up on.

Finally after lunch, we had a big chat about that hot-button issue that has taken over our lives, the AI revolution! It was interesting for me to learn how Turnitin became so dominant back in the day (making it available to everyone as a trial, and getting us hooked…), and the parallels which can be drawn with their plans to roll out AI detection in the near future. Unlike their originality product which allows us to see the matches and present this to students as evidence of alleged plagiarism, we were concerned that their AI detection tool would be a black box, leaving wide open the possibility of false accusations of cheating with students having no recourse or defence. I don’t think I can share where I saw this exactly, but apparently Turnitin are saying that the tool has a false positive rate of around 1 in 100. That’s shocking, unbelievable.

No-one in the North East seems to be looking at trying to do silly things like ‘ban’ it, but some people at Durham, a somewhat conservation institution, are using it as a lever to regress to in-person, closed-book examination. Newcastle are implementing declarations in the form of cover sheets, asking students to self-certify if / how they have used AI writing.

There were good observations from colleagues that a) students are consistently way ahead of us, and are already sharing ways of avoiding possible detection on TikTok; and b) that whatever we do in higher education will ultimately be redundant, for as soon as students enter the real world they will use whatever tools are available in industry. Better that we teach students how to use such tools effectively and ethically in a safe environment. As you can see from the Padlet screenshot above, our sentiments on AI and ChatGPT were a tad negative.

Leave a Comment