Tag: Turnitin

ALT NE User Group: June 2023

Published 9th June 2023

Durham University’s Lightboard, a very cool (but smudgy) piece of tech

Hosted by my lovely colleagues at Durham, this ALT North East meeting began with a discussion of the practice of video assessment. I talked through what we do at Sunderland using Canvas and Panopto, covering our best practice advice and talking through the things which can go wrong. The problem of a VLE having multiple tools for recording / storing video was one such headache shared by all of us, no matter what systems we are using.

We then moved on to a discussion about Turnitin, ChatGPT and AI detection, pretty much a standing item now. Dan shared with us a new tool he has come across, which I’m not going to name or share, which uses AI to autocomplete MCQs. A new front has emerged. Some bravery from Northumbria who must be one of the few HEIs to have opted in to Turnitin’s beta checker, and New College Durham are going all in on the benefits of generative writing to help staff manage their workload by, for example, creating lesson plans for them. A couple of interesting experiments to keep an eye on there.

After lunch we had demonstrations of various tools and toys in Durham’s Digital Playground Lab. This included a Lightboard. This is a really cool and simple piece of tech that lets presenters write on a transparent board between them and the camera using UV pens. I came across this a few years ago, before the pandemic I think, but it’s a strange beast. It’s not a commercial system, but open hardware, so anyone can build one for themselves at little cost. Unfortunately at Sunderland, and I suspect at many bureaucracies, this actually makes it a lot harder to get one than just being able to go to a supplier. So it never happened, but at least today I got to see one live.

Another bespoke system demonstrated was a strip of LED lights around the whiteboard controlled through a web app which allows students to discretely indicate their level of comprehension. We had a short tour of the Playground’s media recording room, watched some video recordings of content created in VR to, for example, show the interaction of the magnetic fields of objects, a demonstration of Visual PDE which is an open source web tool for demonstrating differential equations, and Kaptivo, a system for capturing the content of a whiteboard but not the presenter. You can see the Kaptivo camera in the background of my photo, behind the Lightboard.

Leave a Comment

ALT North East User Group: March 2023

Published 24th March 2023

A screenshot from Padlet showing our thoughts on generative AI. It’s a tad negative.

We’re getting back into a stride now, with the second meeting of the academic year at Teesside. After introductions and updates from each of the core university groups, Malcolm from Durham kicked us off with a conversation about Turnitin and how we all feel about it. From a survey of the room, most of us seem to be using it rather apathetically, or begrudgingly, with a few haters who would love to be able to do away with it, and no-one saying they actively like the service. Very revealing. So why do we all keep on using it? Because we all keep on using it. Turnitin’s database of student papers pulls like a black hole, and it will take a brave institution to quit the service now. Of note was that no-one really objected to the technology itself, especially originality reporting, but rather their corporate disposition and hegemonic business model.

Emma from Teesside then talked about their experience of being an Adobe Creative Campus, which involves making Adobe software available to all staff and students, and embedding it into the curriculum. Unfortunately, Emma and other Teesside colleagues noted the steep learning curve which was a barrier to use, and the fact that content had to sit on Adobe servers and was therefore under their control.

Next up was my partner in crime, Dan, reporting on Sunderland’s various efforts over the years to effectively gather student module feedback. This was a short presentation to stimulate a discussion and share practice. At Newcastle they have stopped all module evaluation, citing research on, for example, how female academics are rated lower than male. This has been replaced with an ‘informal check’ by lectures asking students how the module is going, are you happy, etc. They are being pushed to bring a formal system back due to NSS pressures, but are so far resisting. At Durham they are almost doing the opposite, with a dedicated team in their academic office who administer the process, check impact, and make sure that feedback is followed up on.

Finally after lunch, we had a big chat about that hot-button issue that has taken over our lives, the AI revolution! It was interesting for me to learn how Turnitin became so dominant back in the day (making it available to everyone as a trial, and getting us hooked…), and the parallels which can be drawn with their plans to roll out AI detection in the near future. Unlike their originality product which allows us to see the matches and present this to students as evidence of alleged plagiarism, we were concerned that their AI detection tool would be a black box, leaving wide open the possibility of false accusations of cheating with students having no recourse or defence. I don’t think I can share where I saw this exactly, but apparently Turnitin are saying that the tool has a false positive rate of around 1 in 100. That’s shocking, unbelievable.

No-one in the North East seems to be looking at trying to do silly things like ‘ban’ it, but some people at Durham, a somewhat conservation institution, are using it as a lever to regress to in-person, closed-book examination. Newcastle are implementing declarations in the form of cover sheets, asking students to self-certify if / how they have used AI writing.

There were good observations from colleagues that a) students are consistently way ahead of us, and are already sharing ways of avoiding possible detection on TikTok; and b) that whatever we do in higher education will ultimately be redundant, for as soon as students enter the real world they will use whatever tools are available in industry. Better that we teach students how to use such tools effectively and ethically in a safe environment. As you can see from the Padlet screenshot above, our sentiments on AI and ChatGPT were a tad negative.

Leave a Comment

Authorship Investigate Demo

Published 1st November 2019

Had another demonstration of Turnitin’s new Authorship Investigate tool today. This time they came to visit us for the benefit of our head of service.

Further to what I’ve written about this before, new features or things I’ve learned today includes the fact that this isn’t integrated into either the VLE or Turnitin’s Feedback Studio which we currently use, but rather is a standalone application that only nominated individuals would have access to. This would typically be people working in academic misconduct departments who could use Authorship Investigate as a tool to help their investigations. Turnitin are, however, working on a kind of early warning system that could be used to identify papers which have potentially been procured through contract cheating / essay mill services, similar to the existing similarity report. Academics could then ask for those papers to be investigated further. This is, however, some way off at this time.

Some new things Authorship Investigate can use in checking papers includes citation styles, font and text styles, and the language of the document, e.g. UK / US English, and whether or not this has been changed or doesn’t match previously submitted papers by the student in question.

Leave a Comment

ALT North East User Group – 2019

Published 12th April 2019

In a first, I didn’t just attend the meeting this time round, I hosted it at one of the University’s nicer enterprise suites at Hope Street Xchange. Working with Graeme and Julie who are the North East’s key contacts with ALT, I took care of the practicalities – venue, IT, parking, lunch – while they organised the agenda and speakers.

In the morning we had presentations from our regional Turnitin account manager who presented on their new Authorship Investigate tool which is designed to help detect instances of contract cheating, followed by a presentation and discussion from Jisc on changes to the EU’s Accessibility Regulations which we as an institution will need to respond to over the next year.

In the afternoon representatives from each institution attending gave a short presentation or talk about what interesting projects we have going on. I talked about using Trello with the team to better organise our workload, and the rollout of Panopto across the University which is now in full swing.

I’m pleased to be able to say it all went very well, with only one minor lunch hiccup which was quickly resolved. Hopefully this will be something we can do on a regular basis going forward.

Leave a Comment

Turnitin Academic Integrity Summit

Published 27th September 2018

Attended Turnitin’s annual conference which this year was largely devoted to the issue of contract cheating, students paying other people to write essays on their behalf. A problem which has been growing for some time, but which came to the fore in 2014 with the MyMaster scandal in Australia. They also had demonstrations of an imminent anonymous and moderated marking tool which looked great, and a new Code Similarity project which is a development of MOSS for checking computer code for similarity.

The new product they have to help with contract cheating is called Authorship Investigation and aims to try and detect cheating by comparing work submitted by a given student over a period of time, analysing such things as word and punctuation usage, richness of vocabulary, and document metadata – looking for obvious things such as an unusual author or editing time. The hands-on demonstration was quite good, especially for software still in beta and not due for release until next year. A number of us at the demonstration raised the same type of concerns though. For example, when I’m writing work I create a new document for every draft, and therefore the final file that I actually submit would show a same day creation date and very little editing time, both things that would be flagged up by Authorship Investigation as suspicious.

Also demonstrated was just how easy it is to get assignments from essay mills, and how predatory they are. A funny anecdote was about someone who was researching contract cheating. They started an online chat with someone from an essay mill site, who then proceeded to offer their services to write the paper for them!

This is a hard problem Turnitin are trying to solve, much harder than identifying blocks of text which have been copied and pasted from elsewhere, and most of us at the demonstration were a little skeptical about their approach. Of course, Turnitin is a technology company and they have devised a technological solution (to sell), when a better solution is arguably a pedagogic one, designing out the ability for students to outsource assessment work by moving away from essays and using approaches such as face-to-face presentations. Knowing your students and their work personally is also likely to be better than relying on algorithms, but of course this is much easier with smaller cohorts.

There was also very little discussion about the context of this, and what has caused the issue to arise. In most of the West we have commodified tertiary education, turning it into just another product that’s available for anyone who can afford it, so is it any wonder that those with the means take the next step? Nevertheless, this is the world we find ourselves in and essay mills aren’t going to go away. Calls to legislate against them, as worthy as that may be, will have the same problems as trying to prohibit any online content in that it can only apply to UK based companies, and while technological solutions may help in the short term, they are no panacea as methods to circumvent them will soon appear in what is an ever escalating arms race.

Leave a Comment

Turnitin UK User Summit

Published 6th October 2016

Attended the afternoon sessions of Turnitin’s UK user summit which focused on customer experience, with talks from colleagues at the University of Edinburgh, the University of East London, Newcastle University and the University of Huddersfield. It’s always cathartic to hear your colleagues sharing their tales of woe and horror which are so familiar in your own work, like the academics who insist on treating the originality score as sacrosanct when making a plagiarism decision, but more productively there were some really good ideas and pieces of best practice shared. One colleague was using Blackboard’s adaptive release function to hide the Turnitin assignment submission link until students had completed a ‘quiz’ which was simply making them acknowledge in writing that they work they were about to submit was all their own. A couple of people presented their research findings on what students wanted from feedback, such as in the attached photo which shows a clear preference for electronic feedback. Someone made a product development suggestion, splitting the release of the grade and feedback in Turnitin so that students have to engage with their feedback before they get their grade. But I think my personal highlight from the day was the very diplomatic description of difficult customers as those who have ‘higher than average expectations’.

Though I missed out on the morning session due to another commitment, I was able to get the gist from networking with colleagues in-between sessions. Improvements to the Feedback Studio including the ability to embed links, multiple file upload, a new user portal which will show the most recent cases raised by people at your institution, and the development I found most interesting, the ability to identify ghost written assignments. This is still quite away from being ready, but it’s an increasing problem and one Turnitin has in their sights. They couldn’t reveal too much about how this will work for obvious reasons, but the gist is that they will attempt to build up a profile of the writing style of individuals so that they can flag up papers which seem to be written differently.

The Twitter conversation from the summit is available from the TurnitinUKSummit hashtag, where you will see I won the Top Tweet! Yay me, but alas there were no prizes.

Leave a Comment

Canvas Demonstration

Published 29th January 2016

Had a live demonstration of Instructure’s Canvas from an old Northumbria colleague, who is now at the University of Hull where they have just rolled out Canvas as their new VLE. It looks like a different generation system compared with what we’re using at Sunderland at the moment, LearningStudio, and the technical and customer support Hull has received has been second to none. For example, they are using PebblePad as their ePortfolio solution and Instructure built an LTI integration to link the two systems within days, free of charge. Other available integrations are extensive, and includes Mahara and Turnitin. The ‘Commons’ feature looks very nice, it allows people to easily import and publish courses from a central Canvas repository – it could be a good way to finally get some traction on OER use.

Other nice features include a central ‘Files’ area that allows content to be reused across different course sites; the ability to publish calendars to Google Calendar, Exchange and other calendar services; an online marking system provided by Crocodoc (which Blackboard added a couple of years ago); a fully functional student view mode; the ability to record audio and video from anywhere that uses the virtual text-box editor; a quiz tool with 12 questions types, including an equation editor; and a user masquerade function which works as well as Mahara’s.

There are some issues with it as well, of course. There is currently no SITS integration which is going to cause them problems if they want to gain some serious market penetration in the UK, but I am told they are working on this with Tribal. There is also no built-in conferencing or whiteboard tool, but there are integrations available for BigBlueButton and, I believe, Blackboard Collaborate which is what we currently use through LearningStudio. Mobile access was disappointing, as they have taken an apps approach rather than responsive design. There are three different apps available for iOS and Android devices which serve different functions, one of which is for audience response, which is nice. Support for SCORM and Storyline is a potential issue as they have had problems with it at Hull that we would need to investigate further. There is no integration for Medial (Helix) at the moment, though Medial do seem to be gauging the market in preparation for working on one. Finally there is cost, which, for obvious reasons I can’t say too much about. But it is more than LearningStudio. A lot more.

Overall the demonstration and discussion was a very positive experience. Hull are the latest UK institution to adopt Canvas, joining five others, so Intructure are gaining some traction here. In the US they’re storming the market! Check out the latest market share report from Edutechnica.

Leave a Comment

Turnitin LTI and Case Studies

Published 18th May 2015

One of the big projects I picked up last year when I started at Sunderland was the team’s development of a new way of accessing Turnitin through SunSpace. Following the successful implementation of the LTI earlier this year I wrote a case study about our experience which has now been published to our website.

This is the first of what I hope will be many case studies sharing our experience for the benefit of others and publicising the good work we do.

Leave a Comment

Quick Start Guides for Staff

Published 31st October 2014

In conversation with a colleague in Academic Development about how to target new starters and make them aware of all the fabulous tools and services we have to offer, we came up with the idea of having short, one-page ‘quick start’ guides for each of our core tools which would provide an introduction, explain what it was and how it could help, how to access and where to find more detailed information. I wrote the ones on Equella, Turnitin and ClassLive (Blackboard Collaborate) myself, and edited the others to a greater or lesser extent to make the style and content match across the range.

https://my.sunderland.ac.uk/display/sunspace/Quick+Start+Guides+for+Staff

Leave a Comment

Mahara Upgrade

Published 6th October 2014

I feel like I don’t post as much as I used to, and part of the reason why is because a lot of my work is now either collaborative or of a project management nature. The new version of Mahara is a case in point. The old version was 1.4, a three year old release, and hadn’t been updated since. A project to upgrade or install a new version had begun before I started which became one for me to push through. The new version, set up as a completely new system because the database on the old one was Postgres and we couldn’t easily migrate it to MySQL, is now available thanks to a team effort from many people in WaLTS and IT Services. Now there is just the small matter of manually exporting 8,000 user accounts to the new one. That’ll keep us busy for a while.

Another good piece of work I have been involved in is the imminent deployment of a new integration of Turnitin, another stalled project which I had picked up, which included writing a fairly comprehensive report for our service director who had her doubts. We just need to do some final quality assurance testing on this and write some new help guides for staff and students and then it will be good to release.

Leave a Comment