AI in Higher Ed

Testing of Detection Tools for AI-Generated Text
Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching for solutions to detect such content. The paper examines the general functionality of detection tools for artificial intelligence generated text and evaluates them based on accuracy and error type analysis. Specifically, the study seeks to answer research questions about whether existing detection tools can reliably differentiate between human-written text and ChatGPT-generated text, and whether machine translation and content obfuscation techniques affect the detection of AI-generated text. The research covers 12 publicly available tools and two commercial systems (Turnitin and PlagiarismCheck) that are widely used in the academic setting. The researchers conclude that the available detection tools are neither accurate nor reliable and have a main bias towards classifying the output as human-written rather than detecting AI-generated text. Furthermore, content obfuscation techniques significantly worsen the performance of tools. The study makes several significant contributions. First, it summarises up-to-date similar scientific and non-scientific efforts in the field. Second, it presents the result of one of the most comprehensive tests conducted so far, based on a rigorous research methodology, an original document set, and a broad coverage of tools. Third, it discusses the implications and drawbacks of using detection tools for AI-generated text in academic settings.
Original link
Content Credentials
Introducing the new standard for content authentication. Content Credentials provide deeper transparency into how content was created or edited.
Original link
Promoting Academic Integrity in Light of Generative AI | Concordia University
Zoom is the leader in modern enterprise video communications, with an easy, reliable cloud platform for video and audio conferencing, chat, and webinars across mobile, desktop, and room systems. Zoom Rooms is the original software-based conference room solution used around the world in board, conference, huddle, and training rooms, as well as executive offices and classrooms. Founded in 2011, Zoom helps businesses and organizations bring their teams together in a frictionless environment to get more done. Zoom is a publicly traded company headquartered in San Jose, CA.
Original link
Guidance on AI Detection and Why We’re Disabling Turnitin’s AI Detector | Vanderbilt University
In April of this year, Turnitin released an update to their product that reviewed submitted papers and presented their determination of how much of a paper was written by AI. As we outlined at that time, many people had important concerns and questions about this new tool, namely how the product exactly works and how...
Original link

Using AI Detectors: Tools and Considerations

| John Abbott Office of Pedagogy and Innovation
A Dawson College PPT on AI Detection
BRIAN REDEKOPP JULY 2023 CAN WE RELIABLY DETECT AI-GENERATED TEXT? The conclusion is no, we cannot.
OpenAI just admitted it can't identify AI-generated text. That's bad for the internet and it could be really bad for AI models.
In January, OpenAI launched a system for identifying AI-generated text. This month, the company scrapped it.
Original link
Don’t Rely On AI Plagiarism Detection Tools, Warns OpenAI CEO Sam Altman
OpenAI CEO Issues Warning Against Relying on AI Plagiarism Detection
Original link