A Big Picture Look at AI Detection Tools

Teaching in Higher Ed

Christopher Ostro shares a big picture look at AI detection tools on episode 555 of the Teaching in Higher Ed podcast.

Quotes from the episode

I think there are tons of students I interact with who are really just curious and trying to use these tools to dig deeper.
-Christopher Ostro

I want them getting practice on these things that are going to be part of their future careers and lives. I love that my classroom is a stage for that.
-Christopher Ostro

I think AI detection has a place, but its place is limited. I don’t think it should ever be the sole reason a student is getting honor coded.
-Christopher Ostro

I love to tell my students if all you’re doing with these tools is taking the output and submitting as your own work, you don’t have a job.
-Christopher Ostro

Resources

• Video: AI Detection: A Literature Review with Christopher Ostro
• Slides: AI Detection: A Literature Review
• University of Colorado Boulder Learning Design Group
• Video: Student Use of AI: A Panel Dialogue
• GPTZero, TurnItIn AI Detector, Writer.AI
• Can linguists distinguish between ChatGPT/AI and human writing?: A study of research ethics and academic publishing, by J. Elliott Casal & Matt Kessler
• A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study, by Peter Scarfe, Kelly Watcham, and Alasdair Clarke
• Simple techniques to bypass GenAI text detectors: implications for inclusive education, by Mike Perkins et al
• Can AI-Generated Text be Reliably Detected? by Vinu Sankar Sadasivan et al
• Testing of detection tools for AI-generated text, by Debora Weber-Wulff et al
• GPT detectors are biased against non-native English writers, by Weixin Liang et al
• Detecting ChatGPT-generated essays in a large-scale writing assessment: Is there a bias against non-native English speakers? by Yang Jiang et al
• Kaggle competition 2023 – 2024
• h/t to Janae Cohn who shared the article on LinkedIn and posted some additional reflective questions we might ask, as we refuse GenAI in writing studies
• Refusing GenAI in Writing Studies: A Quickstart Guide, by Jennifer Sano-Franchini, West Virginia University; Megan McIntyre, University of Arkansas;Maggie Fernandes, University of Arkansas
• Maha Bali’s writing on AI (and other topics)
• A Man on the Inside
• Daytripper (DC Comics)