Skip to main content

Here’s how ChatGPT could solve its major plagiarism problem

ChatGPT is a wonderful tool but there’s a dark side to this advanced AI service that can write like an expert on almost any topic — plagiarism. When students that are supposed to be demonstrating their knowledge and understanding of a topic cheat by secretly using ChatGPT, it invalidates testing and grading. AI skills are great but aren’t the only subject that students should learn.

Policing this problem has proven to be difficult. Since ChatGPT has been trained on a vast dataset of human writing, it’s nearly impossible for an instructor to identify whether an essay was created by a student or a machine. Several tools have been created that attempt to recognize AI-generated writing, but the accuracy was too low to be useful.

Amidst rising concerns from educators and bans on students using ChatGPT, Business Insider reports that OpenAI is working on a solution to this problem. A recent tweet from Tom Goldstein, Associate Professor of machine learning at the University of Maryland, explained how accurate it might be at detecting watermarked text that’s written by ChatGPT.

#OpenAI is planning to stop #ChatGPT users from making social media bots and cheating on homework by "watermarking" outputs. How well could this really work? Here's just 23 words from a 1.3B parameter watermarked LLM. We detected it with 99.999999999994% confidence. Here's how 🧵 pic.twitter.com/pVC9M3qPyQ

— Tom Goldstein (@tomgoldsteincs) January 25, 2023

Any tool that could identify plagiarism with nearly 100% accuracy would settle this discussion quickly and alleviate any concerns. According to Goldstein, one solution is to make the large language model (LLM) pick from a limited vocabulary of words, forming a whitelist that is okay for the AI to use and a blacklist of words that are forbidden. If an unnaturally large number of whitelist words show up in a sample, that would suggest it was generated by the AI.

This simplistic approach would be too restrictive since it’s hard to predict which words might be necessary for a discussion when working one word at a time, as most LLMs do. Goldstein suggests that ChatGPT could be given the ability to look ahead further than one word so it can plan a sentence that can be filled with whitelisted words while still making sense.

ChatGPT made a big splash when it entered the community writing pool and can be a great teaching aide as well. It’s important to introduce artificial intelligence in schools since it will clearly be an important technology to understand in the future, but it will continue to be controversial until the issue of plagiarism is addressed.

Editors' Recommendations

Alan Truly
Computing Writer
Alan is a Computing Writer living in Nova Scotia, Canada. A tech-enthusiast since his youth, Alan stays current on what is…
Google might finally have an answer to Chat GPT-4
ChatGPT versus Google on smartphones.

Google has announced the launch of its most extensive artificial intelligence model, Gemini, and it features three versions: Gemini Ultra, the largest and most capable; Gemini Pro, which is versatile across various tasks; and Gemini Nano, designed for specific tasks and mobile devices. The plan is to license Gemini to customers through Google Cloud for use in their applications, in a challenge to OpenAI's ChatGPT.

Gemini Ultra excels in massive multitask language understanding, outperforming human experts across subjects like math, physics, history, law, medicine, and ethics. It's expected to power Google products like Bard chatbot and Search Generative Experience. Google aims to monetize AI and plans to offer Gemini Pro through its cloud services.

Read more
This app just got me excited for the future of AI on Macs
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

In a year where virtually every tech company in existence is talking about AI, Apple has been silent. That doesn't mean Apple-focused developers aren't taking matters into their own hands, though. An update to the the popular Mac writing app iA Writer just made me really excited about seeing what Apple's eventual take on AI will be.

In the iA Writer 7 update, you’ll be able to use text generated by ChatGPT as a starting point for your own words. The idea is that you get ideas from ChatGPT, then tweak its output by adding your distinct flavor to the text, making it your own in the process. Most apps that use generative AI do so in a way that basically hands the reins over to the artificial intelligence, such as an email client that writes messages for you or a collaboration tool that summarizes your meetings.

Read more
One year ago, ChatGPT started a revolution
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

Exactly one year ago, OpenAI put a simple little web app online called ChatGPT. It wasn't the first publicly available AI chatbot on the internet, and it also wasn't the first large language model. But over the following few months, it would grow into one of the biggest tech phenomenons in recent memory.

Thanks to how precise and natural its language abilities were, people were quick to shout that the sky was falling and that sentient artificial intelligence had arrived to consume us all. Or, the opposite side, which puts its hope for humanity within the walls of OpenAI. The debate between these polar extremes has continued to rage up until today, punctuated by the drama at OpenAI and the series of conspiracy theories that have been proposed as an explanation.

Read more