OpenAI shutters AI detector due to low accuracy
1 min readArtificial intelligence powerhouse OpenAI has discreetly pulled the pin on its AI-detection software citing a low rate of accuracy.
The OpenAI-developed AI classifier was first launched on Jan. 31, and aimed to aid users, such as teachers and professors, in distinguishing human-written text from AI-generated text.
However, per the original
The classifier is the latest of OpenAI’s products to come under scrutiny.
On July 18, researchers from Stanford and UC Berkeley published a study which revealed that OpenAI’s flagship product ChatGPT was getting significantly worse with age.
We evaluated #ChatGPT‘s behavior over time and found substantial diffs in its responses to the *same questions* between the June version of GPT4 and GPT3.5 and the March versions. The newer versions got worse on some tasks. w/ Lingjiao Chen @matei_zaharia https://t.co/TGeN4T18Fd https://t.co/36mjnejERy pic.twitter.com/FEiqrUVbg6
— James Zou (@james_y_zou) July 19, 2023
Researchers found that over the course of the last few months, ChatGPT-4’s ability to accurately identify prime numbers had plummeted from 97.6% to just 2.4%. Additionally, both ChatGPT-3.5 and ChatGPT-4 witnessed a significant decline in being able to generate new lines of code.
AI Eye: AI’s trained on AI content go MAD, is Threads a loss leader for AI data?