With the invention of tools like ChatGPT, AI is increasingly getting smart and it is now hard to determine whether the text is written by a human or not.
The fact is that Google does not really like AI-generated content specifically that which is meant to manipulate Search Engines for rankings and not help people.
Fair enough, there are many reasons why you may want to avoid AI content or ‘make your content less AI‘
So, what next?
That is where an AI text detector comes in handy. AI text detector tools use AI to recognize whether the text was generated by a fellow AI.
This is what I like to call the ‘Battle of AI‘
As a blogger, I use AI detection tools from time to time to regulate the content submitted via my ‘Write For Us Page‘ since some contributors are just lazy and looking for backlinks. They end up generating content from tools like ChatGPT without making it helpful to my readers.
OriginalityAI reached out to me to try out their tool and I was given premium access to the tool. I had a hands-on test, tried things here and there, and came up with this review.
Being an A.I content detector is one thing, but can the accuracy of OriginalityAI be trusted?
To find out whether OriginalityAI, really lives up to its promises (of catching AI content) I used various tests with different datasets such as;
- Human written content
- AI-generated content
- Partly human and partly AI-generated text
- AI-generated content but paraphrased
- AI-generated content with added grammatical and punctuation errors.
What is Originality.AI?
Originality.ai is a content tool that checks your content for originality; i.e to ascertain whether it is human or A.I generated.
The tool doubles as both an AI content detector as well as a plagiarism checker additionally checking if any of your content was plagiarised.
OriginalityAI uses various algorithms and language processing techniques to scan content and give results as to the extent of AI detected in your content.
The scores from the results (which are shown in percentages) are a representation of Originality.AI‘s opinion on whether your content was written by a Human or Artificial Intelligence (AI).
For example, after scanning fully human-written text, the ideal results should be 100% for Originality and 0% for AI and vice versa.
As of late, the tool can effectively detect GPT-3, and GPT-3.5 content with a purported accuracy of up to 94%.
The scores might vary depending on what amount of text is detected as either original or AI and hence the percentages accorded will depend accordingly.
Now, let’s dive into the test!
Test #1 (Human Written Content)
To begin with, I wanted to find out what sort of results this tool can come up with human-generated content.
I took a portion of text from a post, on Why businesses need SEO that was written by a Guest contributor on this blog and tested it with OriginalityAI.
Results from the Scan (Human Written Text)
The tool returned a score of 88% originality. This means that the text was largely written by a human.
If you are to ask me, the score is pretty good.
But just like you, I wasn’t convinced yet and I needed to test further.
Let’s explore the next test as things get more complex.
Test #2 (A.I Generated Content)
In this test, I explored the extent to which this tool can detect text that has been purely generated by various A.I tools such as ChatGPT, and CopyAI.
Text from ChatGPT
For this test, I prompted ChatGPT to write me an intro for a blog post titled “SEO“
Results from the Scan (ChatGPT Text)
The result is accurate and the tool passed this check.
As if that was not enough, I went ahead to test another AI content generator tool, Copy AI.
Text from CopyAI
For this test, the tool performed terribly and it was blindsided by content from CopyAI.
Results from the Scan (CopyAI Text)
The tool failed this test. It could not detect text from CopyAI as ai generated.
Let’s proceed to the next step.
Test #3 (ChatGPT content edited and proofread by a Human)
I used an extract from one of my posts which is ranking well in the SERPs. This post was written by AI and edited by a human to fact-check and ensure that the article is useful to the reader.
It was generated by ChatGPT and improved to be meaningful.
I won’t be disclosing this one but the results were as follows.
From the results, OriginalityAI passed this test. It flagged the tool as largely AI.
Test #4 (A.I ChatGPT content but Paraphrased with Quillbot)
In this test, I used text from ChatGPT and paraphrased it with Quillbot one of the most powerful paraphrasing tools on the web to fool the tool.
I paraphrased with different modes such as Fluency, Standard to trick OriginalityAI and see what results it would come up with.
Results from the Scan (A.I ChatGPT content but Paraphrased with Quillbot)
OriginalityAI failed to detect text that was generated by ChatGPT but paraphrased via Quillbot. Test failed.
So, based on the results, I managed to trick OriginalityAI into thinking the paraphrased content was human-generated.
Test #5 (A.I ChatGPT text with grammatical and punctuation errors added)
A.I content detectors use various methods in detecting whether the text was generated by AI such as identifying certain structural or stylistic features that are distinct from human-written text, i.e., lack of grammatical errors or a more formulaic (uniform) language.
As I was making further research about OriginalityAI, I came across a user in a Reddit forum who said that ‘Adding punctuation and grammatical errors, generating text using complex prompts..” could make the output undetectable by an AI content detector.
In order to fool this tool, I decided to give it a try in this test. I generated text with ChatGPT-3 and scanned it. OriginalityAI flagged the content as 100% AI.
As you can see, OriginalityAI flagged the ChatGPT3 content as 100% AI.
After that, I threw in a few typos here and there, changed sentence construction, and flipped some punctuation as shown below.
Changes I made; I removed a comma after the word ‘searching’ in the first paragraph. In the second paragraph, I changed ‘personalized’ to personal and also removed the full stop on the closing sentence.
As you can see from the results, the tool was consistent and still returned detection of the content being AI-generated.
Frequently Asked Questions
How Does OriginalityAI Work?
Originality AI uses AI language processing to analyze content and determine whether it is AI-generated. The tool analyzes patterns, and construction of your text to establish whether it was generated by an AI tool such as ChatGPT.
Is there a free alternative to OriginalityAI?
Yes, there are various free OriginalityAI alternatives you can try such as Writer.com AI content detector, GLTR, Copyleaks,
How does Google detect AI content?
Google uses sophisticated algorithms to analyze your content and detect whether it is AI-generated. Honestly, there are no known disclosures on which software and how Google uses it to check the content.
Is Originality AI Accurate?
Originality AI is highly accurate (but not completely) in detecting AI content. The tool analyzes the language and structure of the content, to determine whether the content was written by AI or has any instances of plagiarism.
Workaguide Sum Up
OriginalityAI is a highly accurate tool that helps detect AI content and text. It detects content that is AI generated from tools like ChatGPT and returns scores in percentages. Although the tool is highly accurate (up to 94% accuracy), it can still be fooled by some tricks like paraphrasing.
- OriginalityAI is highly accurate but not completely.
- Results get more accurate where text is longer. 100 words or more
Hopefully, the tool will gain full momentum with time as the developers keep making it smarter. I think it will more reliable in the future.
So, is OriginalityAI worth purchasing?
My answer to the question is yes.
OriginalityAI can be used for free via a free trial of 50 credits if you download the Chrome extension.
The plans start at;
- $20 for 2000 credits.
- $50 for 5,000 credits.
- $100 for 10,000 credits.
- $250 for 25,000 credits
- $500 for 50,000 credits
1 credit costs $0.01. This, in essence, means 1 credit scans for 100 words.
The tool can help you catch most AI content, and the costs are also considerably fair. 1 scan for 100 words will cost you $0.01.
I hope you found this OriginalityAI review helpful.
If you think OriginalityAI is a good fit for you, purchase the tool here.