Deep Fake Detector Extension by Mozilla Firefox
28 comments
·February 8, 2025numpad0
blah2244
I've heard of a startup that claims to be able to achieve a near-0% false positive rate: https://www.pangram.com/our-model/how-it-works
They appear to basically RLHF a model on a bunch of examples of human/AI output on the same prompt. Not sure how well it works, but I'm guessing Mozilla is doing something similar here.
saretup
Anyone can get a 0% false positive by always inferring negative. What you wanna look at is the precision-recall curve.
Blahah
Oof what a silly naming decision. Deepfake already has an established coherent meaning - it's specifically about impersonation with video/audio/images. Just writing in collaboration with a tool is not deep or fake necessarily.
toasteros
I'm cool with using the word Deepfake for text. Generated text should generally be referred to in the derogatory, considering it very rarely adds anything of value.
Hizonner
So you're cool with using just any words to describe just anything, so long as the vibe is right. Great. I'm sure that'll help a lot with everybody's understanding of the world.
superb_dev
It's more than vibes. Generated text is certainly fake, and it's "deep" in the same way that generated voice/video is.
toasteros
I guess you're right, "garbage" would be a better term, but this appropriately places it in the right category.
asynchronousx
Agreed, although trying to name things in modern tech is like playing minesweeper but the board changes every round.
See Lora vs LoRA and many others.
daveguy
Well, as long as it's not as unreliable as LLMs.
Hizonner
Mozilla continues to do anything and everything but work on the damned browser.
ivewonyoung
Sounds like a company version of ADHD.
jsheard
That's the first time I've seen "deepfake" used to refer to generated text, isn't that term usually used for generated imagery/audio which is passed off as real?
loeg
Not necessarily passed off as real, but otherwise yes.
Insanity
I had the same reaction - but I guess images was just the first obvious application of fakes. ai text is similarly fake in the same vain
Hizonner
No, text is not fake in the same vein. The whole point of deepfakes is that they're images of real people in situations they were not in. Unless you're actively claiming that some victim wrote the text, it's not similar.
daveguy
Elon should definitely pass a law that "deep fake" can't be used to refer to text. Otherwise what's he going to do with twitter?
elashri
Seems interesting. Also there should be mention that this works for English text only somewhere. Non-English text is not supported. Also If I open the extension and try non-English text, then the "x" button for that page won't close the extension sidebar.
edit: It is even worse, if I'm visiting non-English page then the extension sidebar will be loaded and you cannot close it. You can't control this behavior. This is not a problem with English pages.
pogue
Is this new? I tried searching for news or information about this extension, but all I can find is their page about it on Fakespot.
They also published an AI image detection addon (marked as experimental) in 2022 although I have no idea if it still works.
https://addons.mozilla.org/en-US/firefox/addon/deepfake-dete...
null
boomboomsubban
The version history goes back to October, wayback agrees with that.
DeepYogurt
Very interesting tool. Please rename to `AI Slop Detector` or similar.
dgeiser13
Google appeared to have picked it up on addons.mozilla.org around Nov 22, 2024.
Retr0id
Does anyone use this? How accurate is it?
dhdjruf
>People should be careful with these extensions. It's one thing if they have a GitHub or GitLab repo, where people can easily check out the source, developer history, or any issues presented. It's another thing when that's not the case. Many of its reviews are not promising either.
Someguy posted this immediately deleted his post. It only had a 62% chance of being human. Comical because the ai didn't realize that the Dev is mozilla.
dhdjruf
Can't the ai use this tool and keep rewriting its text untill it passes?
viraptor
Yes, this is a lost battle. Ask for a specific way of writing to defeat most existing system. Gain access to the review system to defeat them entirely.
methou
I lost faith in this company, Mozilla has been distracted by chasing hypes, taking money from a major competitor, dropped servo development, the list goes on and on. I had to kagi for "Mozilla Foundation" NPO to confirm that it's still a nonprofit.
In today's view, I'm looking at a Ad Company depends on Google happens to own a browser. This contradicts one of it's main sale point: diversifying the browser market. For me what's left for Firefox is just uB0 support.
There's no remorse in switching to and strongly soliciting Firefox forks like LibreWolf or Waterfox.
Don't most AI either incorporate or surpass GAN architecture, making good software detector impossible to build?
If I understand right, GAN is a co-trained AI similar in size to main AI that discriminate and identify generated AI data apart from sample human data. When the main AI has gotten so good that GAN becomes a dice roll, training is considered finished.
Human brains are completely different implementation and nothing is stopping us from instantly spotting AI, at least for now, but computers shouldn't be able to. Isn't that the case?