The demo screenshot/page seems to only show NSFW images, so the demo doesn't convey how quickly this classifier can operate. The demo page should have some non-NSFW images to show off how quickly SFW images are revealed, since the default is to block all images.
One day someone will release the ‘detect and block anything resembling kpop’ extension for Twitter and I’ll be happy.
What are you there for, then?
I started doing the same with md5 hash filtering but it was very slow going, an AI that can detect low quality posts and filter them out is the holy grail I guess
Not only kpop, but entire "fandoms" as a whole. When that software finally arrives, I want to be able to refer back to this comment and say I read it here first.
I guess I had developed a kind of builtin ad filter into my brain, from ignoring so many ads over the years.
Thankfully, my place of work had reasonable people working there. But I think if I worked somewhere more strict even that one ad might have prompted a conversation with HR. Nonetheless, I promptly installed an ad-blocker on the browser in case any ads would be shown in the future that would have been more explicit than the one that had been showing this time.
https://github.com/nmurray1984/porn-blocker-chrome-extension
I found that the hardest problem to solve was the prevanlence of false positives. Even if you have a low false positive rate, it's still very likely to have an image blocked regularly just due to volume.
For that reason, the focus of my plugin is - for users that are OK with it - contributing URLs that are not NSFW but have been blocked. The extension includes a right-click menu option to do so.
Once an image tested positive with your first model, you could run a second more CPU intensive model (but also more accurate) on it.
What I really do care about is not seeing worthless clickbait. That makes me endlessly angry. Could you build a filter like that on top of this?
Because I live stream and people try to trick me into viewing NSFW content on stream.
Is this really a question?
The issue with NSFW images is not you seeing it on your own computer, it is other people seeing it on your computer (e.g. while walking by or for some other reason).
Great work with TensorFlow by the way, can't wait to see this technology maturing over the years.
You leave your laptop unlocked and suddenly it looks like the nude bomb went off (https://m.imdb.com/title/tt0081249/).
Would it be feasible to run the model in wasm or in the GPU?
Its the training that takes forever, due to the fact all those numbers need tweaking. However one you have the model, classifying is pretty fast.
So I decided to move the inference to the server.
It's fast but I didn't toy with GPU setting when running Tensorflow model on JS.
So seems this extension is not really for your use case but for others.
Most companies big enough to do this already have their own internal CA installed on all the machines, for internal sites, so they use that same CA to sign the mitm cert. With so many sites using HSTS it can be annoying if you access a site while off the network.
As far as them knowing the content of a particular image they would need to have some kind of machine learning like this extension.
The classifier lib:
https://github.com/alex000kim/nsfw_data_scraper
Announcement points to this data source (while the readme hints at a "premium" classifier):
Just to expand: there are many excellent films which are not "family friendly" only because of 1 or 2 nude scenes which aren't even germane to the overall plot in many cases. I often wished there was a tool or SaaS that could detect such scenes and cut or blur them out. Would save a lot of manual processing.
My favorite thing is that they had a JarJar filter for the Star Wars prequels.
Crowdsourcing such metadata would be a good start, although it can be subjective.
If you find out a better way for streaming media, please share.
Will flag sections of the video with explicit / suggestive / partial nudity
[1] https://en.m.wikipedia.org/wiki/CleanFlicks
Vid Angel took a different approach, allowing you to fast forward over parts, and appears to still be operating: https://www.vidangel.com/
They had an ever expanding catalog of films they had processed to avoid any nudity or bad language. I think they cut those parts out entirety.
Here I found it.
They got sued out of existence apparently by the movies studios but was recreated and they now somehow do it with streaming content from Netflix or HBO.
I dont know how they do that but I figure they will be sued again.
I am not endorsing the company. I have never used it and never will but it is out there.
Surely a much easier thing to do would be to simply stop being offended by the human body? Just watch the movies anyway. Your kids won't explode if they see a boob.
This reminds me of when I went thru all different low calorie sweeteners to put in coffee until I realized this is a problem I created myself and coffee is actually better if I just get used to having it plain.
There’s a whole genre of family friendly films, those will serve you better than trying to hack up stories for full adults.
Expansion: how are nude scenes not family friendly? Not trying to start any flame wars here, just trying to understand how one or two scenes with nudity suddenly means the video is not family friendly? We all go through life seeing nudity, so should be fine. Violence however is something we both strive and should avoid as much as possible.
The answer is "American Prudery".
It is indeed hard for me to understand how someone can feel uncomfortable seeing nudity, as it's everywhere in life and always has been.
One film I think of in this regard is Schindler's List. I've seen both the original and the TV edit that Spielberg made to broadcast for teenagers to see. The primary edits I noticed were sex scenes and post-sex nudity. Those scenes weren't gratuitous(they showed something about the characters) or anything, but were edited(either cut or blacked out part of the frame). BUT there was still lots of nudity in the edited film. This was nudity of a different nature. People forced to strip down and paraded in the open for inspection.
Sometimes parents just want to take the easy path and consider all nudity as out of bounds for their kids. I think that's fine.
Sometimes parents consider vaccinations to be out of bounds for their kids, too.
Actually I think a lot of people find it awkward to watch graphic sex scenes and extended nudity with their family. As a grown up, the I feel awkward watching parts of game of thrones with my parents.
That's a shame because I would like to watch this show with them. Lately a lot of major TV shows seem to aim to include one nude scene per episode - I guess the money people think that's what sells...
I can understand why some people might find violence equally difficult, but where it features it tends to be much more tied to the plot.
If this taboo wouldn’t have existed for you as a kid I’m not so sure the awkwardness would exist for you as an adult. As a sample size of 1, coming from a country where there is much less of a taboo I feel very differently on this topic.
However, you'll probably also be sued into oblivion by angry authors/publishers who don't like people modifying what they read in any way.
Some of my CX team is getting harassed by trolls who send profane messages and racial slurs through the Zendesk Chat interface. Zendesk does not have a way to filter out profanity (for Chat at least; there are options for emails or tickets).
I’ve found simple client side extensions that can censor words, but a better approach would use NLP to grasp the context.
“I hope you die” contains the same words as “My <product> got wet, I hope it didn’t die”, but with vastly different intention.
--
[1] https://jigsaw.google.com/issues/
[2] for example https://boingboing.net/2019/08/14/white-aligned-english.html
Edit: to clarify, I'm not afraid of some killing either, thanks to the pop culture of the past seventy years or so. Now, why eye-hurting images of bodily damage pop up on rather innocent searches—that's a haunting mystery. On Reddit, the ‘NSFW’ label is used equally for a vaguely sexually suggestive shape or a close-up more suitable for a surgical journal. As if I didn't get plenty of suggestiveness just from music videos anyway! So my long-standing wish was for an ‘NSFL’ filter instead.
Sex is part of human nature – and, I would argue, a much bigger and better part of it than violence and aggression. Why do we hide from it?
Many people say they are negatively affected by porn addiction (whether consumers, or partners of consumers, or parents, or people who feel objectified, even some people in the industry), and they feel strongly about it. Just because sex is a good part of human nature doesn't invalidate that in their eyes. In fact, it is precisely because some consider sex to be good and precious that they want to be much more careful about viewing it or depicting it, and I agree with that.
The number of societies that don't want censored sexuality is near zero. It is not just "some societies". And there are plenty of societies that desire that more than western ones.
In many cases sex is the direct cause of much sorrow, misery, and emotional damage. Maybe your partner cheated on you. Maybe you got pregnant and your partner left. Maybe alcohol was involved. Maybe you are lonely and got addicted to pornography. Maybe you didn't use contraceptives and are now seeking (or went and got) an abortion. If you look around in poor communities, you'll find a big source of poverty is... unprotected sex. It turns out, you can pretty much ruin your life as a teenager and guarantee you'll stay in poverty your whole life if you get pregnant and have a baby while you are in middle school/high school.
Unlike war and murder, sex is something most people will participate in (in some form or another). So I would argue that it's more important than ever to consider the types of sexual messages we send in media. Do we want to promote sexual relationships between committed partners or do we want to promote wanton promiscuity? I would argue that whichever you choose will have an impact on some non-negligible % of the future choices of the viewers. To be clear, I think we also need to be careful of depictions of extreme gore/violence as well, but for slightly different reasons.
In general, I'm of the opinion that implicit > explicit for both sex and violence in media, but perhaps there is a time/place for being explicit (i.e. so people understand what really happened during the Holocaust, etc).
Has anyone tested to see if it correctly handles PoC? That demo site it points to almost exclusively light skinned folk.
These are the basic things I’d want confirmation of.