Deep Learning on Title and Content Features to Tackle Clickbait (opens in new tab)

I'm not sure that quite addresses the problem here.

After all there is no clear definition of 'what dogs look like' (in the sense of a collection of logical rules), but deep learning models excel at detecting them, when provided with enough positive examples.

If it's possible for humans to agree on whether a given article is clickbait or not, we should be able to put together an adequate dataset for training a system to classify them too. From the linked article I am unable to discern how the training dataset was labelled.

In other words, the fact that 'clickbait' is a nebulous concept shouldn't preclude machine learning from being able to detect it.

The core of the definition is subtly wrapped in "main purpose" -- once the attention is attracted and the link is clicked, the clickbait's job is done. So the content of the article will be lower quality and less intellectually satisfying than non-clickbait articles.

For example, if you charted "interest on clicking this link text" vs "satisfaction with article after reading", I think clickbait would be clearly in the high interest vs low satisfaction quadrant.

In 2014, Jon Stewart offered an interesting definition of clickbait:

"I scroll around, but when I look at the internet, I feel the same as when I’m walking through Coney Island. It’s like carnival barkers, and they all sit out there and go, 'Come on in here and see a three-legged man!' So you walk in and it’s a guy with a crutch."

The thing is, he was talking about BuzzFeed when he said that, and that is not what BuzzFeed does at all. BuzzFeed's editor wrote about the distinction here, and it's the most insightful article I've read on the topic:

https://www.buzzfeed.com/bensmith/why-buzzfeed-doesnt-do-cli...

People tend to consider things like lists clickbait, even though those articles usually deliver exactly what the headline suggests. (If you click on "23 photos of kittens that are just too adorable," that is what you will get.) But because it's an article that was made specifically to get traffic, people incorrectly call it clickbait.

And it often goes even further than that. On Reddit and Hacker News, commenters constantly call articles clickbait. Sometimes it's true, and there's a sensational headline that leads to a bullshit story. But just as often, the story delivers on what the headline promises, but commenters call it clickbait because the headline is slightly hyperbolic, snappy, or just plain well-written.

I would define clickbait as articles which intentionally try to disguise what you'll get out of reading them. The information is banal, but the headline makes it out to be revolutionary or shocking.

You might disagree with the details of the formulation, but I think there's pretty broad agreement that something similar is going on with clickbait.

I guess it's an inherently fuzzy concept, so quite a good fit for machine learning.

But my definition of clickbait is any link I follow where I feel like I've been tricked into the click. The link looked interesting, but I feel regret once I see the actual content.

A definition would need a bit more fleshing out, mostly about the (lack of) actual content; a long-winded page (not just text) that eventually leads to the core, which could be summarised in one line, even the article title itself. (like 'peanut butter is made out of peanuts' instead of "you'll NEVER guess this ONE SECRET peanut butter ingredient!"

Vanilla Reddit is almost garbage because of how default subreddit posts take over your front page.

What you need to do is to unsub from all default subreddits, subscribe to niche ones you like and use Reddit Enhancement Suite (RES) [1] to contain the default subreddits to what RES calles the Dashboard (basically a page where you can add lots of subreddits as individual widgets).

[1] https://redditenhancementsuite.com/

your best bet is to filter out meme subs

I wrote the original article visualizing clickbait from scraped Facebook data: http://minimaxir.com/2016/08/clickbait-cluster/

Yes, there are obvious tropes of clickbait. Facebook, however, is cracking down on them, so there's been a slight brinksmanship between "how do I get people to click articles without following the tropes?"

From the visualization in my article, you can see there is a spatial blend between sources like the NYT and BuzzFeed when subjects like kids and Pokemon are brought up.

The point that the article is trying to explain is clickbaits cant just be classified only by using these titles. The content of the webpages also plays a big role :)

Not all clickbait headlines are written like that.

For instance: "Russia hacked US power grid" doesn't have any of those, and yet it was a completely clickbait/sensationalist/borderline fake news headline from WashPost. How is AI going to deal with those?

https://theintercept.com/2016/12/31/russia-hysteria-infects-...

Seems like everyone uses the glove embeddings for any text based DL project.

yes - i am skeptical on how generalizable the final model is - given lots of features (numerical and text) are closely linked to same domain.