undefined | Better HN

0 pointsribosometronome2y ago0 comments

I wonder what dang thinks about that for HN?

I'm not sure how you would properly prompted LLM change moderating standards based on community feedback? Sticky threads for popular topics? Have the understanding of things like local politics or a newly released game in 2023 to be able to separate out bad faith discussion from real? Reddit isn't twitter where the main thing the mods do is remove abusive replies. They're community crafters and maintainers.

0 comments

1024core2y ago

A few-shot prompt should be able to do it. Now, I will admit I have not tried; but you could have the prompt be some posts that are considered "on topic" (of the sub) and others that are "off topic", and let the LLM rate these posts. Limit the number of new posts to a small number to prevent probing and spamming.

ribosometronomeOP2y ago

And handling the 11th unique story on a single topic being posted and voted up by brigades that week? Considering people's user history when making moderation judgments? Having the context to understand new dog whistles? All things that are technically possible, I guess, but it requires a lot of complex prompting, long context windows, and effort placed into moderation tools that Reddit doesn't seem to have put significant effort into before.

SanderNL2y ago

Alright, I see. Reddit is not my thing, but I can see how this gets complex (and costly) fast.

seanhunter2y ago

My understanding is Reddit the company actually already uses openai's moderation api[1]. Not sure they expose that to anyone (even mods) outside the company. It's not an LLM I don't think though, it's just a set of classifiers to give a probability that something violates various categories of their TOS.

[1] https://platform.openai.com/docs/guides/moderation

j / k navigate · click thread line to collapse