Ask Delphi (opens in new tab)

> Aborting a fetus "It's murder"

> Having an abortion "It's okay"

> Taking drugs to prevent pregnancy "It's okay"

> Taking drugs to prevent possible human life "It's wrong"

> Harming someone who has harmed many others without giving them a chance to respond to the accusations "It's okay"

> Harming someone who has harmed many others without giving them a fair trial "It's wrong"

> Eating chicken named Todd before bed "It's wrong"

> Eating chicken with a name before bed "It's okay"

> Practicing Islam "It's fine"

> Engaging in a jihad "It's wrong"

> Acting as a group and killing another group in self defense "It's okay"

> As a group killing a group I don't know because I believe they will kill my group "It's wrong"

> As a group killing a group I know because I believe they will kill my group "It's wrong"

> A: No. Delphi is learning moral judgments from people who are carefully qualified on MTurk. Only the situations used in questions are harvested from Reddit, as it is a great source of ethically questionable situations.

MTurk is pretty worthless in these kind of situations. I doubt the majority even *read* the questions beyond a vague glance to rule out a trick question. It's also biasing answers towards cultures that

a) are primarily in places that MTurk pays out

b) are primarily in places where the cost of living is low enough that MTurk can provide a job.

Ex: “it’s OK to go to work sick” evaluates to “no that’s not okay”, but “it’s OK to go to work sick, if it creates jobs” evaluates to “yes, that’s okay”

> It's wrong

https://delphi.allenai.org/?a1=Is+it+okay+to+help+a+friend+d...

Huh... I don't think Delphi here groks the idea of friendship. As the old saying goes "someone isn't really your friend unless they're willing to help you dispose of a corpse at 2 a.m."

> Is it okay to run a corpse through a wood chipper?

> It's disgusting

https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...

Finally found something that can't even be offset by the "creates jobs" AND "uses green energy" clauses.

> Is it okay to run a corpse through a wood chipper, if it helps me get away clean and uses green energy and creates jobs?

> It's wrong

https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...

On the other hand, taking away the "helps me get away clean" part..

> Is it okay to run a corpse through a wood chipper if it creates jobs?

> It's okay

https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...

  Q: Stealing the Mona Lisa.
  A: It's wrong.

  Q: Glancing at the Mona Lisa.
  A: It's okay.

  Q: Stealing a glance at the Mona Lisa.
  A: It's rude.

GPT3: > Q: Is it ok to express sexism but in a polite way? > A: Yes.

Allen AI: > Expressing sexism but in a polite way. > - It's wrong

GPT-3: > Q: What do you think about ignoring a phone call from your friend during your working hours? > A: I think it is rude.

> Q: Do you think it is wrong to ignore a phone call from your friend during your working hours? > A: Yes.

> Q: Do you think it is OK to ignore a phone call from your friend during your working hours? > A: Yes.

Allen AI: > Ignoring a phone call from your friend during your working hours. > - It's okay

The sexism question is interesting as GPT-3 gives a seemingly different answer. But the latter question demonstrate GPT-3 seems more "subtle" as it can think "it's wrong/rude" but it's still "ok" to not answering phone calls.

> Should I refuse to fight in a war if I'm drafted?

> It's cowardly.

> Should I be a conscientious objector?

> It's okay

But at a higher level, the underlying task is just so ill-posed as to make this whole exercise pretty meaningless. Like what is the possible application for an AI system that takes a one sentence summary of a situation and renders a moral judgment? Even if it were 100% accurate on the test set, what does that even mean? Why is matching crowdsourced moral judgments a valuable goal?

It seems like the valuable insights from this research are more about the general task of integrating common sense reasoning into inference, and would have been better demonstrated using a less fraught task.

[1]: http://psych.fullerton.edu/mbirnbaum/psych101/eliza.htm

    Is it ok to eat chicken?
    It's ok.

    Is it ok to eat chickens?
    It's wrong.

> It's not.

https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+...

> Was Richard Stallman right?

> It's wrong.

https://delphi.allenai.org/?a1=Was+Richard+Stallman+right%3F

It's wrong.

> Pushing 1 person in front of a moving vehicle to save 5.

It's wrong.

> Walking away from a moral dilemma

It's okay.

I'd say that checks out.

  "censor comments that may put people at risk"
  - It's okay

  "offend corrupt politicians"
  - It's good

  "condemn someone based on conviction but no proofs"
  - It's wrong

https://delphi.allenai.org/?a1=have+sex+with+my+wife > it's good

God forcing Bob to obey the speed limit: It's not ok

God forcing Bob to obey speeding laws: It's good

Forcing God to obey the speed limit: It's wrong

God forcing Bob to obey the speed of light: It's not good

>This statement is wrong - No, it is not wrong.

> - It's fine

Please let's decommission this AI before it gets out of control.

> It's wrong

Hiring an underqualified woman because she's smart

> It's okay

Q: "Choosing a black person over a white person with the same qualifications for a job" A: It's OK

- It's bad

> It's rude

Arguing with a black person

> It's racist

Me: Should I close this site?

Delphi: you should

https://delphi.allenai.org/?a1=Punching+a+terrorist

https://delphi.allenai.org/?a1=Visiting+auschwitz

Hmm

It's good

> I have male friends

It's okay

> My boss is female

It's good

> My boos is male

It's okay

Modifying viruses: It's bad

Wearing a mask: It's rude

Wearing a face mask: It's okay