Show HN: API to detect abusive content in 27 languages

5 pointsvadimberman7y ago4 comments

Hello HN,

I am Vadim of Tisane Labs (http://tisane.ai). We build text analytics APIs.

My natural language processing journey started over a decade ago, when I built an NLP engine with an emphasis on scalability across languages. The engine served as a foundation of a startup I cofounded in 2010 (https://en.wikipedia.org/wiki/LinguaSys), which had Mark Cuban as an investor and was acquired in 2015.

Utilizing our expertise, we're trying to tackle one of the most painful issues with the Internet today: abusive content. Hate speech, sexual harassment, cyberbullying are difficult to detect. Today's solutions mostly look for obscenities; correlation with training datasets only works with limited demos as the patterns of abuse are too many. Hate speech is more than just ethnic slurs.

The API is a generic analytical engine, so it may be used for other purposes as well, but abusive content is our main focus.

We'd love to hear your feedback, ideas, wishes, and complaints.

4 comments

web647y ago

Looks interesting, but I couldn't get the code samples to work. Would be good to have all languages available in the demo on the website.

vadimbermanOP7y ago

Thanks, Web64.

What was the issue? Any error messages or you just didn't get the output you wanted?

I imagine you're interested in Norwegian?

EDIT: I forgot to mention that you don't need to code to test-drive. You can simply dump your JSON in the console (the "Try it" button: https://dev.tisane.ai/docs/services/5a3b6668a3511b11cc292655...).

web647y ago

Yes, I would like to test for Scandinavian languages as there are not many multilingual NLP apis available. Not even Google/Microsoft/AWS has multilingual support.

The error I'm getting is:

  Request Error
  The server encountered an error processing the request. The exception message is 'Invalid JSON string literal format. At line 1, column 1.'. See server logs for more details. The exception stack trace is: 
  at System.Runtime.Serialization.Json.JavaScriptReader.ReadStringLiteral()
  at System.Runtime.Serialization.Json.JavaScriptReader.ReadCore()
  at System.Runtime.Serialization.Json.JavaScriptReader.Read()
  at System.Json.JsonValue.Load(TextReader textReader)
  at Tisane.Server.Parse(Stream json)
  at SyncInvokeParse(Object , Object[] , Object[] )
  at System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]&amp; outputs)
  at System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc&amp; rpc)
  at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc&amp; rpc)
  at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage11(MessageRpc&amp; rpc)
  at System.ServiceModel.Dispatcher.MessageRpc.Process(Boolean isOperationContextSet)

using these parameters:

  $parameters = array(
     'content'  => "Babylonians should not be allowed at managerial positions.",
     'language' => 'en'
  );

1 more reply

j / k navigate · click thread line to collapse

Show HN: API to detect abusive content in 27 languages

5 pointsvadimberman7y ago4 comments

Hello HN,

I am Vadim of Tisane Labs (http://tisane.ai). We build text analytics APIs.

The API is a generic analytical engine, so it may be used for other purposes as well, but abusive content is our main focus.

We'd love to hear your feedback, ideas, wishes, and complaints.

4 comments

web647y ago

Looks interesting, but I couldn't get the code samples to work. Would be good to have all languages available in the demo on the website.

vadimbermanOP7y ago

Thanks, Web64.

What was the issue? Any error messages or you just didn't get the output you wanted?

I imagine you're interested in Norwegian?

web647y ago

Yes, I would like to test for Scandinavian languages as there are not many multilingual NLP apis available. Not even Google/Microsoft/AWS has multilingual support.

The error I'm getting is:

  Request Error
  The server encountered an error processing the request. The exception message is 'Invalid JSON string literal format. At line 1, column 1.'. See server logs for more details. The exception stack trace is: 
  at System.Runtime.Serialization.Json.JavaScriptReader.ReadStringLiteral()
  at System.Runtime.Serialization.Json.JavaScriptReader.ReadCore()
  at System.Runtime.Serialization.Json.JavaScriptReader.Read()
  at System.Json.JsonValue.Load(TextReader textReader)
  at Tisane.Server.Parse(Stream json)
  at SyncInvokeParse(Object , Object[] , Object[] )
  at System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]&amp; outputs)
  at System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc&amp; rpc)
  at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc&amp; rpc)
  at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage11(MessageRpc&amp; rpc)
  at System.ServiceModel.Dispatcher.MessageRpc.Process(Boolean isOperationContextSet)

using these parameters:

  $parameters = array(
     'content'  => "Babylonians should not be allowed at managerial positions.",
     'language' => 'en'
  );

1 more reply

j / k navigate · click thread line to collapse