Business adoption of AI has accelerated tenfold as a result of the COVID-19 pandemic, and a handful of conversational AI platforms have emerged as the leaders in the space. We set out to see how Netomi’s Natural Language Understanding (NLU) performs against the most prominent conversational AI platforms: Google Dialogflow, IBM Watson, Microsoft LUIS and RASA.

Here are a few key findings from the Conversational AI Benchmarking Report:

  • Netomi has the highest overall accuracy (85.17%) of any platform, and outperforms on both email and chat
  • Netomi has the highest out-of-scope accuracy at 92.45%
  • Rasa has the highest coverage rates

The report reveals a lot of disparity in AI performance even amongst the most established platforms, signaling that even as the market matures, the end user experience is still greatly differentiated based on the underlying AI platform a company deploys.