NLP/Chatbot/Agentic guardrails

Classifiers are commonplace in chatbots to run customer sentiment analysis, intent classification for proper routing, topic tagging, and guardrails that protect the system from out-of-bounds user queries.

• Problem: Each of these classifiers run fully for every single user query.
• With moco: Some of these classifiers only need to run partially.
• Impact: Reduction of cost and improved energy efficiency