Classifiers are commonplace in chatbots to run customer sentiment analysis, intent classification for proper routing,
topic tagging, and guardrails that protect the system from out-of-bounds user queries.
Problem: Each of these classifiers run fully for every single user query.
With moco: Some of these classifiers only need to run partially.
Impact: Reduction of cost and improved energy efficiency