AI Powered Voice Agent using NLP and ASR

Abstract

The demand for intelligent, automated communication systems has signifi- cantly increased with the growth of businesses and customer service requirements. Tra- ditional call centers require high manpower, leading to increased operational costs and inconsistent service quality. This paper surveys the development of AI-powered voice agents using Natural Language Processing (NLP) and Automatic Speech Recognition (ASR) for automating call center operations. The system supports Marathi, Hindi, and English, enabling multilingual communication and bridging the gap between technology and regional language users.

A key feature of this work is the integration of the N8N automation platform, which enables modular workflows for call handling, appointment booking, and marketing pro- cesses. By leveraging N8N, the system can seamlessly connect ASR, NLP, and Large Language Models (LLMs) such as ChatGPT and Gemini, ensuring flexibility, scalability, and ease of deployment. This modular approach reduces the complexity of development while allowing customization for businesses of different sizes.

We discuss the background, related works, methodologies, performance results from ex- isting studies, and future research directions. The survey highlights how voice-based AI agents, integrated with N8N and modern LLMs, can transform customer support, mar- keting, and appointment management by reducing human dependency and operational costs.