Chat Bots play crucial role in modern world businesses. Development of a chatbot is a tedious and complex task that takes enormous amount of time. Therefore, to enable businesses to develop chatbots in short amount of time with small resources, we need to explore usage of LLMs for the chatbot development. In this article the researchers developed a prototype chatbot architecture that enables businesses to use LLMs interchangeably. Nonetheless, it notes the prototype's limitation in tracking conversation history, an area ripe for future enhancement. The current focus on pre-trained LLMs sets the stage for subsequent research into personalized, fine-tuned chatbot experiences for SaaS customers. There are dozens of LLMs existing already, therefore it is crucial to select the most capable LLM which will power the chatbot. It is crucial for the LLM to be cost-efficient, to be profitable for the business. This article evaluates three LLMs, endorsing ChatGPT for its superior speed, cost-effectiveness, and relevance, backed by OpenAI's pioneering status.