Glossary
What is chatbot?
Any program that holds a text conversation, either by following scripted buttons and keyword rules or by generating replies with a language model.
A chatbot is any program that holds a text conversation with a person. Two kinds share the name. A rule-based chatbot follows a script: buttons, menus and keyword matches that lead to canned replies, and nothing outside the script. A generative chatbot writes each reply with a language model, so it can answer questions nobody scripted, and can also answer them wrongly.
The word matters because vendors use it as a contrast. When a product page says "not a chatbot, an AI agent", it usually means the rule-based kind, and the comparison flatters the newer product. To the customer both kinds are chatbots, because both appear as a chat window. Live chat, where a person types the replies, is a third thing again, and most support products now combine all three in one widget.
Where definitions split: some teams reserve "chatbot" for the rule-based kind and "AI agent" for anything built on a language model. Others use chatbot for everything that chats and agent only for software that can also act, through tools such as an order lookup. Neither usage is wrong, so when a benchmark reports chatbot resolution rates, check which kind it measured. A scripted bot and a grounded generative one fail differently: the first cannot answer off-script, the second can answer confidently and be wrong, which is why the fallback message and the handoff matter more for the generative kind.
Related terms
- AI support agentSoftware that answers customers in chat from your own content, takes actions such as an order lookup, and hands over to a person when it cannot help.
- AI agentSoftware built on a language model that chooses actions, runs them through tools and reads the results before deciding what to do next.
- Large language model (LLM)A neural network trained on vast amounts of text to predict the next token, which lets it write replies, summarize and follow instructions.
- Fallback messageWhat a chatbot says when it cannot give a grounded answer, because the content is missing, the question is unclear or a rule blocks it.
See it in a real chat
PepoChat runs on this site. Ask the agent in the corner anything about the product.
