The basic unit of text processing for AI models. A token is roughly 4 characters or 0.75 words in English. API pricing, context limits, and rate limits are typically measured in tokens.
Related Terms
More in AI & LLMs
Tool CallingThe ability of an AI model to invoke external functions during a conversation. T...Function CallingA capability of large language models to generate structured function invocation...AI AgentAn autonomous AI system that can plan, execute actions, and iterate toward goals...Multi-Agent SystemAn architecture where multiple AI agents collaborate, each specializing in diffe...Large Language ModelA neural network trained on vast text data that can understand and generate huma...