Inference — AI Glossary

The process of running a trained AI model on new data to generate predictions, classifications, or content. Inference is what happens when an AI system is "thinking" — processing inputs and producing outputs. Optimizing inference performance and cost is a key concern for production AI systems.