An AI model is called multimodal when it can understand or produce several types of data: text, images, audio, video, and sometimes other signals.
Rather than chaining specialized models (one to read the text in an image, another to analyze it), a multimodal model processes the different inputs in a single representation. You can ask a question about a photo, analyze a scanned document with its tables, or reply directly to a voice message.
The large models from Google, OpenAI, Anthropic and Mistral all accept at least text and images. Common uses: automated document reading, visual inspection in industry, voice assistants, video description.
Why it matters when hiring
For most products, using a multimodal model through an API is AI Engineer work. The scarcity lies elsewhere: training or adapting these models requires research or computer vision profiles with real experience on image or audio data. Specify which of the two you are looking for.
