A common question today, right after “What is an LLM?”, is “How are they used?”. That is, what is the current architecture for what IT calls deployment? Initially, and still for many customers, this architecture is a big, static Large Language Model (LLM) in the cloud (think ChatGPT, Bard, Bing, Claude) that is fed a text prompt, either directly in a chat interface or through an API call.