Running an LLM locally is easy to demonstrate.
Start Ollama or vLLM, load a model, send a request, and watch it generate tokens.
The interesting problems start when you send more than one kind of request.
Imagine a local inference server handling ...
