Docker Model Runner

DevOps and Docker Talk ›

13:06 | Apr 21st, 2025

Docker launched "Docker Model Runner" to run LLMs through llama.cpp with a single "docker model" command. In this episode Bret details examples and some useful use cases for using this way to run LLMs...Show More