View a markdown version of this page

🏆 āļĒāļ­āļ”āļ™āļīāļĒāļĄ: sagemaker/latest/dg/large model inference.html - āļ›āļĢāļ°āđ€āļ”āđ‡āļ™āļĢāđ‰āļ­āļ™

Model parallelism and large model inference

Amazon SageMaker AI includes specialized deep learning containers (DLCs), libraries, and tooling for model parallelism and large model inference (LMI). In the following sections, you can find resources to get started with LMI on SageMaker AI.