AIAppsAPI
•
Aug 21
•
in Articles
• 2 min read
Plenty of the self-hosting threads here stop at the point where a model finally answers on localhost. This is a map of everything that sits around that, because inference turns out to be the easy layer.
The Five Layers
Inference loads model weights...