Use $MODELPATH
The Problem
On-device AI models are becoming more common, but by default, applications store them in different places.
On-device AI models are becoming more common, but by default, applications store them in different places.
I wrote this guide for a friend interested in running large language models locally in September 2023, and parts of it are out of date – things change quickly. If you’re reading it and run into questions feel free to email me: f (at) filip.world.