Learn how to build or just use Alex Ziskind’s LLM Hardware Calculator.
Understand what hardware you need for the model you want to run locally.
This M4 Max 16 MacBook Pro can handle some of the larger language models.
https://m.media-amazon.com/images/I/51MOSiURIHL._AC_SX425_.jpg’:[425,425],’https://m.media-amazon.com/images/I/51MOSiURIHL._AC_SX522_.jpg’:[522,522],’https://m.media-amazon.com/images/I/51MOSiURIHL._AC_SX569_.jpg’:[569,569],’https://m.media-amazon.com/images/I/51MOSiURIHL._AC_SX385_.jpg’:[385,385],’https://m.media-amazon.com/images/I/51MOSiURIHL._AC_SX679_.jpg’:[679,679],’https://m.media-amazon.com/images/I/51MOSiURIHL._AC_SX466_.jpg’:[466,466],’https://m.media-amazon.com/images/I/51MOSiURIHL._AC_SX342_.jpg’:[342,342]}/