Rendered at 11:24:33 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
y42 43 minutes ago [-]
good to have a quick overview, though I am missing some kind of depth, like
>There are others — MLX-native runtimes, llama.cpp directly — but Ollama and LM Studio cover 95% of people reading this.
Sure, but... MLX native runtime have a lot of advantages right? and they are not necessarily more complicated like eg ollama. It's worth to mention them, too.
Coming to the next missing part: use cases.
Running it locally competes with dozens of freely available chat bots. And for most simple parts, seriously, you don't need that sophisticated payed AI service. But then: how do local model's perform exactly here: let's start with coding, image generation and more? Like stuff that I probably really want to run locally.
reftel 43 minutes ago [-]
«The honest table». Right. Not interested in reading what you didn’t write.
WakeUpPeople 27 seconds ago [-]
Yeah, when I saw that I immediately rolled my eyes and closed that tab.
b3ing 21 minutes ago [-]
This is old, lm studio support has dropped quite a bit.
As of July the best seemed to be
* nativ
* omlx
* mtplx
reassess_blind 34 minutes ago [-]
Whats the best coding model that fits on 16GB unified memory these days?
fron 42 minutes ago [-]
Entire article is vibeslopped
viggio24 30 minutes ago [-]
clearly AI written (aka "slop"), stopped reading after a few paragraphs
>There are others — MLX-native runtimes, llama.cpp directly — but Ollama and LM Studio cover 95% of people reading this.
Sure, but... MLX native runtime have a lot of advantages right? and they are not necessarily more complicated like eg ollama. It's worth to mention them, too.
Coming to the next missing part: use cases.
Running it locally competes with dozens of freely available chat bots. And for most simple parts, seriously, you don't need that sophisticated payed AI service. But then: how do local model's perform exactly here: let's start with coding, image generation and more? Like stuff that I probably really want to run locally.
As of July the best seemed to be
* nativ
* omlx
* mtplx