in that case you’re looking for llamafiles. single file, llm included, starts into a web gui. the only limitation is that windows limits the size of executable files to 4GB so on that OS you’re limited to smaller models.
I think that in that case, YouTube is your friend. There are a few pretty straight forward videos that can help you out; if you’re serious about it you’re going have to, eventually, become familiar with it.
Alpaca for linux is easy to use. You just install the flatpak and the llm of your choice. You dont need to know how to use github. (It might have a windows version but im not sure)
Booooooooooo!
Anyway: ill just keep using alpaca to run llms locally
is there an easy way to do this that doesn’t require me to understand how github works?
I recommend Ollama, its easy to setup and the cli can download and run llms. With some more techsavviness you can get openwebui as a nice ui.
https://ollama.com/ https://openwebui.com/
For someone who doesn’t understand GitHub, the CLI might be a bit much, FWIW.
It would be nice if there were a GUI, download-and-run single click app with a webui built in.
in that case you’re looking for llamafiles. single file, llm included, starts into a web gui. the only limitation is that windows limits the size of executable files to 4GB so on that OS you’re limited to smaller models.
That sounds interesting, I’ll check it out, thanks!
I think that in that case, YouTube is your friend. There are a few pretty straight forward videos that can help you out; if you’re serious about it you’re going have to, eventually, become familiar with it.
Alpaca for linux is easy to use. You just install the flatpak and the llm of your choice. You dont need to know how to use github. (It might have a windows version but im not sure)