See what models you can run locally with its rank and the command to run it
Compare them with API models on the same score
Building it made me realise a 32GB Mac can now run a model that scores on-par with GPT-5, completely locally and for free (e.g. Qwen3.8 27B at 4-bit).
Each model gets one score fitted across 19,731 published benchmark results, and every result links to its source. The method is at whatmodel.sh/method, and the data, scoring code and bench script are open source: github.com/jakemanger/whatmodel
If you'd like to contribute, there's a bench script to collect real-world tok/s and you can also submit any new models and benchmark scores along with their source on the github.
Hey everyone, I made whatmodel.sh
To use it,
Enter your RAM and GPU
See what models you can run locally with its rank and the command to run it
Compare them with API models on the same score
Building it made me realise a 32GB Mac can now run a model that scores on-par with GPT-5, completely locally and for free (e.g. Qwen3.8 27B at 4-bit).
Each model gets one score fitted across 19,731 published benchmark results, and every result links to its source. The method is at whatmodel.sh/method, and the data, scoring code and bench script are open source: github.com/jakemanger/whatmodel
It works from the terminal too: curl whatmodel.sh
If you'd like to contribute, there's a bench script to collect real-world tok/s and you can also submit any new models and benchmark scores along with their source on the github.
Hey everyone, I made whatmodel.sh
To use it,
Enter your RAM and GPU
See what models you can run locally with its rank and the command to run it
Compare them with API models on the same score
Each model gets one score fitted across 19,731 published benchmark results, and every result links to its source. The method is at whatmodel.sh/method, and the data, scoring code and bench script are open source: github.com/jakemanger/whatmodel
It works from the terminal too: curl whatmodel.sh
If you'd like to contribute, there's a bench script to collect real-world tok/s and you can also submit any new models and benchmark scores along with their source on the github (please star if you find it useful).
I made an open-source AI leaderboard that shows the best models your machine can run
1. Enter your RAM + GPU
2. See what models you can run locally
3. Compare them to API models too
Made me realise a 32gb macbook can now run a model better than GPT 5 completely locally for free
whatmodel.sh
Hi everyone, I made whatmodel. It's a simple site that can be visited in the browser or used from the terminal via a:
curl whatmodel.sh
To use it,
1. Enter your RAM and GPU
2. See what models you can run locally with its rank and the command to run it
3. Compare them with API models on the same score
Building it made me realise a 32GB Mac can now run a model that scores on par with GPT-5, completely locally and for free (e.g. Qwen 3.8 27B at 4-bit).
Each model gets one score fitted across 18,731 published benchmark results, and every result links to its source.
The method is at https://whatmodel.sh/method and the data, scoring code and bench script are open source: https://github.com/jakemanger/whatmodel
If you'd like to contribute, there's a bench script to collect real-world tok/s and you can also submit any new models and benchmark scores along with their source on github.
I made an open-source AI leaderboard that shows the best models your machine can run
1. Enter your RAM + GPU
2. See what models you can run locally
3. Compare them to API models too
Made me realise a 32gb macbook can now run a model better than GPT 5 completely locally for free
http://whatmodel.sh
