Daily Shaarli
July 25, 2024
exo: Run your own AI cluster at home with everyday devices. Maintained by https://x.com/exolabs_. [...] Forget expensive NVIDIA GPUs, unify your existing devices into one powerful GPU: iPhone, iPad, Android, Mac, Linux, pretty much any device! Update: Exo Supports Llama 3.1 #update-exo-supports-llama-31 Now the default models, run 8B, 70B and 405B parameter models on your own devices https://github.com/exo-explore/exo/blob/main/exo/inference/mlx/models/sharded_llama.py exo is experimental software. [...] The native way to access models running on exo is using the exo library with peer handles.