All activity
SilicaCluster is an open-source (AGPLv3) application designed to turn Android devices into nodes for a decentralized, local AI infrastructure . Built as a true private alternative to centralized AI services, this app allows you to run open-source Large Language Models (LLMs) locally on your phone or distributed across a cluster of devices. - ShintoChakkiath/Silica-Cluster-Decentralized-Mobile-AI
Silica ClusterDecentralized Mobile AI
Shinto Chakkiathleft a comment
Please note: The purpose of this project is to demonstrate the use of Inference Parallelism to run LLMs on a cluster of devices. This serves as a proof of concept for the product I am currently building. I hope you enjoy the project! Please feel free to contact me if you are interested in the system we are developing.
Silica ClusterDecentralized Mobile AI