Featherless AI

Run every 🦙 model & more from 🤗 huggingface. Serverless

210 followers

Run every 🦙 model & more from 🤗 huggingface. Serverless

210 followers

Visit website

LLMs

•

Unified API

Featherless is a platform to use the very latest LLMs. We list thousands of models from Hugging Face and make them available serverless, helping you keep up with the hundreds of new models added daily without ever renting a GPU No matter your application, find and use the state of the art LLMs with Featherless

Payment Required

Launch tags:API•Artificial Intelligence•Tech

Launch Team / Built With

LM-Kit OneThe Private AI Application Server

Promoted

Platform is very quick and fluid. Good UI, I think this has great potential. Update the main site with api pricing info, thanks!

Report

2yr ago

Agreed @griimnak! That would be helpful to know on the homepage.

Report

2yr ago

Featherless AI

Maker

@griimnak @jonathanleung To both : the plans include API access!

Report

2yr ago

That's crazy that you offer this for $10-20; read about how you are swapping out models in almost real time, that's super cool! Thank you for making open source AI world a better place. As someone without the knowledge on how to deploy LLMs, this is a cool way to test out all kinds of OSAI quickly! Congrats @eugene_cheah !

Report

2yr ago

Featherless AI

Maker

@tonyhanded Thanks! Hope you find a model you like for your use case, or just to play with =)

Report

2yr ago

Hubflo

How does Featherless ensure the integration of these models remains user-friendly? It sounds like an amazing platform! The ability to access the latest open-source AI models from Hugging Face is also fantastic.

Report

2yr ago

Featherless AI

Maker

@hakz Thanks! We use OpenAI compatible API, so any tools that integrates and work with OpenAI can be used with featherless.ai

Report

2yr ago

Hugging Face

wow this is very cool! @eugene_cheah

Report

2yr ago

Featherless AI

Maker

@julien_c Thank you 🙏 : now we just need to scale usage, then servers, then models - until we catch them all from huggingface 😉

Report

2yr ago

Hugging Face

@eugene_cheah let's do it! BTW https://recursal.ai/ looks quite cool too

Report

2yr ago

Featherless AI

Maker

@julien_c Thanks! They are actually the same backend / infra 😉 As we scale featherless.ai, we do plan to integrate it back to recursal, with the more "complicated features" like automated finetuning, etc. So that recursal will be providing offerings beyond RWKV.

Report

2yr ago

Turf

Interesting. Shared it with our dev lead!

Report

2yr ago

Featherless AI

Maker

@tim__pouw Thanks, hope you can find a useful model for your use case, or for fun!

Report

2yr ago

Telebugs

Hi Eugene, Featherless.AI sounds like an invaluable tool for accessing and experimenting with various LLMs. How do you manage the computational resources to support such a wide range of models? Also, are there plans to support custom model training or fine-tuning on the platform? Congrats!

Report

2yr ago

Featherless AI

Maker

@kyrylosilin Our infrastructure auto scale according to current workload, with optimizations specific to our infra provider. We also adjust our setup for the best price to performance GPUs, to lower overall cost (aka no H100s), even for the larger models. In overall, this lets us keep costs to the minimum (no wasted GPUs), according to the user workloads. And yes, we do plan to support additional features like finetuning, and the option to switch to token based pricing, for larger scale commercial users in the future. But for now, this is aimed at individuals who would love to play with all the models

Report

2yr ago

Just Scroll

Congrats on launching Featherless AI! It’s incredible to see a platform that simplifies access to the latest AI models from Hugging Face.

Report

2yr ago

1 2 3

Pros

Cons

Reviews