We provide low cost API to our hosted models, enabling businesses to prioritize delivering products that cater to their customers' specific needs. With our support, you can craft exception products while we take care of intricate details!
Hi Everyone, Maruti.io provides hosting solution for Large Language Models, and reduces development hours. So that you can focus on providing maximum value to your customers. We are working on features such as fine-tuning, faster inference times, analytics, model evaluations, and retrieval augmented generation.
Why am I doing this?
The idea for this project came from me wanting to host a Open Source Large Language Model. Hosting a model such as T5, or any other model can get expensive really fast, along with all the analytics that need to be put in place. Especially if you don't have access to a performant GPU.
Solution:
To solve this problem, and allow makers, founders and creators access to a Large Language Model with high performance, low costs, and using lower compute power so that you can focus on building a product that can stand out!
Features:
Get access to a hosted flan-t5-small model in no time. You can access it via an easy to use API. You only pay for what you use, so you don't have to worry about constantly running a Virtual Machine and paying absurd GPU costs.
We will always fine-tune and update our model, so you get a model that is always improving.
How do we do this?
We use a smaller model that can run efficiently on a CPU. We train it further to be more performant, and get closer to existing Large Language Models in terms for performance.
Congrats with the launch! I have one question though: can you provide more details on how the pricing structure works for accessing the hosted flan-t5-small model through the API? Is it based on usage duration, the number of API calls, or some other metric, and are there any specific pricing tiers or options available?
Congratulations on the launch. This is very good timing, there are a lot of startups which are based on using LLMs in different scenarios. This will help people focus on the product.
Maruti.io