Maruti.io

API for open source Large Language Models

5.0•2 reviews•

126 followers

API for open source Large Language Models

5.0•2 reviews•

126 followers

Visit website

No-code Platforms

•

LLMs

We provide low cost API to our hosted models, enabling businesses to prioritize delivering products that cater to their customers' specific needs. With our support, you can craft exception products while we take care of intricate details!

Free Options

Launch tags:API•Artificial Intelligence•No-Code

Launch Team

Framer AI AgentsDesign and publish professional sites with AI

Promoted

Maruti.io

Maker

📌

Hi Everyone, Maruti.io provides hosting solution for Large Language Models, and reduces development hours. So that you can focus on providing maximum value to your customers. We are working on features such as fine-tuning, faster inference times, analytics, model evaluations, and retrieval augmented generation. Why am I doing this? The idea for this project came from me wanting to host a Open Source Large Language Model. Hosting a model such as T5, or any other model can get expensive really fast, along with all the analytics that need to be put in place. Especially if you don't have access to a performant GPU. Solution: To solve this problem, and allow makers, founders and creators access to a Large Language Model with high performance, low costs, and using lower compute power so that you can focus on building a product that can stand out! Features: Get access to a hosted flan-t5-small model in no time. You can access it via an easy to use API. You only pay for what you use, so you don't have to worry about constantly running a Virtual Machine and paying absurd GPU costs. We will always fine-tune and update our model, so you get a model that is always improving. How do we do this? We use a smaller model that can run efficiently on a CPU. We train it further to be more performant, and get closer to existing Large Language Models in terms for performance.

Report

3yr ago

Tiledesk

@sagarpatel10 congrats for your launch! Your hosting solution for LLMs sounds promising. I'm curious about a few details: 1. Can you provide more information about the cost structure for your hosting service? What are the pricing options available to users? 2. How do you ensure the security and privacy of the data and models hosted on your platform? 3. Could you elaborate on the fine-tuning process you mentioned? How frequently do you update and fine-tune the models, and can users have input into this process? 4. What programming languages and frameworks are supported for making API calls to access the hosted model?

Report

3yr ago

Maruti.io

Maker

@michelepomposo Of cource Michele 1. So there are two plans. There is a free tier which gives you 1 project API key, and 1,000 API calls per month. 2. We use API keys to authenticate requests. On the dashboard side, we make sure the customer is logged in, and only return project data for customer that have created those projects. The analytics dashboard shows all the input traffic for a given project. So that they know what is going into their systems. 3. So the fine-tuning process is still being worked on, but it allows users to fine-tune models on their data using this service. We then return the model back to the user in a file. We also fine-tune all our models to increase their performance. Users can also request a model to be hosted on this service. 4. Since the API calls will be made over a network, rather than locally users can use any programming language that they might be using to make a POST request to our url. There is documentation on how to do that with python. I will expand it for more languages in future.

Report

3yr ago

Tiledesk

🔌 Plugged in

@sagarpatel10 thank you for the detailed answers! Don't you mind to share the python docs?

Report

3yr ago

Maruti.io

Maker

@michelepomposo Of course! Here are the docs! This is like a quick start guide, so it has everything from creating a project, to then running the python code. https://maruti.io/docs

Report

3yr ago

Lebesgue: AI CMO

Congratulations on the launch. This is very good timing, there are a lot of startups which are based on using LLMs in different scenarios. This will help people focus on the product.

Report

3yr ago

Maruti.io

Maker

@leon_novacki Thank you Leon! Your support is much appreciated!

Report

3yr ago

Go Mail Merge

Great idea, I don't know anything about training models yet but what I do know is that I won't want to pay for all of that compute all of the time.

Report

3yr ago

Maruti.io

Maker

@kingromstar yup! That is part of Maruti.io’s charm! Hosting costs are one of the biggest barriers for increasing AI adoption. I hope to reduce that with Maruti.io

Report

3yr ago

Pythia World (Retired)

Hi Maruti.io team! Congrats on the launch! It could accelerate the development process. And it seems especially useful for non-technical startup founders. Best of luck!

Report

3yr ago

Maruti.io

Maker

@mary_rumyantzeva Hi Mary, Thank you for the kind words! Thats the goal! I hope I can help founders build AI apps faster! I appreciate your support! :)

Report

3yr ago

Selzy

This is a great launch, team, especially when Large Language Models are becoming more and more popular!

Report

3yr ago

This is a great service and helps lot of founders to focus more on the development. Congratulations on the launch. All the best.

Report

3yr ago

Congrats with the launch! I have one question though: can you provide more details on how the pricing structure works for accessing the hosted flan-t5-small model through the API? Is it based on usage duration, the number of API calls, or some other metric, and are there any specific pricing tiers or options available?

Report

3yr ago

Maruti.io

Maker

@elena_gaidarji of course! So at the moment there are two tiers. The starter tier allows you 1 project, and a 1,000 api calls per month. The innovate tier is the next tier up. It gives access to 5,000 API calls a month! With innovate you can also host 3 projects, and the 5,000 api limit is cumulative for all projects. When we release models they show up on innovate tier first. Each API call has a limit of 512 tokens at the moment.

Report

3yr ago

@sagarpatel10 Oh, great, thanks for such detailed explanation :)

Report

3yr ago

1 2 3

5.0

Based on 2 reviews

Review Maruti.io?

Reviews

Most Informative