Subscribe
Sign in
Monitor ML
p/monitor-mlReal-time production monitoring of ML models, made simple.
Start new thread
Kat Manalac

Monitor ML - Real-time production monitoring of ML models, made simple.

by•

Monitor ML tracks the performance of models throughout their lifecycle and connects them to business metrics. We support model tracking, metric logging/analysis/alerting and production event logging. You choose the framework, we monitor the model.

Add a comment

Replies

Best
Aparna Dhinakaran
Maker
Hey everyone 👋! I'm the co-founder of Monitor ML along with my brother @eswar_dhinakaran! Our goal with Monitor ML is to bring more transparency and visibility to machine learning. ✨ From my background as a machine learning engineer, I saw models being deployed in applications with broad societal impact. However, there were very few tools to help researchers and businesses monitor models to identify how they behave over time in the real world. Monitor ML is a framework-agnostic platform to track model performance in real-time and connect models to business metrics. You can think of us as a Mixpanel/Amplitude for machine learning models. Right now we support model tracking, training metrics logging/analysis/alerting and production event logging. We support teams and individuals and work with Google Oauth (for team management) and Slack (for alerts). If you have any use cases in your company or as a developer, please email me at aparna@monitorml.com and I'm happy to chat! I'm also here to answer any questions you have :)
Pratyush Mishra
Congrats on the launch!
Sam Udotong
This is dope. How would I upload a model's metrics quickly?
Eswar Dhinakaran
Maker
@sudotong Thanks for asking! We have a simple rest endpoint as well as our own session hook for Tensorflow sessions so you can automatically add metrics in each step of the training/evaluation phases.
Abhinava Singh
Congrats on the launch!
surgieboi
Absolutely love this tool!
Aparna Dhinakaran
Maker
@sergio_villasenor Thank you sergio!
Abi Ganesh
awesome idea! :)
Premonition
Amazing product. Transparency in technology is the key to sustainable business growth for all
Aparna Dhinakaran
Maker
@premonitionlaw Agreed! Thanks for the support!
Saumitra Saha
Can your platform give me insights on how to improve my model?
Aparna Dhinakaran
Maker
@sumosaha Currently we have manual thresholds that set off alerts. We're working towards anomaly detection with our events platform. These insights can help drive where the model is performing abnormally. We're also integrated with Tensorflow so we're working towards scraping information from the tensorflow board while the model is training so model builders get realtime insights to when their model is moving towards/diverging from expected performance.
Kimberly Robles
congrats!!!!
Aparna Dhinakaran
Maker
@kimberly_robles thank you kimberly!!
Akila Welihinda
This tool/service looks very useful! I can definitely see a need for this in the industry
Aparna Dhinakaran
Maker
@akil_welihandaa Thanks Akhila! Appreciate the support!
Cecilia Gonzalez
Congrats on the launch!
Aparna Dhinakaran
Maker
@ceciliagonzalez Thank you cecilia!
Mike Mahlkow
Hey Aparna. That looks really interesting. How does Monitor ML compare to the end-to-end machine learning platforms that are currently in the market?
Aparna Dhinakaran
Maker
@mikemahlkow Thanks Mike! Monitor ML is focused on the monitoring vertical. We're platform/framework agnostic, so it doesn't matter to us how you train or deploy your models - we just want to help monitor it's performance so that you can focus on building the models. With an end-to-end platform, you're tied to their restrictions around what kind of models can be trained, deployment constraints, etc.
Where's Wallington?
Wow this is amazing! I couldn’t be more proud. Keep up the great work y’all. Nothing but love!
Jake Pimental
This is neat. How can someone use your platform to know how their models are performing in production?
Aparna Dhinakaran
Maker
@jake_pimental1 Thanks Jake. They can use our events APIs to log model predictions. We enable human in the loop collection of ground truth so they can then define custom metrics based on what actually happened in production.
LaVonne Idlette
Great tool. I look forward to using it to model
Aparna Dhinakaran
Maker
@lavonne_idlette thanks lavonne! Feel free to send us feedback/suggestions!
Lexi Burbey
Can’t wait to see where it goes!
Eswar Dhinakaran
Maker
@lexi_burbey Thank for the support Lexi!
Kaeya Majmundar
Brilliant product from a brilliant founder! Good luck @aparna_dhinakaran1
Aparna Dhinakaran
Maker
@kaeya thank you for the support :)
Maria Nicolae
Congrats on the launch!!!
BALAJI RAMANUJAM
Congrats on the launch
Adithya Murali
Congrats!