Chris Messina

Floyd - Heroku for deep learning

Add a comment

Replies

Best
Sai Prashanth Soundararaj
Hi Hunters, I’m Sai, one of the cofounders at FloydHub. We're building FloydHub to be a “Heroku for deep learning”. We are in the current batch (W17) at YC. Thanks to @chrismessina for hunting us! 10 months ago, I was working at Microsoft and doing a lot of deep learning (DL) there. While the DL community is terrific, I was often frustrated by how difficult it was to get started and build upon others’ work. For example, running any popular Github project often started with an exercise in dependency hell. As I untangled these for myself, I wrote up some notes on setting up the top DL frameworks, which became super popular on Github (https://github.com/saiprashanths...). That's when I realized that engineering was a huge bottleneck in deep learning and a problem worth solving after all. I’ve since quit my job and have been working fulltime for the last 9 months on building FloydHub to make deep learning easier. Our goal is to let the data scientists focus on the science, while we handle the engineering grunt work (provisioning and scaling infra, running reproducible experiments, enabling sharing and collaboration, supporting DL frameworks with zero setup, shipping trained models to production easily, etc.) Lots of interesting challenges - happy to talk about them! We have a lot of work ahead, but we’re excited to share with you what we have so far! We have a neat Neural Style Transfer demo you can try out now (https://www.floydhub.com/#examples). Let us know what you think! Looking forward to your feedback and answering questions.
Pietz Prove
@saip @chrismessina any special deals for poor students? :)
Sai Prashanth Soundararaj
@gopietz Not yet, but we've been thinking about setting up an academic discount. I'd like to learn more - shoot us an email: founders@floydhub.com
Chris Messina
This is pretty awesome... the whole field of Deep Learning is becoming more and more accessible and easy to use. Here's the launch post on HN.
Dražen Lučanin
Heroku for deep learning with cheaper-than-AWS GPU hardware and Jupyter notebook support? I am intrigued…
Sai Prashanth Soundararaj
@metakermit Thanks! Take it for a spin; let us know if you meet your expectations :) Always happy to hear feedback and/or feature requests!
Dražen Lučanin
@saip what are these modules I see in the web app? Are they like models that people have published? I see the examples I ran in there as well – are they public by default?
Sai Prashanth Soundararaj
@metakermit Ah, I see you dug deeper into our hidden features! That's awesome! First off - don't worry - none of your experiments are public unless you explicitly make it public (this feature is disabled now, so you can't make your stuff public ATM :-) Some deets: Our current version lets you run single script jobs only (e.g. floyd run python train.py). We will soon be supporting data workflows that allow you to chain jobs to arbitrarily complex pipelines, like the one in the screenshot above :) More info upcoming!
Dražen Lučanin
@saip cool, looking forward to this :)
Naren Thiagarajan
Hello Hunters! I'm Naren, the other co-founder. We are very excited to see all the feedback so far, please keep them coming! One question for all: What Deep Learning frameworks / algorithms do you want to see on Floyd? Maybe something that you already use or always wanted to try but it has been difficult to setup / get started. And we will port them to Floyd :)
Samiur Rahman
@narenst Keras, Chainer and PyTorch are what I use. Since Keras is part of TensorFlow now, I'm sure that's already supported, but Chainer and PyTorch handle dynamic networks much better.
Sai Prashanth Soundararaj
@samiur1204 @narenst Feedback taken. Chainer and PyTorch coming up very shortly!
Samiur Rahman
This is great @saip @narenst! Was trying to figure out what GPUs you guys are using (seems like K80). Definitely on par with all the cloud providers right now (GCP, AWS, Azure) but I'm frustrated that noone is offering the GTX 1080 or the new Titan X. Both of those cards are quite a bit faster than the K80s for Deep Learning. Would love it if you guys could incorporate one of them somehow :).
Sai Prashanth Soundararaj
@samiur1204 @narenst Agreed! We're currently on AWS, so we're limited to Tesla K80s at the moment, unfortunately. But better GPUs and hosting our own infra is something we have been talking quite a bit recently. I'll keep you posted on that front!
Atul Acharya
Hey @saip @narenst - Ok, this looks supercool! 👏👏 Particularly as I'm setting up DL environments for various projects -- computer vision, NLP, creative AI, and more. I find creating/establishing proper working environments is roughly 10%-20% of the challenge. I'd love to see and explore the following installed and working: -- OpenCV (for computer vision / self-driving car projects) -- MXNet -- PyTorch Datasets I'd love to see available locally: -- Youtube-8M -- Quora Q&A dataset -- MusicNet -- Million Song Dataset How do I get started? Thanks!
Sai Prashanth Soundararaj
@atulacharya @narenst Hey, thanks Atul! Glad you're finding it useful. Some details on what's supported and what's coming soon: - OpenCV is available in all the environments by default. Will add MXNet, PyTorch and Chainer over the weekend. - Datasets: We have Quora Q&A (http://docs.floydhub.com/guides/...). The rest are also great suggestions. I'll look at their licenses and load them into Floyd soon too! To get started, check out: https://www.floydhub.com/welcome. We have a simple MNIST project to get you up and running and a more complete Neural Style Transfer guide here: http://docs.floydhub.com/guides/.... Ping me if there's anything at all I can do to help!
Atul Acharya
@saip @narenst Thanks. Signed up. Testing it out now. What's the best way for discussing more technical issues?
Sai Prashanth Soundararaj
@atulacharya @narenst Shoot us an email: founders@floydhub.com. Happy to help any way we can!
Glenn Gillen
So I'm probably a bit sensitive when it comes to Heroku comparisons 😉 But... Nice DX, what appears at this stage to be pretty compelling pricing, and a marketplace in the works too?! 😱 Wow. This is shaping up to be something very impressive. Great job team. I'm not really in the target market as I'm fine running infrastructure but a massive n00b when it comes to tensorflow. I really want to up my TF game so I can take this for a serious spin though.
Sai Prashanth Soundararaj
@glenngillen Thanks! Driving down price is something we're serious about and that's a good part of our tech challenge. GPUs on the cloud are ridiculously expensive and a big barrier for people to experiment with DL. Do take it for a spin and let us know what you think! We definitely want to make it easy to get started, even for beginners and enthusiasts like yourself. We have one full end-to-end tutorial (style transfer), but hoping to add more over the coming days - may be that's where the marketplace will help :)
Bo Wang
I like this a lot, pricing is defo alluring. Imma try it tonight..
Sai Prashanth Soundararaj
@bluemonk482 Sweet! Very interested in getting an AI researcher's perspective. How does this fit with your existing workflow? If there's anything we can do to make it frictionless, let me know - sai@floydhub.com. All ears!
Ivan Verkalets
Awesome job guys! Definitely will try it.
Sai Prashanth Soundararaj
@verkalets Thanks! Quick question - we want to add more frameworks and DL algorithms to Floyd. Is there anything specific you'd like to see? Sorta doing audience polling :)
Ivan Verkalets
@saip I`ll use everything which you will provide :D
Sai Prashanth Soundararaj
@verkalets Valid response, I'll take that :D
Salil Navgire
Great job guys and a really cool concept. I would totally use this platform
Sai Prashanth Soundararaj
@salilnavgire Glad you like it, thanks! Are you still at NYU? Looking to talk to some folks from academia.
Salil Navgire
@saip I'm not in school anymore
Sai Prashanth Soundararaj
@salilnavgire Ah, ok :) I'll ping you offline over the weekend anyway. I know NYU has some really cool DL projects/talent. Would love to get some info or some introductions. Cheers!
12
Next
Last