@diego_iglesias The desktop client is currently available for Windows only. But you can use the chrome app at-least to test the feature and signup on website to get a notification when we launch for OS X(Soon). Also, there are some workaround available to use in the meantime http://www.howtogeek.com/187359/... (we are also using theses for testing in development)
@talkaboutdesign@diego_iglesias Desktop app is required to run .scraping script. Coming soon : Run in Cloud using web platform, REST API or the Mobile app
@evanlodge Kimono is just a light scraping tool
Kimono can't extract data form local HTML files, Kimono can’t extract data form JSON, XML data sources locally or from WEB, Kimono can't accept more than 10k input URLs in an API, Kimono can't switch the user agent, Proxy for anonymous website scraping, Kimono can’t give you website source code, network tree, HTTP status etc. for error handling, You can’t crawl multiple website using one API (Check dynamic input feature http://www.datascraping.co/doc/3... ), Kimono can’t be scheduled at a specific time/interval. For e.g. run at 8am on Monday and 6pm on Friday and lots more. You can’t use stand alone REGEX parser for advance mode (see it in action here : http://www.datascraping.co/doc/2...) and many more problem in scraping tools right now (not just in Kimono, instead most of them) solved or will be solved in Data Scraping Studio. (You can also see some pain point posted by a user here: http://www.datascraping.co/doc/q... )
And most importantly the potential business risk, if a targeted website blocked their User-agent or blacklisted their server IP address you won’t be able to crawl that website. For example if they have 100 users crawling 1000 pages every day from eBay. Which means their server is sending 100k traffic to eBay every day and eBay team can easily detect the BOT traffic (coming to site, no add to cart, no purchase) and can get block anytime. Will result you will be failed to access the data.
By installing Data Scraping Studio on a windows server, you can make your own Kimono++ ( Be the owner :)
Report
@vikashrathee@evanlodge Ye, kimono is pretty basic tool, not something for serious SEOs or growth fellers - more like "quick in and out" kind of thing. However, as you talked about JSON, does this mean it has no problem with lazy loading and comparable?
@andmitsch@evanlodge Not just that, you won't be able to crawl many website using Kimono. For example try PriceTree - http://www.kimonolabs.com/load?u... You will get an error. (Sorry, can't kimonify - Screenshot ) . So potential business risk to get a NOT ABLE TO CRAWL anytime.
It looks very interesting. It's always a tedious job to create a scraper.
If you could make this in a way, that the desktop client is not a necessity but you could directly convert it into a web API, this could be the best tool ever ;-)
@ernstmul Thanks Ernst for the suggestion. Yes agreed! We are working on it and will probably launch the web application with REST API by July, 16 . Once launched, you'd be able to scrape data on cloud using the web platform and the mobile app. Thanks again!
Report
@vikashrathee that seems even more useful than a Mac app - run from chrome and extract to google sheets
@passingnotes@ernstmul Thanks David for the suggestion, you will see this and more creative features coming soon to automate the data collection process.
An easy and powerful suite of website scraping. Just point and click element selectors Chrome app to create web scraping agent with instant extracted data preview. And then use the desktop app for advance features like batch crawling, scheduling, multiple website scraping simultaneously and more for FREE
This is definitely one of the better scraping tools I have found and the integration within Chrome works well. Sort of useless for me though without an OS X version.... signed up for the newsletter.... hoping to see something on this soon.
@the_scott_davis Sure Scott, will send an email to you(everyone) when it's released. You can also get in touch with sales, if Data As a Service interest you!
@ahmed_fahad_ Agreed Ahmed! And we are already working on it and will launch the REST API soon. Please subscribe on website to get notification when it's released.
@blainehatab I also loved Kimono and many others but the problem is when you need this for business. There was 100 or 1000 of issues when we started to use them for our price comparison website http://www.pricetree.com . So decided to solve them all together and make one for the world.
@narekk Thanks Narek for the heads-up, Any reference link or tutorial we can post on our website to help Apple fans :)
Report
@vikashrathee Hi, your product is very interesting, I hope you have the OSX version really soon to be able to test it. Question: You offer the software for free, what's your business model (if you have one) or why is it free?
@jhuerta88 thanks Jorge, we have not decided the business modal yet(May be next year, at-least for Enterprises). And the focus is on acquiring the market share/user base. We want everyone to test the awesomeness and most scale-able software of web scraping and use it without any fee, contract or commitment. It's helping us on feedback as well to work on the area of improvements without any pressure.
We are making SQL of web, and have enough patience to launch the business modal :)
Report
I'm wondering: can you extract CSS settings for animations on a site?
@ramtorn I guess you mean to extract inline style attribute? Yes, you can extract using any parser(CSS selector or REGEX). See some example here http://www.datascraping.co/doc/3...
Replies
Markdown Editor For Notion Lovers
idm.in
Widgetly
idm.in
Higherme
idm.in
idm.in
Appwrite
idm.in
idm.in
idm.in
Sandbox VR
idm.in
Wind
idm.in
idm.in
1Degree
idm.in
idm.in
idm.in