Comments on post “Website Downloader”
Christopher Su
@nitrogen · UW CSE. Formerly Google, Msft, Cisco.
So it does "wget -r" for you?
34sharetweet・
H
Henrik Harju
@henrikharju
@nitrogen It's wget with a ton of options and a special twist.
10sharetweet・
Harri Heljala
@harzzn
@henrikharju @nitrogen plus you'll get a preview straight in your browser which is delivered over a fast fiber network
1sharetweet・
jari
@jarizwarts · Frontend @ Oberon.nl
@henrikharju Care enlightening us on what the 'twist' might be?
Not much of an argument...
6sharetweet・
Harri Heljala
@harzzn
@jarizwarts @henrikharju mainly using the right options based on our extensive experience, following redirects and fixing some other shortcomings you might usually run in to
6sharetweet・
Christopher Su
@nitrogen · UW CSE. Formerly Google, Msft, Cisco.
@harzzn @henrikharju does your "fast fiber network" really matter if the download is bottlenecked by the user's bandwidth anyways?
4sharetweet・
Christopher Su
@nitrogen · UW CSE. Formerly Google, Msft, Cisco.
@harzzn @jarizwarts @henrikharju the twist is they get your email
35sharetweet・
Andrei Oprisan
@andreioprisan
@nitrogen @harzzn @jarizwarts @henrikharju the twist is that you get hours of your life back instead of trying to get all the potential corner cases right for simply wanting to download a page in its entirety
8sharetweet・
Hardik Pandya
@hvpandya · Product Designer
@jarizwarts @henrikharju why so much animosity Jari?
6sharetweet・
Roberto Estivill
@roberto_estivill
@nitrogen more like httrack i would say :P
4sharetweet・
Ramesh Padala
@rameshdot0 · Maker of flexbot.ai & yogatailor
@hvpandya @jarizwarts @henrikharju i think i just understood the reason for the "animosity". they are asking for $28 to download a simple webpage.
1sharetweet・
Jan Ahrend
@janahrend · PhD Student, University of Oxford
@andreioprisan @nitrogen @harzzn @jarizwarts @henrikharju
'Corner cases': wget --mirror --convert-links --adjust-extension --page-requisites -U Mozilla --no-parent -e robots=off --wait=3 --random-wait --limit-rate=900k --no-check-certificate https://websitedownloader.io/
3sharetweet・
Tom Redman
@redman · Technical Product Manager, Buffer
@janahrend Like a charm. Thanks.
upvotesharetweet・
Cameron Banowsky
@cbanowsky · hacker
@roberto_estivill @nitrogen httrack is the bomb
upvotesharetweet・