Mass downloading a set of URLs with login

Question

Possible Duplicate:
How can I download an entire website

I'm looking a mass-downloader to help me download the entire database from a site I have an account on. The requirements are simple:

1. Login using my user and password (form-based login)
2. Download all URLs of the form "http://site.com/ID", where ID is less than 1000.

What should I use?

Answer 1

GetGo Download Manager seems to do that:

You can easily set up a Batch Download that not only downloads a large list of files using an URL pattern template, but also automatically renames downloaded files using a filename pattern template.

Answer 2

I strictly recommend NeoDownloader. I've been using it for years.

It downloads from password protected sites and supports downloading URL ranges.

Answer 3

Try Orbit Downloader. MANY options available with that.

Answer 4

I have had good luck with Offline Explorer. Allows you to access password protected pages and has lots of advanced options.

Answer 5

You can do this with wget, and possibly a very simple script (depending on how the site is set up).

Answer 6

HTTRACK works like a champ for copying the contents of an entire site. This tool can even grab the pieces needed to make a website with active code content work offline.