How to download all files from php site (downloadable)
Posted: Sun Nov 18, 2007 10:13 am
I was unable to make up better name for this thread lol.
Its about on how to download ALL downloadable files from some e107, phpnuke etc sites. Well ofcourse not settings, config etc...
legal files.
I had problem with that ..because Website extractors does not extract/download files that doesnt actually have file name.
huh?
It means...if its like this:
site.com/download.php <<< this is the main page for download, but it does not show any downloads (downloads r in database of site)
so the link to downoad would be:
site.com/download.php?id=01
site.com/download.php?id=3223
etc...
I dont know why, but as i said...website extractors does not download those files. maybe its because those downloads does not have extensions.
Anyways...here's what i did:
1. find out how many files this site has ...100? 200? 30000 ? etc...it doesnt have to be exact number. just some number where to start. if theres like 6000 you can take it as 10000. anyways...
2. use passpro to generate 1-4 digit numeric dictionary (0-9999)
3. open that list with notepad++
4. use the macro, to add ''site.com/download.php?id='' before each line
5. save the list
6. use ''free download manager'' to import that list and start downloading those files.
Note:
macro doesnt always work well...you have to make new macro for each xx digits.
for example:
1 digit lines can be made using one macro (paste, down, left)
2 digit lines can be made using another (new) macro (paste, down, left, left)
etc...
if you use one macro, then it will paste the link between numbers and you dont want that.
Just look what you doing lol...dont go crazy putting like ..run macro 1000 times...first try with 3-22 times or something like that...
If you have like 10000 downloads...then you need 4 macros. (for 1 digit numbers, 2, 3 and 4 digit numbers)
...took me about 5 mins to figure it out and make it with 9999 files.
Its about on how to download ALL downloadable files from some e107, phpnuke etc sites. Well ofcourse not settings, config etc...
legal files.
I had problem with that ..because Website extractors does not extract/download files that doesnt actually have file name.
huh?
It means...if its like this:
site.com/download.php <<< this is the main page for download, but it does not show any downloads (downloads r in database of site)
so the link to downoad would be:
site.com/download.php?id=01
site.com/download.php?id=3223
etc...
I dont know why, but as i said...website extractors does not download those files. maybe its because those downloads does not have extensions.
Anyways...here's what i did:
1. find out how many files this site has ...100? 200? 30000 ? etc...it doesnt have to be exact number. just some number where to start. if theres like 6000 you can take it as 10000. anyways...
2. use passpro to generate 1-4 digit numeric dictionary (0-9999)
3. open that list with notepad++
4. use the macro, to add ''site.com/download.php?id='' before each line
5. save the list
6. use ''free download manager'' to import that list and start downloading those files.
Note:
macro doesnt always work well...you have to make new macro for each xx digits.
for example:
1 digit lines can be made using one macro (paste, down, left)
2 digit lines can be made using another (new) macro (paste, down, left, left)
etc...
if you use one macro, then it will paste the link between numbers and you dont want that.
Just look what you doing lol...dont go crazy putting like ..run macro 1000 times...first try with 3-22 times or something like that...
If you have like 10000 downloads...then you need 4 macros. (for 1 digit numbers, 2, 3 and 4 digit numbers)
...took me about 5 mins to figure it out and make it with 9999 files.