Page 1 of 1
Howto: Download 814 maps for Spring with easily.
Posted: 20 Mar 2008, 16:43
by Vadi
This'll download 814 maps from the evolutionrts.info server for ya. They said they got lots of bandwidth and don't mind. So, just copy/paste the whole thing below into the terminal, and leave it overnight (make sure you have enough disk space tho!)
Lo and behold the power of the terminal, as it'll start downloading everything for you. Note that if you'll need to stop the downloading, copy/pasting the same command again will work - it'll skip over the already downloaded files.
Have fun!
Edited: Thanks to bibim and lurker for providing a much shorter version!
Re: Howto: Download 814 maps for Spring with easily.
Posted: 20 Mar 2008, 18:34
by bibim
lol, what about just making a script such as this one:
Code: Select all
#!/usr/bin/perl -w
use strict;
my $baseUrl="http://evolutionrts.info/maps";
chdir("$ENV{HOME}/.spring/maps");
system("wget $baseUrl -O springMapIndex.html");
if(! open(INDEX,"<springMapIndex.html")) {
print "ERROR - Unable to retrieve map list\n";
exit;
}
while(<INDEX>) {
system("wget -nc $baseUrl/$1") if(/<a href="([^\;]+\.sd7)">/);
}
close(INDEX);
unlink("springMapIndex.html");
Re: Howto: Download 814 maps for Spring with easily.
Posted: 20 Mar 2008, 19:09
by lurker
wget -c -np -r
http://evolutionrts.info/maps should do the trick.
Re: Howto: Download 814 maps for Spring with easily.
Posted: 20 Mar 2008, 19:14
by Vadi
Smart people use that... dumb people copy links from firefox, replace http with wget -nc http, and paste!
Re: Howto: Download 814 maps for Spring with easily.
Posted: 20 Mar 2008, 20:21
by HAARP
for i in ...
Re: Howto: Download 814 maps for Spring with easily.
Posted: 20 Mar 2008, 22:22
by Vadi
Your command does work, but it's sorta ignoring the maps with the same name that I downloaded before
Re: Howto: Download 814 maps for Spring with easily.
Posted: 21 Mar 2008, 00:38
by LordMatt
Re: Howto: Download 814 maps for Spring with easily.
Posted: 21 Mar 2008, 09:54
by bibim
Actually this also downloads all unwanted files such as indexes for each possible sort ("index.html?C=D;O=A" etc...). But I agree, in this case these files are really lighweight in regard to all maps
It's possible to filter them easily however (and remove automatic directory creation as well):
Code: Select all
wget -c -np -nd -A sd7,sdz -r http://evolutionrts.info/maps
btw, it seems the "maps" directory of evolutionrts.info also contains mods ("BA6.1.sd7" for example)
Re: Howto: Download 814 maps for Spring with easily.
Posted: 21 Mar 2008, 17:42
by Vadi
Thanks bibim!
Re: Howto: Download 814 maps for Spring with easily.
Posted: 21 Mar 2008, 20:04
by lurker
bibim wrote:btw, it seems the "maps" directory of evolutionrts.info also contains mods ("BA6.1.sd7" for example)
That would be AF's site's fault, as I grabbed a lot of these from his map folder.
Re: Howto: Download 814 maps for Spring with easily.
Posted: 21 Mar 2008, 23:58
by bibim
Vadi wrote:Edited: Thanks to bibim for providing a much shorter version!
Well, tbh I just improved slightly lurker's version, he deserves the credits
Re: Howto: Download 814 maps for Spring with easily.
Posted: 22 Mar 2008, 20:50
by Radtoo
Most users will presumably feel more happy with
http://www.downthemall.net/ and firefox.
Not to downplay the merit of having a command line script, too, just mentioning an alternative to it. :)
Re: Howto: Download 814 maps for Spring with easily.
Posted: 22 Mar 2008, 21:37
by Vadi
Know that one... but you'd have to click on every single map, no?
Re: Howto: Download 814 maps for Spring with easily.
Posted: 28 Mar 2008, 17:35
by Radtoo
Know that one... but you'd have to click on every single map, no?
No. You can download everything in one batch.
Right-click anywhere on that webpage except on a link, choose downthemall, mark topmost map to lowest map (shift-select), rightclick and say check selected items, download.
You could also download the maps by extension (adding an extension filter is the same as selecting them in the list, it just does the checkboxes at one point), or simply every item availiable (not too much overhead anyways ;P).
Re: Howto: Download 814 maps for Spring with easily.
Posted: 28 Mar 2008, 18:39
by Vadi
I see.
The only prob is that I don't keep firefox open everytime, while a terminal window somewhere on my other side of the cube won't take up much visual space / memory.
Re: Howto: Download 814 maps for Spring with easily.
Posted: 23 Dec 2008, 00:55
by morphriz
Try
Code: Select all
wget -c -np -nd -nc -A sd7,sdz -r http://evolutionrts.info/maps
Will skip maps you allready have..
Re: Howto: Download 814 maps for Spring with easily.
Posted: 23 Dec 2008, 15:18
by Caradhras
How much space do all the maps use?
Re: Howto: Download 814 maps for Spring with easily.
Posted: 23 Dec 2008, 17:37
by Vadi
8.5GB
(If anyone wants to repeat this later, use the [^.]*\.\w+\s+([.0-9]*).* regex to get the size (yeah, it fails on maps with dots, feel free to suggest a better one) and then just paste them into qalculate)