Springfiles

[Licho]

Tbh there is no need to panic yet.

How would I setup new system:
* simple website on main spring server with upload form
* reliable mirroring system (rsync etc instead of current unreliable ftp push)

- this only needs small simple website as Hoiui said - downloader systems only need to know http mirrors and they know it atm through "plasmaserver" which already runs on main spring machine.


What would I do given current circumstances:
* wait for JJ statement regarding possibility of hosting springfiles on main spring server

[Licho]

Also it depends on what mirror providers think.

For example AF explicitly forbids downloader system to use his mirrors. He asked me to remove his mirrors from system.

[Satirik]

it should also support spring tools not just maps and mods

[zwzsg]

• I'd like a system that allows for updates, where I can change the file (including the filename) without changing the link.
• I'd like a system where I can use a simple internet browser to both upload and download files. Integration with other tools is very cool, but it must not be made compulsory on the user.
• Having the bare files is not enough. The minimap, description, many tags that can be used for sorting, and a search box that works, is almost more important than the files themselves.
• Have a website where the browsing is fast.

[TradeMark]

Luckily i have made a site for these kind of problems:

http://mapinfo.adune.nl/
Although, it only lists maps... Maybe i add other files too in future.

http://mapinfo.adune.nl/?N=1&find=deltasiegedry&E=1

Shit, "special" maps are flooding the results...

[AF]

http://www.darkstars.co.uk/forum/topic/ ... cquisition

I will add that I have had other ideas since, and that thread was never completed, as I didn't have time thanks to peet.

Also, I forbid the use of direct linking to the downloader component of the php on my download website. My only requirement is that you link instead to the download page, and not the file itself, but spring downloader failed this requirement.

JJ is also extremely unlikely to hand over his code or run it on any server he is not the sole controller of. He guards his codebase vehemently. An example being the one time he gave me a small section of code for his header, after I suggested he move to CSS. After missapplying my new code, he declared it would never ever ever work, and rolled back. As a side note he did this to the live website, not a test website. It appears he isn't bothered that 70% of each web page served is redundant html markup and cacheable images and other objects.

Since I allowed JJ to host a mirror at darkstars.co.uk, and bypass this requirement by having his own subdomain and account as a gesture of kindness after he complained of bandwidth issues, I'm not so sure I can allow this to continue, especially since my mirror burdens itself with a HUGE proportion of the bandwidth used.

Thus, JJ has 15 days to implement a basic html Index for his mirrors (a 30 minute job), or to pack his bags and leave. If no index is made available on http://jj.darkstars.co.uk, I will personally remove his access and make the mirror free for all to see, regardless of what 'secret sauce' jj has put in there (woohooo, me backing it all up now incase he takes it down ftw!)

In the meantime:

Since I last checked, jj has changed his storage scheme. He now stores files as is just like my site rather than as hashes or numbers. He stores them inside folders labelled cn where n is the number of that category. As such, one could nab all 22GB of JJs file site and dump them elsewhere.

[AF]

Why hello there http://jj.darkstars.co.uk/ooo.htaccess

Order allow,deny
Allow from all
Deny from 64.191.68.69
Deny from unknown-files.net
Deny from ns1.erosdns.com
Deny from ns2.erosdns.com
Deny from ns3.erosdns.com
Deny from ns4.erosdns.com
Deny from ns5.erosdns.com
Deny from ^pipex.com

Blocking a DNS server? An entire ISP? Intentionally blocking other file sites? But this isnt your server! Anticompetitive practices I see!

The htaccess as you can see is now done, apache listings are available. If JJ wants the new password for http://jj.darkstars.co.uk he can pm me, until then, there's 28GB of files ripe for the picking

edit: for some reason a folder called 'maps' was present, but with a htaccess denying anybody from seeing it, hence it not being listed in the apache html listings

[very_bad_soldier]

Downloading from darkstars is a pain for me cause of the poor transfer speeds (below 200kB/s).
Same for evolutionrts (but ok, its on another continent)...
planet-wars and vsync both deliver >1MB/s for me.

[AF]

EvoltuionRTS and darkstars both used shared web hosting at Dreamhosts.

That and I'm in the middle of a 28GB FTP transfer

[TradeMark]

AF, now when you have opened that list of files for everyone, can i link to them directly? Last time you denied that (i already link for your site, but new files arent linkable on your site anymore, only direct download link works from jj.darkstars.co.uk).

I agree to very_bad_soldier though... i get only 50-200 kbps from darkstars

[AF]

I denied because JJs mirror subdomain was JJs mirror subdomain and he would never have agreed to let you link them, and I have my policy over downloads from ym download site

[TradeMark]

i mean, Can i link to these files:
http://jj.darkstars.co.uk/c2/DeltaSiegeDry.sd7

etc

its your site where the data is coming from


So, is it yes or no?

[AF]

For the moment yes, but the contents of that subdomain may change after JJs time runs out (or JJ provides the html index as I requested and thus it then becomes his decision )

[TradeMark]

ok i added your host in the list now
http://mapinfo.adune.nl/?map=1944_Red_Planet

thats okay for you?

[AF]

Thats fine for now

[Kenku]

Luckily i have made a site for these kind of problems:

http://mapinfo.adune.nl/
Although, it only lists maps... Maybe i add other files too in future.

http://mapinfo.adune.nl/?N=1&find=deltasiegedry&E=1

Shit, "special" maps are flooding the results...

Yea, special is really a case in which updating the old link would work. Note although none of them are the up to date mod. The current version of Senna's Mod Map is Delta Seige Morph V1.1, so the specials are kinda unneeded.

[Forboding Angel]

Why prevent SD from direct linking?

[Licho]

Who owns vsync2?
PlanetWars is main spring server - it just uses different domain, because springrts.com domain owner does not want illegal stuff on his domain.

[jj]

AF, First,
The only thing you accomplish is that new files aren't uploaded to your mirror since you change the ftp access credentials.

Second, Your statements are all lies.
I've never denied public access to your mirror and it is all in your hands.
You have never requested me to build an index for your mirror (why can't you do that yourself instead?).
Third, you don't know the underlying reason of the rows in that 2 year old ht-access file.

Now something constructive. Today i'm coding the new mirror system. The current isnt very reliable and it isnt uploading new versions of files to mirrors. I also think that it is important to let people administrating their own mirror servers / add new ones at springfiles so the mirror system would be more dynamic with a greater quantity.
I also want to make the mirror system database feeded, regulary updated with a cron job instead of the current on-the-fly mirror file checking. I have no problems of making this mirror database publicly available is some way.

[det]

Why dont you use rsync for mirrors?