Preventing UF disaster mkII

[AF]

We now have god knows how many file sites, hwever this is a false sense of security.

I've noticed many people have started reverting to using a single site for uploads. Ordinary users are downloading from all sites but theyre being guided towards certain sites because modders and mappers are only uploading to one site, and at the moment theyre starting to converge on JJs site.

Should JJs site go down or run out of bandwidth your all buggered. Its as simple as that. Upload to ALL the sites if possible or at least 2 or 3.

I know darkstars has masses of bandwidth unsed and its linked from other file sites as a mirror, yet uploads there have almost stopped completely without explanation. Nobody has reported that my upload script is broken either, and Ive tested it and shown it works, so its not a technical issue.

[Peet]

The optimal solution would really be for the sites to synchronize to each other in a circular manner, though this would be a major pain without a standardized file structure.

[Gota]

This was discussed tons of times before,and I remmber some websites were synchronizing.

[Tribulexrenamed]

AF, make a script that rips all the files on the other sites onto your site.

[SwiftSpear]

Or write an autoupload system that uploads simultaneously to multiple sites redundantly.

[el_matarife]

I suggest making a full site backup available via torrent once a month. Also, the file sites should back up to one another even if that means just dumping the full list of files in a private directory as long as there's space.

[Saktoth]

This is not a huge problem. UF's final death was one of the best things to happen to spring filehosting in ages. It was going up and down, leaving no way to get maps from the lobby for months at a time and generally being a pain in the butt, with no real feature development. All kudos to imacup for hosting files for us for that long, but once it finally did go down half a dozen hydra heads popped up to fill its place- something that couldnt happen while it was still lingering around.

From these, JJ's was picked because, quite simply, it is the most fully featured (more than UF ever was).

If it goes down, im sure the spring community will be able to handle it and migrate elsewhere (perhaps to an even better site).

All that being said, by all means, create synchronized upload scripts etc, it sounds like a good idea.

[Argh]

I would use a centralized upload location, if one existed, and could handle very large uploads, i.e., over the typical 128MB barrier.

[Peet]

I would use a centralized upload location, if one existed, and could handle very large uploads, i.e., over the typical 128MB barrier.

The whole point is to not be centralized

[Argh]

Sorry, I meant a central page with a script that would start uploads to each site in turn, including some common format stuff, like the name and a text description- just a script to simplify things and save people time.

The way I envision it, I could click a button, browse for the files for P.U.R.E., then walk away for a few hours, waiting for it to finish, instead of wasting an hour going into each 'site, putting in the same darn information, etc. I'd use it.

[AF]

I tried, everybody is uploading to JJs site and JJs site wont let you steal the files like other sites. Id just end up with a lot of download.php_1 _2 _3 etc files in my mods folder with error message html inside them.

Also shared hosting packages rarely allow torrenting fo any kind to be hosted on them. Running a torrent client in a shell to download or running a torrent tracker is usually a bannable offence.

And I am unaware of any synchronizing system. Some hosts have 'mirrors' but even that system could fall apart if people continue to focus exclusively on JJs site.

At the moment JJ has the advantage of stealing Trademarks code, and Trademark refusing to give out that code or write any more of it, and JJ refusing to share any of it. Did nobody wonder why JJs site had all the stats for mods and the others did not?

[jj]

At the moment JJ has the advantage of stealing Trademarks code

what code? explain.

and JJ refusing to share any of it

the site is all about sharing things, AF...
btw, i will give 100% of the code to the community when i stop serving...

[AF]

Trademark wrote code to open up and look inside maps and mods and take out things like mini maps and statistics and things like map sizes and stuff.

He then complained that you'd stolen all his code and being mightily pissed off by it refused to write any more code for anyone unless it was his own private file host, but he didn't have the means to host such a file host by himself so he moved on.

To date nobody has released any php code showing how to do what that code does or any of the code trademark uses.

[jj]

i dont use his code, but satiriks one. its available to everyone at my site.
http://spring.jobjol.nl/show_file.php?id=921

[Vadi]

going around uploading to multiple sites would be painful

[FLOZi]

I think most would agree that Argh's vision of centralised uploading, decentralised downloading would be the ideal.

[Warlord Zsinj]

Yeah, centralised uploading is ideal.

I think it should be run from spring.clan-sy.com

TBH it'd be ideal if even the search function was run from this website, with links or just download mirrors to the other sites. That way we can hook the lobby to a reliable website (spring.clan-sy.com) when using the lobby's inbuilt 'find me this map or mod' function. Also, it means that we can have filehosting sites come and go, while spring.clan-sy.com is likely to stick around for a while - if it goes down for good, the lifesigns for spring as a whole are probably pretty bad anyway.

Also, UF going down was not the best thing - remember how screwed SWS was at the time - we had just had an article published in a magazine leading to our site which was hosted on UF.

[[Krogoth86]]

Upload to ALL the sites if possible or at least 2 or 3.

Well I'd like to upload to darkstars but even with the new upload function it doesn't work for me with MA. Still the same problem that nothing happens after the upload is finished...

[Licho]

Well maps and mods are relatively safe because of client distributed p2p system (cadownloader/springlobby).
Tracker for the system is freely availiable, has 2 backups and can run on any home/adsl pc.

[Licho]

You could also use p2p system for mirroring.
- fetch file list from here http://tracker.caspring.org/torrents.txt or connect to it and it sends you info about all maps and mods it knows
- then connect to p2p coordinator and send it need file request - in few seconds it will respond with list of working http mirrors for that file