New downloading system

New downloading system

Discuss the source code and development of Spring Engine in general from a technical point of view. Patches go here too.

Moderators: Moderators, Moderators

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

New downloading system

Post by Licho »

Lobbies can use this service:

http://planet-wars.eu/PlasmaServer/Service.asmx

To get information about known resources, including hashes, metadata, map images etc.

To download a map or mod you just call
http://planet-wars.eu/PlasmaServer/Serv ... wnloadFile

you will receive:
- list of dependencies
- list of webmirrors to use for torrent download
- torrent file (to check for integrity)

You can download file directly from webmirrors but be sure to spread load and its unsafe since you wont check file integrity properly until completely downloaded.

Resources minimaps and metadata are available for direct download from:
http://planet-wars.eu/PlasmaServer/Resources/

Possible uses:
* lobby that reliably downloads stuff you need to play :)
* lobby that shows minimaps for map you dont have yet
* lobby that allows you to join mod you dont have and view its metadata (modoptions)
* lobby or autohost that allows you to host any mod or map without having it on disk


System actually exists for long time, it was meant mainly for winter project (now on hold).

Resources will be added to the system by mirroring jobjol and by webform upload.

Springdownloader will be changed to use this new system (along with package-pool system for mods that support it).
Springie will be adapted for this too in the future.
0 x

YokoZar
Posts: 883
Joined: 15 Jul 2007, 22:02

Re: New downloading system

Post by YokoZar »

How does this differ from Springlobby's current torrent implementation?

Sounds awesome though :)
0 x

User avatar
koshi
Lobby Developer
Posts: 1058
Joined: 14 Aug 2007, 16:15

Re: New downloading system

Post by koshi »

YokoZar wrote:How does this differ from Springlobby's current torrent implementation?
It will work when we're done implementing it...
This new system is a replacement for the old one. You might have noticed the old torrent tracker being offline for a while
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: New downloading system

Post by Licho »

There is also related engine supported "pool" system which provides extremely efficient incremental updating of mods.
SD implements this too and afaik SpringLobby has code for it for about a year just not enabled :(
0 x

User avatar
koshi
Lobby Developer
Posts: 1058
Joined: 14 Aug 2007, 16:15

Re: New downloading system

Post by koshi »

Is noticing new resources from jobjol fully automatic (now)?
How about the webform?
0 x

jeykey
Posts: 136
Joined: 28 May 2009, 16:24

Re: New downloading system

Post by jeykey »

sounds great... this will solve some inconveniences
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: New downloading system

Post by Licho »

Webform is currently in working.

There will be special webform for package system.

Because you have to register user and "tag" for the mod and only allow authorized updates of given tag.

Det is in charge of this development and I guess CarRepairer will actually code it.

And jobjol stuff isnt automatically processed yet, i still dont have full copy of jobjol :(
But each spingdownloader auto detects new content instantly and sends metadata from it to server.
0 x

User avatar
AF
AI Developer
Posts: 20671
Joined: 14 Sep 2004, 11:32

Re: New downloading system

Post by AF »

web form?

Also, theres always the darkstars mirror and filesite....
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: New downloading system

Post by Licho »

Yeah but mirrors are incomplete. Most files are on springfiles.
0 x

User avatar
koshi
Lobby Developer
Posts: 1058
Joined: 14 Aug 2007, 16:15

Re: New downloading system

Post by koshi »

Can we get file size in resourcelist ResourceData elements please?
Also is that filtered for actually available already? IIRC you wanted to change that.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: New downloading system

Post by Licho »

Nope, because resource has varied size.
One resource can have different file representations.

It can exist as multiple different archives each with different md5 hash and size.
Or even completely different format (sdp).

I recommend you just interface with springdownloader, it works fine on linux its tested and has working pool package download mode too.

Image

It will save time both to you and to me and make further improvements much easier.
0 x

User avatar
Forboding Angel
Evolution RTS Developer
Posts: 14630
Joined: 17 Nov 2005, 02:43

Re: New downloading system

Post by Forboding Angel »

Not a good idea. Many of us specifically object to having SD open. I specifically hated it when tasclient tried to interface with SD and TS. Annoyed me to no end.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: New downloading system

Post by Licho »

1) who said you need to keep it open?

2) how is it different from having lobby open? Tasclient starts it and stops it along with itself.

3) who cares what annoys you? You are annoyed by lots of things. Being annoyed isnt a reason.
0 x

User avatar
AF
AI Developer
Posts: 20671
Joined: 14 Sep 2004, 11:32

Re: New downloading system

Post by AF »

Because it means a larger user base for you, more capacity, and more weight behind your words when talking about development stuff since your stuff is proven to work by popular demand.
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: New downloading system

Post by Licho »

Positive voices are never heard nor visible, you just see complainers in forums..
0 x

User avatar
AF
AI Developer
Posts: 20671
Joined: 14 Sep 2004, 11:32

Re: New downloading system

Post by AF »

Thats because people don't like to throw yay licho or yay AF forum parties, instead they just take your word when you say stuff instead of thinking your a weird maniac person.

A happy populace will use your wares, do as you say, and get on with things, while secretly singing your praises.

An unhappy populace will scream murder and hassle you until someone makes a rival project and they declare its the best thing since sliced bread!
0 x

User avatar
Agon
Posts: 527
Joined: 16 May 2007, 18:33

Re: New downloading system

Post by Agon »

Licho is doing a very great job for this community by spending lots of time and money.
The downloading system is awesome by the way.

... enough positive words, could you add a description to each download.
Eg. I dont know what mod pa is :S .
0 x

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: New downloading system

Post by Licho »

Thanks :)

We will have to ask det to add some descriptions to his package system.

I also wondered what pa is when it appeared there, it's PRO annihilation apparently :)
0 x

User avatar
hoijui
Former Engine Dev
Posts: 4342
Joined: 22 Sep 2007, 09:51

Re: New downloading system

Post by hoijui »

yeah.. thanks for this, licho :-)
the only objection i have is that it is .net/needs mono, but well.. thats more of a childish objection, and i will overcome it.
in contrary to this, i would like it a lot if both(all) lobbies could use the same downloader (as long as it works/is well maintained), and it works on all the OSs. so yeah.. good thing, thanks! :-)
it seems to work well (tested on windows only). i would like the widgets downloader to get a bit more comfortable, eg:
  • allow downloading multiple widgets at once
  • when the list gets actualized (eg. when downloading a widget finnished), reset the position to the previous one, instead of showing position 0 in the list
  • maybe remove some outdated widgets (thinking on the multiple transporter widgets eg.)
  • allow tagging widgets, for example: grapic, functional, important, must-have (eg CustomFormations2)
minor things.. not such a big issue, as usually you dont do much widgets fiddling except after a fresh install, could be usefull for noobs though.
0 x

Auswaschbar
Spring Developer
Posts: 1254
Joined: 24 Jun 2007, 08:34

Re: New downloading system

Post by Auswaschbar »

Having 30 megs of additional libraries to download, install, and load every run is valid con imho.
0 x

Post Reply

Return to “Engine”