SpringDownloader - maps/mods/widgets/lobby - Page 4

SpringDownloader - maps/mods/widgets/lobby

Various things about Spring that do not fit in any of the other forums listed below, including forum rules.

Moderator: Moderators

User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

CaDownloader 2.6.0.
- added segmented web mirror downloads
- added all known sites as mirror sources (configurable in xml on server)
- results in massively improved web mirror downloads speeds (maxes my 8mbit conn)
- hopefully fixed random CaTracker 100% CPU bug


Cadownloader starts torrent download mode firsts, but if mirror data arrive from central server, it stops it and starts segemented web download instead.
It uses as many segments as is the number of mirrors. Mirror order is also randomized.

Mirror discovery/check (which happens on server) is relatively time-consuming process (it has to check its correct map version etc) so data are cached there for 4 hours.
User avatar
IOU
Posts: 7
Joined: 21 Feb 2008, 00:35

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by IOU »

Will this eventually be bundled with the main Spring installer?
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Yes.

That reminds me I also added automatic otacontent download if you are missing it, and optional teamspeak (integrated with game).

And also asks user to upload spring errors to central server after game with errors.
User avatar
IOU
Posts: 7
Joined: 21 Feb 2008, 00:35

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by IOU »

i take it, that this is still incompatable with Linux ? (Well i could never get Mono to run it)
User avatar
AF
AI Developer
Posts: 20687
Joined: 14 Sep 2004, 11:32

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by AF »

CADownloader <->lobby interface?
User avatar
BrainDamage
Lobby Developer
Posts: 1164
Joined: 25 Sep 2006, 13:56

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by BrainDamage »

IOU wrote:i take it, that this is still incompatable with Linux ? (Well i could never get Mono to run it)
SpringLobby has a downloader integrated now which interface to CA's system, also supports teamspeak, to enable compile using the flag ./configure --enable-torrent-system
User avatar
IOU
Posts: 7
Joined: 21 Feb 2008, 00:35

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by IOU »

well that just rocks my socks off. Are there any pre-compiled deb's that have this flag enabled? I dont mind compiling if it doesnt, Im just lazy :lol:
User avatar
BrainDamage
Lobby Developer
Posts: 1164
Joined: 25 Sep 2006, 13:56

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by BrainDamage »

IOU wrote:well that just rocks my socks off. Are there any pre-compiled deb's that have this flag enabled? I dont mind compiling if it doesnt, Im just lazy :lol:
i asked yokozar, the debs are not ready yet, either you wait or either you can build yourself if you don't have patience :wink:
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

AF - interface really is next on my todo :)

As for linux compatibility - you dont need it for non-CA purposes now thanks to springlobby.
But downloader runs under mono on linux now, only p2p/torrents stuff works though. Download of CA itselfs stops at 3.7% for unexplained reasons..

If any linux user wants to try to fix it, let me know. Sources are here
svn://svn.caspring.org/trunk/tools/CaUpdater
You can compile binaries even on windows and then gdb "mono CaDownloader.exe" on linux.
User avatar
IOU
Posts: 7
Joined: 21 Feb 2008, 00:35

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by IOU »

I asked a while ago, but i'll ask again, need any backup trackers? I'm still happy to host one
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Thx for the offer.. backup trackers are not needed atm, I have 2 hot backups ready.
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Downloader upgraded to 0.98
Webseeding now working - that means BOTH websites and torrents are used for downloads.
This should speed things up considerably.

Also if you have unregistered files downloader pops up dialog asking you to register them and registering is background cancellable task.


Few notes:
- it still takes couple of seconds before download starts, because server has to check for web mirrors (they are cached only for few hours to keep them up-to-date)

- you can check what web mirrors are discovered by !maplink and !modlink on springie (it uses same system as springdownloader)

- if you want to share some new mod/map and want to ensure as fast downloads as possible, upload to as many spring related sites as possible.

These sites are used as mirrors:
http://www.darkstars.co.uk/downloads/vi ... le=spring/%t/%f
http://www.tasdownloads.com/uploads/%t/%f
http://www.evolutionrts.info/%t/%f
http://spring.vsync.de/2/%f
http://www.ta-spring.com/%t/%f
http://www.fileuniverse.com/spring/%t/%f

+ jobjol mirrors but not jobjol itself and not unknown files.

If you want to server as a mirror, let me know ... its enough to keep maps/mods in simple web folder to work as a mirror.
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Webseeding is still buggy, reverting to 0.97.0.3
User avatar
AF
AI Developer
Posts: 20687
Joined: 14 Sep 2004, 11:32

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by AF »

I seem to remember a huge fiasco over these kinds of automated downloads and fileuniverse back when tasclinet had betalord auto-downloading maps like your spring downloader does. They started demanding adverts in tasclient to pay for their bandwidth and we refused so they demanded all spring maps move off of file universe.
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

SD 0.98.0.3
- webseeding enabled again
- upload torrents dialog now contains "all" button and appears max once per SD start (on start if you already have new mod/map or when map/mod is added to spring folder)
- tracker mirror discovery improved (permanent cache + faster mirror checking)
- widget manager was accidentally turned off - reenabled now
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Central tracker now forbids reigstriation of duplicated names - this should fix desync problems. Its a temporary fix until lobbies switch to new hash. Newly registered torrent replaces the old one if names match.

Also, webseeding SD is still undeployed due to some remaining problems.
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Downloader upgraded to 0.98.0.3 now for real.

- downloads much faster - no more separated web and torrent methods - shows webmirror links in log for check
- torrent uploading now runs as background process and downloader auto asks to register new files
- some improvements to very_bad_soldier's widget module

Note: if some file keeps downloading past 100%, please report to Masure or me - it indicates incorrect torrent that has to be removed from server.
User avatar
zwzsg
Kernel Panic Co-Developer
Posts: 7049
Joined: 16 Nov 2004, 13:08

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by zwzsg »

The registery is not anymore how to enable LuaUI.
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Updated to 0.98.0.4

* SD can now start even if UnitSync fails to initialize (problem for some vista64/windows 7 users) - in that case it wont seed but will be able to download. If you cannot start SD for selfupdate, get it from here: http://files.caspring.org/caupdater/Spr ... loader.exe

* when regisering new file that has same name/content as existing file, but different spring hash, server asks all connected clients for new hash and allows only if its majority hash (this will prevent bugs where people register maps/mods with faulty hashes and autohosts use them - all people then appear desynced)

* fixed bug where sometimes download wont end

* fixed bug where sometimes progress bar cycles 2 states (completed and downloaded)
User avatar
Licho
Zero-K Developer
Posts: 3803
Joined: 19 May 2006, 19:13

Re: SpringDownloader - automatic map discovery and P2P mod/map

Post by Licho »

Downloader upgraded to 0.99.0.0

Contains new missions module with single player/coop missions.
Post Reply

Return to “General Discussion”