Joined: 25 Feb 2005, 03:21 Location: Czech Republic
Following post cover TAS Maps and Objects3D compression test to show difference between 7-Zip , RAR, ZIP and once ACE compression ratios:
Changelog:
- updated to match latest GOW build v2
- fixed little bug (left two files generated from TAS in redhaven_01)
- added compression result of HAPI content
- added metalheck/metalheck2 and prime core maps
- added ACE selfextracting value of altored_mars (bad result anyway :)
Summary: Unbeatable winner for TAS maps and Objects3D is Opensource 7-zip http://www.7-zip.org Compressing times (approx 3 times longer than RAR) don't matter as for distributing files is priority smallest possible size and fast decompression time ... and these key elements 7-zip meets.
Suggestion to map makers, mod makers and so on please use it!
You lower overall bandwidth demand at servers and notable reduce times needed to download Your work!.
Test system: AMD 3800+, 1GB DDR466, SATA strip raid
Settings: For RAR and ZIP was used WinRAR set to maximal compression, no recovery record, solid archive type, self extracting
For 7-zip was used 7z format , LZMA compression, dictionary size 16MB , word size 96 , solid archive type, selfextracting
Results: sizes are in bytes
Complete set of all custom maps released till now:
Each 7-zip archive can be downloaded from following mirror
You can extract them directly to TAS main directory or rename to *.exe and use self extracting feature.
7 zip seems like a nice format, if someone want to integrate it into the CFilehandler so that it get supported the same way as the hpi formats it would be nice.
Yes, 7 zip probably gives better compression than zip and rar. Does that mean we should abandon at once .zip? I don't think so. Compression ratio isn't the only think to consider when realeasing an archive for everybody to download.
Nowadays, every (or let's say 99%) PC that is able to run Spring can handle zip. It's even been integrated in some newest Microsoft Windows Operatation system file manager (not that I like MS or that particular feature). So everyone know what a .zip is and know how to handle them. .rar aren't that common, but it's also years old and was used by many, so it's not as user-friendly as .zip but still not that bad.
7z on the other hand I think I never saw. And I'm probably not the only one. So if see an archive ending in 7s and my usual file archive can't handle it, I'll probably wonder what is it, then leave for later (later as in never).
Ok, the renaming into .exe to get a self extracting sorta beat me, but I can still counter that argument saying that I would have to know it before taking advantage of that property (most people who will one day or later download a spring map won't have read your thread first), and also by claiming I hate self extractible zip because I'm paranoid about .exe
So, the point I was trying to make, was that althought formats with better compression exist, it makes sense to use not the one with the best compression rate but the one most widespread instead.
Also, I'll tell you to compare not only the size of each compression format for a given map, but also the size of each map for a given archive format.: Map filesizes varies from 1 to 25. So incomparably more space can be saved by asking the map makers to do good job than by annoying the end-user with exotic archive formats.
@zwzsg People who don't do edditing, normal user don't have to open 7zip.
And I hope every model, map make have sufficent knowledge to install a small compression program.
I'm for 7-zip too because I really fear to have a 5go Spring folder...
If Dwarden test is correct (http://taspring.clan-sy.com/phpbb/viewtopic.php?t=843) I would really apreciate to have a 40% better compression on my map folder.
I am thinking seriously about implimenting the 7z compression into a new HPI file structure. We don't need to use the entire 7z file system to use the 7z compression.
Gimme a couple weeks, I'll have it all nailed down.
Joined: 16 Oct 2004, 18:40 Location: I still have more posts than you.
There's also the matter of 7zip using a _LOT_ of system memory. According to my setup compiler, the LZMA method that 7zip uses has the following approximate memory usage:
Decompression Compression
fast 3 MB 3 MB
normal 4 MB 27 MB
max 10 MB 84 MB
ultra 34 MB 369 MB
Joined: 25 Feb 2005, 03:21 Location: Czech Republic
Caydr wrote:
There's also the matter of 7zip using a _LOT_ of system memory. According to my setup compiler, the LZMA method that 7zip uses has the following approximate memory usage:
Decompression Compression fast 3 MB 3 MB normal 4 MB 27 MB max 10 MB 84 MB ultra 34 MB 369 MB
(sorry about the formatting...)
memory usage in 7-zip is affected by compression method and mainly dictionary size!!!
optimal values are use dictionary 1MB and 96 Word ... 7z format, Ultra compression level and LZMA method ...
using these values mean You will need only 75MB for compression and 3MB for decompression ...
using higher dictionary size needs more ram both for Compression and decompression !
and it will only change to compression is maximally by 1-3% ...
using 2-16MB dictionary can come handy when you compressing 100k + files ... but again this need bit of testing as it vary by archived file content used ...
word size, that could vary but usually 96 produced best result for compression ratio ... using lower valeus was resulting into noticeably worse ratio and higher value was from 1% better to 1% worse result ... so i used for test 96 ...
i think following table in 7zhelp can give tips and help understanding how choose best one as it contains memory needed, speeds and so on (you need scroll 1 page down) ...
http://3web.dkm.cz/myie2cz/tas/7ziphelp.htm
Users browsing this forum: No registered users and 0 guests
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot post attachments in this forum