LZMA (7zip) should be used for data package: 150MB smaller

Developer discussion of experimental fixes, changes, and improvements.

Moderators: Nexuiz Moderators, Moderators

Postby tundramagi » Fri Apr 24, 2009 5:41 pm

Load times in nexuiz are pretty long as is, it would be uncool if they were longer. There has been alot of work by divverent to cut down load times (particularly on the server) and this idea of using a dog-slow compression scheme to gain a one time advantage and a persistant curse would nullify all that work (not loading light maps on server, capping bot waypoint load times, and caching bot waypoints once loaded etc).

On all my machines, no matter how fast, loading nexuiz maps is SLOW (but faster than last release by far). Other games (like urbanterror) load pretty fast in comparison. We need faster load times, not slower!

(This message has been brought to you by the council for american justice, all rights reserved)
tundramagi
Forum addon
 
Posts: 974
Joined: Sun Jan 04, 2009 4:53 pm

Postby mand1nga » Fri Apr 24, 2009 6:48 pm

When using bots in Nexuiz 2.5 the startup times are rather long on some open maps like silvercity. This has been improved already by caching "walkable" bot paths (using plain text files). This will be available on the next release.
mand1nga
Alien trapper
 
Posts: 321
Joined: Mon May 12, 2008 12:19 am

Postby Ed » Sun Apr 26, 2009 9:00 am

+1 to everything Div said. LZMA = more CPU, more RAM to decompress. The more brutal you are at compressing it, the longer and more costly it is to decompress. This is not how ZIP works where the longer you take compressing it, in general the longer you take compressing, the quicker it is decompressing.
Ed
Forum addon
 
Posts: 1172
Joined: Wed Mar 01, 2006 12:32 am
Location: UK

Postby Asraniel » Sun Apr 26, 2009 3:12 pm

why isn't just the download package ziped with lzma?
Asraniel
Alien
 
Posts: 112
Joined: Tue Feb 28, 2006 9:15 pm

Postby alpha » Sun Apr 26, 2009 3:14 pm

Asraniel wrote:why isn't just the download package ziped with lzma?

/me seconds this question.
quit for good
alpha
Alien trapper
 
Posts: 492
Joined: Tue Jun 17, 2008 7:18 pm

Postby TVR » Sun Apr 26, 2009 4:29 pm

Windows and OSX do not support .7z natively, and not everyone uses 7zip.

Zip is a well-defined standard, stick with it.
TVR
Alien trapper
 
Posts: 404
Joined: Fri Jun 01, 2007 12:56 am

Postby Psychcf » Sun Apr 26, 2009 8:17 pm

TVR wrote:Windows and OSX do not support .7z natively, and not everyone uses 7zip.

Zip is a well-defined standard, stick with it.


err, what about .tar.gz? it offers pretty good compression, and it's a bit more common... Also, why not offer both formats?
Psychcf
Forum addon
 
Posts: 1554
Joined: Sun Dec 03, 2006 11:38 pm
Location: NY, USA

Postby uluyol901 » Sun Apr 26, 2009 8:37 pm

Psychcf wrote:
TVR wrote:Windows and OSX do not support .7z natively, and not everyone uses 7zip.

Zip is a well-defined standard, stick with it.


err, what about .tar.gz? it offers pretty good compression, and it's a bit more common... Also, why not offer both formats?

A gzipped tarball won't work since you can't access certain files in it without unzipping the whole thing, but you *could* gzip everything first then make a .tar, but that will have about the same speed as zip.

Nexuiz already ships with many external libs for mac and windows, so it won't be a problem.
I would like to know the speed of compressing the contents with lzma, and then putting them in a tarball vs zip vs 7z, also going beyond -2 lzma compression isn't supposed to make a large difference in size, but will make a large difference in decompression time.
uluyol901
Member
 
Posts: 16
Joined: Sun Jan 25, 2009 7:39 pm

Postby divVerent » Mon Apr 27, 2009 8:57 am

Guess why I tried -1 lzma compression above. Not much faster either.
1. Open Notepad
2. Paste: ÿþMSMSMS
3. Save
4. Open the file in Notepad again

You can vary the number of "MS", so you can clearly see it's MS which is causing it.
divVerent
Site admin and keyboard killer
 
Posts: 3809
Joined: Thu Mar 02, 2006 4:46 pm
Location: BRLOGENSHFEGLE

Postby Alien » Wed Apr 29, 2009 5:25 am

7z is not a new compression method but more like a container.

So it seems the bottleneck is hdd reading speed and zip has the best decompression time/file size ratio.
Alien
Forum addon
 
Posts: 1212
Joined: Tue Apr 22, 2008 7:12 am

PreviousNext

Return to Nexuiz - Development

Who is online

Users browsing this forum: No registered users and 1 guest

cron