A way of calculating uncertainties in Nexuiz benchmarks

Discuss anything to do with Nexuiz here.

Moderators: Nexuiz Moderators, Moderators


  • I was interested in what the uncertainties were in benchmarks taken in Nexuiz. I made some calculations and have put together an OpenDocument spreadsheet (made in OOo, should work in others, if not give the appropriate projects bugzilla a nudge) for calculating these uncertainties:
    http://www.rofltech.co.uk/media/nexuiz_ ... inties.ods

    Run a benchmark then copy and paste the necessary values into the spreadsheet to get uncertainties in the min/avg/max values. Min and Max aren't comparable to Avg at all as they are only for that individual frame, not any frame that may have been min/max.

    These are useful figures if you're interested in seeing how much variation there is in results. If you play with lots of settings then any setting that gives a performance change less that the uncertainty is not useful as it is not statistically significant.

    If you would like to understand what any of this actually means, take a Physics degree. :lol:

    Edit: This only works on Nexuiz before 2.3. In 2.3 the measurements changed and are incomparable.
    Ed
    Forum addon
     
    Posts: 1172
    Joined: Wed Mar 01, 2006 12:32 am
    Location: UK


Return to Nexuiz - General Discussion




Information
  • Who is online
  • Users browsing this forum: No registered users and 1 guest