Test Setup

Since this first part is more about the applications and the user experience than the performance, we’re going to keep the benchmarks short. Along with looking at 9.04, part 2 will focus on a greater level of benchmarking, particularly graphics benchmarking.

For now we’re going to be taking a look at general situations – encoding, compression, file operations, etc. Because there’s a lack of a solid benchmarking suite that’s compatible with both Windows and Linux (e.g. PCMark), we don’t currently have a way to benchmark multitasking scenarios. So this is largely a look at single application performance.

Due to some initial issues with the 64bit version of Hardy, all of the following testing is done of the 32bit versions of Hardy and Windows Vista respectively. Future articles will be done with 64bit operating systems.

Our test setup was as follows:

Software Test Bed
Processor Intel Core 2 Quad QX6850
(3.00GHz/1333MHz)
RAM G.Skill DDR2-800 (2x2GB)
Motherboard Gigabyte GA-P35-DR3R (Intel P35)
System Platform Drivers Intel 8.1.1.1012
Hard Drive Seagate 7200.11 500GB SATA
Video Cards 1 x GeForce 8800GTX
Video Drivers NV ForceWare 186.18
Power Supply OCZ GameXStream 700W
Desktop Resolution 1600x1200
Operating Systems Windows Vista Ultimate SP2 32-Bit
Ubuntu 8.04 "Hardy Heron"
.

The User Experience CPU Benchmarks
Comments Locked

195 Comments

View All Comments

  • jasperjones - Wednesday, August 26, 2009 - link

    I second most of Fox5's suggestion.

    1.) I've been completely ignorant of software development on Windows over the last few years. Comparison of MS Visual Studio vs Eclipse or vs Netbeans/Sun Studio? How fast are CLI C++ apps on Windows vs. Linux? Perhaps using both GNU and Intel C++ Compiler toolchains on Linux. And possibly MS Visual C++ and Intel Visual C++ on Windows.

    Perhaps less esoteric, 2.) instead of benching SMB/CIFS on Windows vs Samba on *nix, bench something *nix native such as scp/sftp or nfs. Netperf.

    3.) Number-crunching stuff. I guess this is sort of similar to running at least a few synthetic benches. LINPACK or some other test that uses BLAS or LAPACK, tests that use FFTW. Maybe even SPEC (I wouldn't expect any exciting results here, though, or are there?)
  • Eeqmcsq - Wednesday, August 26, 2009 - link

    Are you looking for benchmarks in Windows vs Ubuntu with the same hardware? Or benchmarks in different CPUs/motherboards/etc with the same Ubuntu?
  • Ryan Smith - Wednesday, August 26, 2009 - link

    Cross-platform. There's no problem coming up with Linux-only benchmarks for hardware.
  • Eeqmcsq - Wednesday, August 26, 2009 - link

    I have a question about your benchmarks that involve files, such as copying and zipping. When you run your benchmarks, do you run them multiple times and then get an average? I ask that because I have learned that in Linux, files get cached into memory, so subsequent runs will appear faster. I suspect the same thing happens in Windows. Do you take that into account by clearing cached memory before each run?
  • Ryan Smith - Wednesday, August 26, 2009 - link

    We reboot between runs to avoid cache issues (and in the case of Windows, wait for it to finish filling the SuperFetch cache).
  • fri2219 - Wednesday, August 26, 2009 - link

    I heard Sony is coming out with this thing they call a Walkman.

    You should review that next!
  • StuckMojo - Wednesday, August 26, 2009 - link

    ROFL!
  • Fox5 - Wednesday, August 26, 2009 - link

    The LTS is really for the same types of people that avoid grabbing the latest MS service pack. IE, anyone who's still running Windows XP SP2 with IE6. Do that comparison and see how they compare.

    Ubuntu is little more than a tight integration of many well-tested packages, there's no reason to go with ubuntu's LTS when everything else already goes through it's own extensive testing. Given how quickly open source software advances, I'd say the LTS is probably less stable than the most up to date versions, and certainly far behind on usability.

    You want the equivalent of Ubuntu's LTS in Windows? It most closely matches the progression that the Windows server versions follow.
  • Ryan Smith - Wednesday, August 26, 2009 - link

    To put things in perspective, 8.04 was released shortly after Vista SP1 and XP SP3 were. So Hardy vs. XP SP2 (a 4 year old SP) is a pretty poor comparison.

    You'll see an up to date comparison in part 2 when we look at 9.04.
  • awaken688 - Wednesday, August 26, 2009 - link

    I'm glad you did this article. It really has been something I think about. I'm ready to read your Part II. As others have mentioned, I have a couple of other articles that would be great.

    1) The comparison of the various versions as mentioned. SuSe, Ubuntu 9.04, BSD, etc...

    2) Someone mentioned VirtualBox. I'd love to hear more about this including a detailed setup for the normal user. I'd love to be able to surf while in Linux, but able to play games in Windows and keep them separate for added security.

    Thanks for the article! Hope to see one or both of the ideas mentioned above covered.

Log in

Don't have an account? Sign up now