Intel Xeon 3.6 2MB vs AMD Opteron 252 Database Test
by Jason Clark & Ross Whitehead on February 14, 2005 8:00 AM EST- Posted in
- IT Computing
"Order Entry" Stress Test: Measuring Enterprise Class Performance
One complaint that we've historically received regarding our Forums database test was that it isn't strenuous enough for some of the Enterprise customers to make a good decision based on the results.
In our infinite desire to please everyone, we worked very closely with a company that could provide us with a truly Enterprise Class SQL stress application. We cannot reveal the identity of the Corporation that provided us with the application because of non-disclosure agreements in place. As a result, we will not go into specifics of the application, but rather provide an overview of its database interaction so that you can grasp the profile of this application, and understand the results of the tests better (and how they relate to your database environment).
We will use an Order Entry system as an analogy for how this test interacts with the database. All interaction with the database is via stored procedures. The main stored procedures used during the test are:
sp_AddOrder - inserts an Order
sp_AddLineItem - inserts a Line Item for an Order
sp_UpdateOrderShippingStatus - updates a status to "Shipped"
sp_AssignOrderToLoadingDock - inserts a record to indicate from which Loading Dock the Order should be shipped
sp_AddLoadingDock - inserts a new record to define an available Loading Dock
sp_GetOrderAndLineItems - selects all information related to an Order and its Line Items
The above is only intended as an overview of the stored procedure functionality; obviously, the stored procedures perform other validation, and audit operations.
Each Order had a random number of Line Items, ranging from one to three. Also randomized was the Line Items chosen for an order, from a pool of approximately 1500 line items.
Each test was run for 10 minutes and was repeated three times. The average between the three tests was used. The number of Reads to Writes was maintained at 10 reads for every write. We debated for a long while about which ratio of reads to writes would best serve the benchmark, and we decided that there was no correct answer. So, we went with 10.
The application was developed using C#, and all database connectivity was accomplished using ADO.NET and 20 threads - 10 for reading and 10 for inserting.
So, to ensure that IO was not the bottleneck, each test was started with an empty database and expanded to ensure that auto-grow activity did not occur during the test. Additionally, a gigabit switch was used between the client and the server. During the execution of the tests, there were no applications running on the server or monitoring software. Task Manager, Profiler, and Performance Monitor were used when establishing the baseline for the test, but never during execution of the tests.
At the beginning of each platform, both the server and client workstation were rebooted to ensure a clean and consistent environment. The database was always copied to the 8-disk RAID 0 array with no other files present to ensure that file placement and fragmentation was consistent between runs. In between each of the three tests, the database was deleted, and the empty one was copied again to the clean array. SQL Server was not restarted.
Facebook
Twitter
RSS
97 Comments
View All Comments
Jason Clark - Monday, February 14, 2005 - link
bthomas, read page 1 please. We focus on the window side of the house and there is no released 64bit OS or SQL server yet.Quanticles, the only measure we has was ntune which reported the HT bus running at 1GHz. Dual configuration for all tests.
Quanticles - Monday, February 14, 2005 - link
Did you check to make sure the HT bus was actually running at 1 GHz with an o-scope?Where you running these systems as 1P or 2P? I got the impression that you were running the tests as 1P systems and then was making recommendations on 2P systems.
bthomas - Monday, February 14, 2005 - link
Geez. Nobody is mentioning the fact that the Opteron is running on a 32-bit OS in these tests.Yeah, its basically a wash under these conditions, but so what..the real test would be under 64 bit. DB applications/servers are supposed to really thrive in the 64-bit realm. Why didnt you test under a 64 bit OS/DB software like Linux/Postgres|MySQL/etc ?!?
=b.t.
rivieracadman - Monday, February 14, 2005 - link
I forgot to ask; Does the 152 offer SSOI or is it still SOI. From the power ratings I can guess it's still SOI. Just curious ...chucky2 - Monday, February 14, 2005 - link
I like how vendors cripple the AMD offerings...sometimes ever so slightly, other times largely. Take a look at the two HP offerings listed out at the end of the article and tell me which one you'd like to buy? For $900 extra, I'll give up whatever performance benefit I'd see for the managability any day.Not AMD's fault...it's the vendors... :(
Chuck
Fluff - Monday, February 14, 2005 - link
Was NUMA enabled on 2003 Enterprise Edition for the 252?Did it make any difference?
This was not made clear in the article.
Unless /PAE is the equivalent.
mlittl3 - Monday, February 14, 2005 - link
For those of you who are interested in what opterons will be made using 90 nm and 1 GHz hypertransport, here is the link on amd's website.http://www2.amd.com/us-en/OPN_Printer/1,,,00.html?...
Sorry it is so long but there is a lot of scripting for filtering results on the page.
To summarize, Opterons 242 (1.6 GHz) to 852 (2.6 GHz) are being updated to the new die process and HT bus.
I would like to recommend to the author of the article to include a reference section at the end of every review to relevant websites for more information. This would be similar to the reference section in the article from Johan. The above link should go there as well as any links to more indepth architecture info on both AMD's and Intel's websites. Just a thought.
skiboysteve - Monday, February 14, 2005 - link
that extra period at the end of post #28 made what would have been a normal statement entirely creepy as hell...snorre - Monday, February 14, 2005 - link
It would be more interesting with an update to these articles:http://anandtech.com/IT/showdoc.aspx?i=1982
http://www.anandtech.com/IT/showdoc.html?i=1935
"The true test that remains, however, is a test comparing AMD’s Opteron to Intel’s Itanium 2. Intel was not very receptive to the idea of doing a head-to-head; not out of a fear of losing, but out of a desire not to lend AMD any credibility by showing that the Opteron is indeed a competitor to the Itanium 2. While we do believe that the Itanium 2 in its 128-way configurations is definitely out of the Opteron’s league, in the 2-way and 4-way configurations that we are interested in comparing, the two are absolutely competitors.
Whether Intel is looking to supply us with an Itanium 2 system or not, we will make that comparison."
We're still waiting...
SpaceRanger - Monday, February 14, 2005 - link
I'd love to see it Jason..