Sandy Bridge-E and X79 – The ASUS P9X79 PRO Reviewby Ian Cutress on November 14, 2011 3:01 AM EST
- Posted in
It seems that every few months or so, we get a new socket and a slew of new chipsets from Intel. If we go back as far as 775 (mainstream), in consumer land, we have covered 1366 (enthusiast), 1156 (mainstream) and 1155 (mainstream). This is in contrast to AMD’s backwards compatibility progression of AM2/AM2+ to AM3/AM3+ (if you ignore Llano and Fusion).
Information has been flying around about the new X79 enthusiast platform for some months now, especially when looking for a replacement for X58. Needless to say, X79 aims at high end and high price. There are the main changes that everyone knows and cares about – quad channel memory and 40 PCIe lanes strike high on anyone’s list about X79. Does that mean the chipset is really for those who want >16 GB of memory, or 2/3 way GPU action?
Above is a block diagram of the routing of the LGA 2011 socket and the X79 Platform Controller Hub (PCH), taken from Intel’s DX79SI motherboard information, which will be reviewed in due course. A few points are specific to that board (dual LAN controllers, USB 3.0 implementation), but it covers the basics of most X79. As we can see, the GPU PCIe lanes are split through multiplexers and switches for x16/x8 or even x4 speeds, depending on the motherboard in question. The connection via DMI from the CPU to the PCH gives the motherboard most of the functionality – PCIe x1, SATA, Legacy IO, TPM, USB 2.0, Audio, Ethernet etc. Most of these features are obviously adjustable by the motherboard manufacturer, in terms of quantity (decrease or increase through controllers), or manipulation, for example ASUS’ SSD Caching, as explained in the ASUS review later.
Firstly, let us look at which niches X79 and LGA 2011 are attempting to cover.
On Anand’s article regarding the CPUs, it is clear to say that anyone wanting performance can find it in Sandy Bridge-E. If you are willing to pay top dollar, you get a top CPU with six cores/twelve threads that will run between 3.6 GHz and 3.9 GHz (depending on CPU load) in a 130 W envelope. With a little push, this could easily see 4.5 to 4.7 GHz while on the Intel branded water cooler being sold separately. While this will not make much of a difference for gamers, we can see the allure for any CPU intensive tasks that are not already GPU accelerated – video encoding or rendering being obvious view points. The following is a slide from Intel’s press kit, comparing the performance of SNB-E i7-3960X to the i7-990X, where the main differences to X58 are the microarchitecture improvements (Nehalem->Sandy Bridge), the memory, and the larger cache:
Memory is a big part of X79, as we are introduced to quad channel memory on a mainstream consumer level chipset, compared to the previous enthusiast chipset, X58, where the push was in tri-channel memory. Most X79 boards will cater for 8 DIMM slots (2 DIMMs per channel), though some will scale this back to 4 DIMM slots to save money and space on the board. Theoretically, a 4x2 configuration will cater up to 64 GB of memory when using 8 GB memory sticks, though users will perhaps be looking in the $1600 range for such a kit (for example, Corsair’s Dominator 4x8 GB DDR3-1866 C9 kit CMT32GX3M4X1866C9) which surpasses the cost of a motherboard+CPU in one swoop. By specification, population of 8 DIMMs should make a motherboard default to 1333 C9 speeds, while when only using 4 DIMMs should give 1600 C9.
There are issues to the memory that a lot of people will consider – does anyone ever need 64 GB of memory? Even if it were populated with relatively cheaper 4 GB sticks, does anyone ever need 32 GB of memory? For the most part, no, however there is always a need for Virtual Machine memory, computational scientists requiring large data sets under a tighter budget, or animators requiring large rendering memory budgets. The flipside of the memory is that most motherboard manufacturers will support high memory frequencies – for example, as shown in the P9X79 PRO, up to DDR3 2666 MHz is selectable on the divider alone. In some pretesting, using a G.Skill RipjawsZ 4x4 GB kit, I have been able to hit 55 GB/s memory bandwidth quite happily. However, as stated previously, there are few users that this will be aimed at, but that is kind of the purpose of such a chipset.
There is argument here that Intel could have used dual channel memory for the high end – it would have reduced the pin count on the CPU (perhaps put it into an 1155 envelope, disregarding the PCIe connections) and ultimately the cost of the platform. Memory bandwidth is not a struggling feature for a lot of users, but those who found the memory bandwidth of X58 the limiting factor will enjoy the quad-channel of X79. Despite this, the specification does allow single, dual and tri-channel operation for X79, so it is completely possible that if micro-ATX or even mini-ITX motherboards are produced, they may scale back to two DIMM slots for dual channel operation. This gives a consumer up to 16 GB of memory, but should provide the same performance in non-memory bandwidth limited scenarios to Sandy Bridge based applications.
For the gamers and GPU users, we finally get full x16/x16 native compatibility in the PCIe world, without the need for any performance reducing NF200 solutions. X79 for the most part will see motherboards spouting x16/x16, x16/x16/x8, x16/x8/x8/x8, x8/x8/x8/x8 or even x16/x8/x8/x4/x4 variations depending on the PCIe layout of the board, the size of the board, and the manufacturer. For all intents and purposes, in gaming, we are not expecting this to make any difference for the first two GPUs. Very few gamers will be using more than two, and again, this chipset is aimed at ‘no price too much’ style scenarios. Where it will probably be handier is in the land of GPGPU, where CPU to GPU bandwidth may have been the major limitation in running simulations.
We cannot get away from the fact that for a lot of X79 motherboards, the PCIe GPU lanes will be post-specified at PCIe Gen 3. The chipset, and the motherboards in X79, should all display Gen 3 compatibility for the GPU slots (usually for the PCIe x8/x16), but this currently means relatively little for consumers until Gen 3 products are released to the market. There is also the fact that it cannot be properly tested in a real-world context until then – depending on how exactly the GPU manufacturers utilize the new technology. As a result, the initial batches of X79 motherboards may require a BIOS update to activate this functionality. I was lucky enough to observe an ASUS Z68 Gen 3 board running an Ivy Bridge processor at a recent invitational event, where ASUS were clearly stating that all their PCIe Gen 3 products are correctly implemented.
It is worth having a look at PCIe Gen 3, if only for a couple minutes. Inside the Intel Chipset implementation, it states:
Intel Core i7 and Intel Xeon processors in an LGA2011 package support PCI Express add-in graphics cards via the board’s PCI Express x16 connectors. These processors support the following generations of PCI Express:
- PCI Express 3.0 with a raw bit rate of 8.0 GT/s results in an effective bandwidth of 8.0 Gb/s each direction per lane. The maximum theoretical bandwidth of the x16 interface is 16 GB/s in each direction, simultaneously, for a bandwidth of 32 GB/s.
- PCI Express 2.x with a raw bit rate of 5.0 GT/s results in an effective bandwidth of 4.0 Gb/s each direction per lane. The maximum theoretical bandwidth of the x16 interface is 8 GB/s in each direction, simultaneously, for a bandwidth of 16 GB/s.
I want to draw attention to 3.0 and 2.x, and the comparison between GT/s (GigaTransfers per second) and bandwidth. It states, for 3.0, that there is a raw bit rate of 8.0 GT/s, and an effective up/down bandwidth total of 32 GB/s. For 2.x, there is a raw bit rate of 5.0 GT/s, and an effective up/down bandwidth total of 16 GB/s. This means there is a distinctive change in how PCIe 3.0 and 2.x operates – PCIe 2.0 uses an 8b/10b encoding scheme, which causes a 20% overhead; whereas PCIe 3.0 uses a ‘scrambling’ technology using binary polynomials and a 128b/130b encoding scheme, reducing overhead to 1.5%. So whereas PCIe 2.0 was a natural progression to PCIe 1.x, this is where the new 3.0 specific features are required in terms of processor and chipset.
The landscape of overclocking has also changed… slightly. The land of X58 overclocking was as varied as one could get – full multiplier and BCLK adjustable to get the balance a user wanted. Sandy Bridge and P67/Z68 changed all that, due to the internal clock generator, effectively being multiplier only. While this made overclocking easy for users and system builders alike, there were some outcries from various overclocking communities about ‘taking the fun’ out of overclocking. Sandy Bridge-E attempts to bridge the two systems with an overclocking hybrid of sorts. It all comes down to clock generators.
The initial CK505 clock generator, at 100 MHz, is split several ways – one to the CPU/memory, one to the PCIe, and one to the I/O. These splits act to gear the clock generator, allowing the user to adjust one without affecting the others. This opens up the CPU overclocking to a wider range of adjustments, rather than the 1-5 MHz sported on most Sandy Bridge/Cougar Point CPU and chipset combinations. A deeper look into how to overclock the Sandy Bridge-E platform is described later as part of the ASUS P9X79 Pro review. However, the broadside of SNB-E is that due to the design and the increased core count, it is expected that SNB-E processors may not overclock as well as Sandy Bridge for 24/7 use, leaving single core performance firmly in the hands of the mainstream processor market.
We are not afraid of overclocking 130W CPUs, despite the increased power draw and heat – a big feature of X58 was overclocking. However, while these SNB-E chips are also 130W, Intel is pushing the release of an Intel branded, all-in-one liquid cooler:
Made by Asetek, this is a simple 120mm single radiator cooler using propylene glycol whereby the fan plugs into a cable from the cooler, and the cooler plugs into the CPU fan header on the motherboard. This indicates that the pump and fan are both controlled by the onboard BIOS fan control implementation. In normal operation, using this cooler, I saw 61ºC in a forced 100% CPU load scenario (ambient 20ºC max) – in an overclocked (~30%) situation, this rose to 89ºC, where both liquid pipes to and from the cooler were warm. It’s not the most perfect water cooler on my brief analysis, but some substantial cooling will be required if users want an overclocked system. It also makes me wonder how Intel’s air cooler will fare, given that they suggest it is for stock systems only:
Lastly, we do lose a few features that have been on previous chipsets, or that were expected to be on X79. The most disappointing is perhaps the lack of USB 3.0 native to the chipset. It looks like we will have to wait until Ivy Bridge or even Haswell for updates on that end. Also, probably more of a carry over from P67/Z68, is that we still have a SATA 3 Gbps/SATA 6 Gbps discrepancy from the PCH. If AMD can stick 6 SATA 6 Gbps from their FCH implementations, it cannot be too much to ask for Intel to do it. It seems surprising then that we do not have Z68’s Smart Response Technology (SSD Caching) on X79 – though ASUS have devised a solution using a hardware/software combination which I will discuss later. Then there is the talk over SAS ports and compatibility – back at Computex when pre-release models of X79 boards were on show, they all had 6 SATA and 6 SAS ports on their models. But this was pulled from the specifications by Intel, for a variety of reasons. So while SNB-E and X79 are meant to be the pinnacle of performance and functionality, there is obviously still room for improvement if we literally want to have everything (no expense spared) in a chipset.
So, without further delay, let us rock on with one of the most important X79 motherboard releases – the ASUS P9X79 Pro!
Post Your CommentPlease log in or sign up to comment.
View All Comments
markgerazzi - Saturday, November 19, 2011 - linkAlso very important, will the Noctua D14 fan block or compromise any of the 8 DImm slots?
CodeToad - Friday, December 2, 2011 - linkI know my workstations... they had to pry my Sun 20 out of my dying hands! All the P9X79 lacks as a true workstation are SAS+SATA control and some Intel virtualization and net tech, at least on the WS model. That would have been easy to add, and I'm sorry Asus failed to go the extra step with the WS model.
The P9X79 lacks nothing that I can see for the enthusiast - in fact there are huge possibilities for overclocking, tweeking, water cooling, and improvement via add-on boards.
There is the issue of threading in current games. Worry not! Every developer I know is urgently learning to improve their code at compile time, including deeply threading applications.
Yes, the board is expensive. So are all the rest in the Top Tech arena. I've looked for another board for the i7-3960X class, and can't find anything cheaper on balance. My experience with Asus build quality and their warranty are final decision factors for me.
I urgently need to build a machine for home office use. I do heavy OLAP and Data Mining research, and I contribute to open source -- the R project and others. I'm also a heavy WS virtualization user. Whatever I choose will be feed by two mid-range servers on a cheap switched 1K+ network, my total "IT Dept." Soon I will have to learn CUDA, and this board will serve will with the right video, since behind the visualization is a ton of computation.
Yes, I could build a server-like box, but I think this board, tons of fast switched memory, and the Core i7-3960X CPU may do better than a traditional dual machine. I'll have to add some boards, but that would be required with any motherboard.
So it's a bit of a risk, but I'm sold.
Thus to all -- if you want to "pee on the tall weeds with the big dogs," the P9X79 is the board and the Intel I7-39x0 is the CPU to do it.
InfiDELL - Thursday, December 8, 2011 - linkWhile X38 was really something over P35 and P45 from X58 to X79 eve I can't see a difference that will worth the money invested in 1366,1356 socket boards.
The extra USB or the power to tweak a CPU that already doesn't have enough backbone for his power?
Or the extra bandwidth of VGA which is so small vs the high price of this boards and CPU.
Not to say it consume more Watts than sandy.
I really scrambled my brains to find the advantages of this boards in IO and ram latency over 1155 boards but, I can't really see but very small differences in performance and with what cost.
I expected that triple channel , quad channel and the native sata 6gb will really tell me something on so called enthusiastic boards. So the CPU and whole system will benefit from lower RAM latency and the rest need it for a big brain as latest CPUs are capable off.
I expected that SB on X79 will really get in flames of so much IO but no, it only burning your pocket for more multicolored heat-sink or some worthless shape.
In top of all extra expenses we get the power bill higher as this boards + their CPU consume quiet more.
Coming back to x38, yes is better than P45 and consume about 25 watts more but, easy taken by P965 in performance and power consumption and for me P965 remain the king of DDR 2 platforms as I tested Asus P5EWS pro X38 , Abit quad GT P965, asus P5K deluxe P965 and Maximus II P45.
History repeat itself.
I'll go prolly to a common 1155, is not worth to wait for X79 CPUs to go down in price as this boards are not shining for me and the same for 1366.
Very disappointing results but thank you for tests it's clear again for me10th time now is not really a deal but, a rip off.
dgingeri - Friday, January 13, 2012 - linkI have a need for lots of memory, even up to 32GB: virtual machines. My current virtual host system (Core i7 950) has 12GB, and I run several small virtual machines for my MCITP testing prep. I currently have 2 domain controllers, a SQL server, an Exchange server, a WDS and WSUS system, and 2 virtual workstations, all to practice for my MCITP tests. (Now I just need to get the money to actually take the tests. 9 tests are pretty expensive.) It's well worth the time and money to get a system like this for that purpose. It's even more cost effective than classes for me.
candabi - Thursday, January 26, 2012 - linkI'm looking for a soho server for Virtualize several machines so, I like this Mobo for its 8 memoriy slots, but Is it possible to install Win2K8 w/o any problem?
I want to use the teaming functionallity of my Synology iSCSI NAS with two LAN ports.
So, I am thinking on purchase one DUAL LAN card, or two separated LAN cards in order to connect them directly to NAS.
And the integrated LAN, it could be connected to the USERS SWITCH.
Do you think is possible? What DUAL LAN card do you recommend?