Cheap Supercomputers: LANL has 750-node Raspberry Pi Development Clusters
by Ian Cutress on November 14, 2017 2:30 PM EST- Posted in
- Servers
- HPC
- Enterprise
- Trade Shows
- SC17
- Supercomputing 17
- Raspberry Pi
- Pi
- LANL
One of the more esoteric announcements to come out of SuperComputing 17, an annual conference on high-performance computing, is that one of the largest US scientific institutions is investing in Raspberry Pi-based clusters to aid in development work. The Los Alamos National Laboratory’s High Performance Computing Division now has access to 750-node Raspberry Pi clusters as part of the first step towards a development program to assist in programming much larger machines.
The platform at LANL leverages a modular cluster design from BitScope Designs, with five rack-mount Bitscope Cluster Modules, each with 150 Raspberry Pi boards with integrated network switches. With each of the 750 chips packing four cores, it offers a 3000-core highly parallelizable platform that emulates an ARM-based supercomputer, allowing researchers to test development code without requiring a power-hungry machine at significant cost to the taxpayer. The full 750-node cluster, running 2-3 W per processor, runs at 1000W idle, 3000W at typical and 4000W at peak (with the switches) and is substantially cheaper, if also computationally a lot slower. After development using the Pi clusters, frameworks can then be ported to the larger scale supercomputers available at LANL, such as Trinity and Crossroads.
“It’s not like you can keep a petascale machine around for R&D work in scalable systems software. The Raspberry Pi modules let developers figure out how to write this software and get it to work reliably without having a dedicated testbed of the same size, which would cost a quarter billion dollars and use 25 megawatts of electricity.” Said Gary Grider, leader of the High Performance Computing Division at Los Alamos National Laboratory.
The collaboration between LANL and BitScope was formed after the inability to find a suitable dense server that offered a platform for several-thousand-node networking and optimization – most solutions on the market were too expensive, and anyone offering something like the Pi in a dense form factor was ‘just people building clusters with Tinker Toys and Lego’. After the collaboration, the company behind the modular Raspberry Pi rack and blade designs, BitScope, plans to sell the 150-node Cluster Modules at retail in the next few months. No prices were given yet, although BitScope says that each node will be about $120 fully provisioned using the element14 version of the latest Raspberry Pi (normally $35 at retail). That means that a 150-note Cluster Module will fall in around $18k-$20k each.
The Bitscope Cluster Module is currently being displayed this week at Supercomputing 17 in Denver over at the University of New Mexico stand.
Related Reading
Sources: BitScope, EurekAlert
26 Comments
View All Comments
edzieba - Wednesday, November 15, 2017 - link
The Compute Module has been available since 2014, and the card-edge interface is forward-compatible between versions.Alexvrb - Wednesday, November 15, 2017 - link
Hmm good point... Might be wise to bundle it with a 3-phase 4000-or-so watt diesel generator.thewacokid000 - Thursday, November 16, 2017 - link
It'll potentially be 10,000+ nodes. You're not thinking big enough for scaling. :)serendip - Wednesday, November 15, 2017 - link
It would be interesting to run a neural network on this with each core acting as a neuron. If the latency isn't terrible, it would allow for some cool parallelization work.kaidenshi - Wednesday, November 15, 2017 - link
I think latency would definitely be the major issue, but it does sound interesting!mode_13h - Friday, November 17, 2017 - link
You mean like this?http://www.artificialbrains.com/spinnaker#hardware