Wednesday February 10, 2010 3:39 AM AEST

Nvidia's CUDA

  • Email a Friend
  • Print Page
 »
Nvidia's CUDA
By Alex Bradner
Jul 24, 2008
Tags: CUDA

Nvidia’s sidestep from gaming could predict a brave new world for domestic computing.

A new use for your graphics card is emerging. It’s known as GPGPU or General Purpose computing on Graphics Processing Units, and the idea is to harness the immense power of consumer graphics hardware for computation.

And it’s gaining momentum. In February last year, Nvidia released CUDA - or Compute Unified Device Architecture - an interface for programmers to write software to execute on its Geforce 8 series (or better) GPUs. This name is a cute backronym, but the floodgate it’s opened is much more serious.

The way GPUs process data is slightly different to x86 CPUs and their relatives. In a CPU cycle a couple of things happen: the CPU loads and decodes its next instruction, the Arithmetic/Logic Unit (ALU) does the grunt work of performing the operation and then spits out the result which then needs to be stored somewhere.

Say you have one million data points which all require an “add this to that” operation performed – for example increasing the brightness of an image in Photoshop. Processing the pixels one at a time will take at least a million cycles. If, however, you have lots and lots (a technical term) of ALUs, each performing “add this to that” on some of those million data points, the number of cycles is massively reduced. There are other delays involved -- such as fetching from memory -- however the principal is the same. Correctly channelled, it’s an epic amount of power compared to the piss-weak four cores on a Core 2 Quad. The CUDA approach has a massive amount of things going on at very high speed, like a leopard in a blender.

You might ask why CPUs aren't built this way. The catch with GPGPU is that the threads are specialised and each needs to be running the same instruction. This model of computing is known as SIMD – or Single Instruction, Multiple Data. For multimedia acceleration, a very specialised and limited set of SIMD operations have found their way into CPUs in the form of Streaming SIMD Extensions (better known as SSE), but these are very limited in terms of versatility and still operate in a serial manner.

Unfortunately, not everything is nicely parallelisable, and for normal office and internet use massively parallel processing doesn't make any sense at all. For the casual or business user, x86/x64 is still better suited to the task.

So GPGPU processing isn't for everyone, but there are a lot of very specific applications where massively parallel processing beats the mostly serial x86 processing we’re used to. Multiple core CPUs are trying to introduce parallel computing to the desktop, but can only process a handful of threads at a time. A GPU core is comprised of lots of little specialised processors each capable of running multiple threads. The word on the street is that a Geforce 8800 only reaches saturation when at least about 25,000 threads are running simultaneously. Perfect for massively parallel number crunching.

In the real word, that means a massive speed boost for data-heavy operations like simulating organic molecules, weather, image recognition, anything to do with multimedia and Newtonian physics. While the first three only help blast through someone’s PhD research, multimedia is everywhere and Newtonian physics will help you blast through a friend and admire the view as their entrails realistically splatter throughout the game world.

 
 »
 
Want all the dirt on the Medal of Honor reboot, including PC multiplayer details, story, and AI coding, plus interviews with devs and real special ops vets?

This is the issue for you!

Plus liquid cooling made easy, budget gaming PC building guide, and a whole lot more. ON SALE NOW!
Comments

Be the first to comment on this article.
Thoughts on this article? Add a comment below.
Login or register to submit a comment.
Power to the PC
 
 
Kitlog
 
 
Atomic Magazine

Issue: 109 | February, 2010

Atomic is a magazine aimed squarely at computer enthusiasts, gamers, and serious PC upgraders.

Every month we bring you the latest reviews of new technology and PC components, in depth features on everything from overclocking to console hacking, and gaming previews and interviews.
 
Latest Comments
"Great aricle, and i thought it would be about low power psus and components.

in any ..."
by battlefield_gir | Feb 10, 2010 2:28 AM
 
"I like alot of the stuff inside, but outside, well i never really like lian li cases, dunno why."
by H3VIW8 | Feb 10, 2010 1:57 AM
 
"It's a fun play, but I found that once you got further down in the levels, Epic Leather Boots ..."
by Tezlin | Feb 9, 2010 8:59 PM
 
"I'm with you there Waltish."
by SceptreCore | Feb 9, 2010 5:53 PM
 
"ozacube, are they going to stick nVidia cards in tv's for the shutter glasses?"
by bozo01 | Feb 9, 2010 11:18 AM
1) Apple iPhone 8GB42 plans 15%
2) HTC Magic16 plans 12%
3) Nokia N9743 plans 12%
4) Nokia E7149 plans 20%
5) Apple iPhone 3GS 16GB30 plans 58%
1) iiNet32 plans 37%
2) Netspace36 plans 8%
3) TPG Internet19 plans 20%
4) Telstra BigPond30 plans 20%
5) Optus33 plans 11%

Mobiles | Broadband | Credit Cards

Atomic MPC
Latest User Reviews
Shenmue II
10%
asdfasdf
 
EVGA X58 Classified
90%
great board, a few things could be better
 
EVGA X58 Classified
90%
Gorgeous looking
 
Sapphire 4890
90%
So good, I immediately wanted a second one!
 
MSI 790FX-GD70 motherboard
90%
Allmost the prefect gaming board