Icon ASCII : A Love Letter


Icon My Neural Network isn't working! What should I do?


Icon Phase-Functioned Neural Networks for Character Control


Icon 17 Line Markov Chain


Icon 14 Character Random Number Generator


Icon Simple Two Joint IK


Icon Generating Icons with Pixel Sorting


Icon Neural Network Ambient Occlusion


Icon Three Short Stories about the East Coast Main Line


Icon The New Alphabet


Icon "The Color Munifni Exists"


Icon A Deep Learning Framework For Character Motion Synthesis and Editing


Icon The Halting Problem and The Moral Arbitrator


Icon The Witness


Icon Four Seasons Crisp Omelette


Icon At the Bottom of the Elevator


Icon Tracing Functions in Python


Icon Still Things and Moving Things


Icon water.cpp


Icon Making Poetry in Piet


Icon Learning Motion Manifolds with Convolutional Autoencoders


Icon Learning an Inverse Rig Mapping for Character Animation


Icon Infinity Doesn't Exist


Icon Polyconf


Icon Raleigh


Icon The Skagerrak


Icon Printing a Stack Trace with MinGW


Icon The Border Pines


Icon You could have invented Parser Combinators


Icon Ready for the Fight


Icon Earthbound


Icon Turing Drawings


Icon Lost Child Announcement


Icon Shelter


Icon Data Science, how hard can it be?


Icon Denki Furo


Icon In Defence of the Unitype


Icon Maya Velocity Node


Icon Sandy Denny


Icon What type of Machine is the C Preprocessor?


Icon Which AI is more human?


Icon Gone Home


Icon Thoughts on Japan


Icon Can Computers Think?


Icon Counting Sheep & Infinity


Icon How Nature Builds Computers


Icon Painkillers


Icon Correct Box Sphere Intersection


Icon Avoiding Shader Conditionals


Icon Writing Portable OpenGL


Icon The Only Cable Car in Ireland


Icon Is the C Preprocessor Turing Complete?


Icon The aesthetics of code


Icon Issues with SDL on iOS and Android


Icon How I learned to stop worrying and love statistics


Icon PyMark


Icon AutoC Tools


Icon Scripting xNormal with Python


Icon Six Myths About Ray Tracing


Icon The Web Giants Will Fall


Icon PyAutoC


Icon The Pirate Song


Icon Dear Esther


Icon Unsharp Anti Aliasing


Icon The First Boy


Icon Parallel programming isn't hard, optimisation is.


Icon Skyrim


Icon Recognizing a language is solving a problem


Icon Could an animal learn to program?




Icon Pure Depth SSAO


Icon Synchronized in Python


Icon 3d Printing


Icon Real Time Graphics is Virtual Reality


Icon Painting Style Renderer


Icon A very hard problem


Icon Indie Development vs Modding


Icon Corange


Icon 3ds Max PLY Exporter


Icon A Case for the Technical Artist


Icon Enums


Icon Scorpions have won evolution


Icon Dirt and Ashes


Icon Lazy Python


Icon Subdivision Modelling


Icon The Owl


Icon Mouse Traps


Icon Updated Art Reel


Icon Tech Reel


Icon Graphics Aren't the Enemy


Icon On Being A Games Artist


Icon The Bluebird


Icon Everything2


Icon Duck Engine


Icon Boarding Preview


Icon Sailing Preview


Icon Exodus Village Flyover


Icon Art Reel




Icon One Cat Just Leads To Another

Real Time Graphics is Virtual Reality

Created on July 31, 2011, 6:02 p.m.

When I tell people my interest is in computer graphics, most people don't really know how to react. Much like anything to do with computers, trying to explain it often leads to more confusion than enlightenment. Even to people who have experience with programming, unless they've done graphical programming, the whole thing can seem like a box of magic tricks. In most peoples' heads I imagine "graphics" conjures up images of crude wireframes and sharp polygonal models from the 90s, when graphics were "new" and "experimental". Of all the responses I remember one particularly well. I was talking to a man in his 60s, an insurance salesman from Yorkshire. His response was something along the lines of:

"So, you're basically making killing people and stealing cars in GTA more realistic."

At the time it didn't even seem like too bad a response. In some ways it was a fair trade. Computer graphics are clearly not one of his interests, and insurance is most definitely not one of mine. What he said was somewhat true in its sentiment, but it remains a rather depressing way to look at it.



And I can't help but finding myself wanting to fight the fight. I wish I could bring more people around to the art, observation, maths, science and problem solving behind graphics! Even gamers see graphics as a very linear and steady progression. You buy a better graphics card - you get better graphics. At the end of the day few care, or really want to know about the details.

To me the fascination is exactly in the details. Sometimes I feel like I'm viewing the world in twice - there is so much more I see! I could tell you the type of shadow your laptop is casting - I could give you the component parts of that shadow and outline them for you. I could tell you why your fingers glow red when you put them right up to a light, and how headlights reflect across a wet road. But graphics gives you even more than that! It tells you so much about the world in general. Through building virtual objects you learn about the real ones. I could tell you about the different ships in the 15th and 16th century, their parts, purposes, strengths and weaknesses. I could tell you in depth about renaissance sword fighting techniques, about the anatomy of a goat, the ways birds can fly and the mechanism for wheellock rifles. Of everything I've studied, I've found nothing more enriching to my world view.

In my opinion computer graphics is one of the most interesting fields in computer science. It has huge amounts of investment, research and some exceptionally smart people at the forefront. Progress is made by brilliant ideas over processing power. My favourite example is a new technique used to emulate a phenomenon called radiosity. This technique is called Sphereical Harmonics (or Precomputed Radiance Transfer if you like). The effect it emulates, radiosity, is basically when light reflects off a colored surface onto some other surface, lighting that up with some of its own color.

This technique was first developed in 2002 by Peter-Pike Sloan, Jan Kautz and John Snyder at Microsoft. It combines maths from all kinds of research areas, in some spectacular ways. But the real core of up and coming research is what is fascinating, because it's borrowing from various quantum physics papers that are using similar Spherical Harmonics models for looking at the rotation of quantum particles. There are stories of e-mail exchanges between the physicists and the programmers, with the programmers requesting help mapping the maths from complex-number space to real-number space so that it can be done on a processor.

All this is where virtual reality will come from. Not from the CGI movies, but from games, because they are interactive, and render images at 60 times a second. This is how I like to look at real-time graphics.

If I became a billionaire overnight I would hire the world's greatest environmental artists and graphical programmers and my game would be a recreation of all the most beautiful places on earth in stunning realism. Because, if I can settle down for the evening in my living room and experience in true virtual reality, with feeling smell sound and sight, the the sun set over the Himalayas - a casual walk along the Great Wall of China early in the morning, then why would I sit down and slog through several more hours of the next GTA?

The final note comes from John Carmack, the real inventor, and prolific innovator of, real time graphics. As well as his primary hobby being rocket science (proving computer graphics really is more interesting than rocket science!), he provides a quote which I think most people involved with graphics can really relate to.

"...after so many years immersed in the science of graphics, he [John Carmack] had achieved an almost Zen-like understanding of his craft. In the shower, he would see a few bars of light on the wall and think, Hey, that's a diffuse specular reflection from the overhead lights reflected off the faucet. Rather than detaching him from the natural world, this viewpoint only made him appreciate it more deeply. 'These are things I find enchanting and miraculous,' he said, 'I don’t have to be at the Grand Canyon to appreciate the way the world works. I can see that in reflections of light in my bathroom.'"

github twitter rss