The changes in the cg production pipeline

Larry Gritz, who works at Sony Imageworks, presented at High Performance Graphics in New Orleans a talk entitled «Production Perspectives in High Performance Graphics». The talk was basically a description of the procedures of making a cg production and the problems involved in it, to see how the production process can be improved and accelerated with the aid of the new generation of graphics hardware.

With amazing pieces of the las works in which he has been involved (Cloudy with a Chance of Meatballs, 2012) he explained how thinks have changed in the later years.

A typical movie can have between 100 and 2000 shots of cg, and every shot consists in about 20 to 200 frames, that have to be rendered at high quality, high resolution and without artifacts. A typical scene can use about 2 to 20 Gb of memory and deal with the loading of more than 100 Gb of textures. It is expected that one frame takes between 4 to 10 hours of rendering, but for complex scenes, 10 to 20 hours can be acceptable. To do this, loads of 8-core machines with 16 to 32 Gb of RAM each are working 24/7. The total number of cores for the renderfarm is estimated to be 5000.

Given all these huge numbers, unexpectedly, the real cost of making a movie does not come from the huge rendering time, from the office space needed for these machines or from the energy to run them, but from the human flesh and brains time; the artist is the bottleneck. Any tool that helps the artist be more efficient in his job is a great money saving. The frame time is less important than pipe time.

The rendering paradigm is also changing. Before, the reyes technique with RenderMan was used to compute several different passes for the frame (beauty, reflections, refractions, highlights, ambient occlusion, fog, etc) for a later 2D composition. Now the use of ray tracing and global illumination have changed that and Sony has moved its rendering engine from RenderMan to Arnold by Marcos Fajardo (who also was at the conference and I had the oportunity to chat with him). Now less passes are required for final compositing.

Among the tools for the artists to do more efficient job, there are those of relighting, that help the illumination artist to tweak and adjust the illumination of the scene with high quality at interactive rates. Before these tools, the relighting was brute force: if the final image was not satisfactory, the frame, or the whole sequence had to be recomputed. Also part of the relighting could be done in the composition, with the different lightings in different passes and adjusting intensities. The deep buffer technique, keeping scene data at pixel level and allowing a real time adjustment of some kinds of lights, also helped with that. Then sorbetto, based on CUDA from nVidia, appeared, but it was not interactive enough for complex scenes, as it had complexity limits. The next version of sorbetto, named mocha, was promising but was killed before shipping (and I ask myself why?). Arnold has a basic relighting tool in which the raytracing is restarted for every change in the light, but allows for interactive feedback.

In conclusion, it’s not computation power that is needed but tools that help the artist work more efficiently. These tools should be multiplatform and multi OS, and some effort from the industry is needed to define standards. Will Shaderlight do the job?

A week in New Orleans: day 1, from London to New Orleans via Atlanta

Written on Saturday 1st August 10h25 (local time)

First I would like to apologize to my usual readers here. For a few days this blog will be in english and strictly related to my days in New Orleans. I have come here to be for the first time in 10 years and for the second time in my life at SIGGRAPH, the most important conference in graphics in the world.

I wish I had had the opportunity to do a proper interactive update of my impressions these days at the SIGGRAPH and High Performance Graphics (HPG) at New Orleans but nor the hotel nor the HPG conference (in which I am now, just before it starts), have free wi-fi to conect to internet. I probably will pay the 5 dollars (actually it has been 14.95 USD, so now it is even les likely that I update more often) for 24 hours conection tonight at the hotel and publish all this, but meanwhile I write offline.

Yesterday it was just the day of travel. It was a bit of a nightmare, especially from the moment I arrived to Atlanta, where I had to take a second plane to New Orleans. The flight from London was one hour late and I had only 2 hours and 15 minutes now reduced to 1 hour and 15 minutes to get to pass immigration, get the luggage, check in again, pass through security and get in the plane. It was the time to fly and I still was queueing to check in the luggage to New Orleans. I was lucky, though. Somebody from Delta shouted then that all flights were delayed. Mine was expected for 23h30, two hours later than scheduled. Actually, finally we were flying at 00h30, after no less than 4 changes of gate number.

I arrived really late and tired to the hotel, I have slept 5 hours, and here I am, listening to some guy talking about BVH…