Post-processing of HPC data...

I've worked a great deal in the high performance computing arena, in particular, post processing applications for large datasets. I've worked on some of the largest systems in the world (when I worked on them), including ASC White, ASC Q and others during my stint with the ASC VIEWS program at LLNL. I spent most of my time working on distributed rendering and visualization infrastructures and scalable rendering applications. Something that I continue to work on today at CEI.There are a number of OpenSource projects I worked on and you can get sources/binaries for. 

An example of all these technologies running together:

powerwall

Selected Papers

Many of the papers covering these technologies can be found at.  As time/space permits, I will try to put some of them on this web site directly, including these papers and talks.

G. Humphreys, M. Houston, R. Ng, R. Frank, S. Ahern, PD Kirchner, JT Klosowski, Chromium: A Stream-Processing Framework for Interactive Rendering on Clusters, Proceedings of SIGGRAPH 2002, July 2002

Valerio Pascucci, Randall J. Frank, Global Static Indexing for Real-time Exploration of Very Large Regular Grids, proceedings of Supercomputing 2001 Conference, Denver, CO, Nov 10-16 2001

Daniel R. Schikore, Richard A. Fischer, Randall Frank, Ross Gaunt, John Hobson, Brad Whitlock, High-resolution Multi-projector Display Walls and Applications, IEEE Computer Graphics & Applications, July 2000
Selected Talks

R.J. Frank, Telepath: Cluster-based Visualization Services, DOE Computer Graphics Forum 2004, Santa Fe, NM, April 26-29, 2004

R.J. Frank, The Evolution of Distributed Visualization Clusters, Commodity Cluster Symposium, Tysons Corner, VA, July 2003

R.J. Frank, B. Alcorn, Parallel Image Compositing API, Commodity Based Visualization Clusters Workshop, IEEE Visualization 2002, Boston, MA, October 2002

R.J. Frank, Production Cluster Visualization: Experiences and Challenges, IEEE Visualization 2003: Workshop on Parallel Visualization and Graphics, Seattle, WA, October 19-24, 2003

R.J. Frank, Streaming Through My Playstation: Future Directions for Hardware and Software Applications, Engineering Opportunities in the 21st Century Conference, LLNL, March 12-13, 2003

Distributed Multi-headed X11 (DMX)

This project allows one to collect a number of X11 servers running on different machines and using them as a single display. This project is now part of the the X.org server. In fact you can probably find it on most Linux distros these days. The sourceforge project is not really active anymore as the development has moved to the X.org project.

Blockbuster

This project allows for the distributed display of large, multi-scale movies on clusters through the DMX server. It was developed by Tungsten Graphics, but the file format was developed by my team at LLNL.

Chromium

This project allows for parallel rendering of OpenGL applications on clusters of graphics computers. This project won an R&D 100 award a couple of years ago. There is a pretty cool demo of the system in action recorded live here.

TeraScale Browser

We worked on this application for a couple of year while I was at LLNL and it was used largely as a technology showcase for the scalable visualization research at LLNL. The source code is available and there are a couple of really useful libraries in the source that I am using in other applications today. Check it out.

GAIA Project

I started this project originally at LLNL, but left before we got too far along. The use of GPUs for intelligence applications is a very interesting direction. See some of their work here.