Real-time multi-perspective rendering on graphics hardware

Multi-perspective rendering has a variety of applications; examples include lens refraction, curved mirror reflection, caustics, as well depiction and visualization. However, multi-perspective rendering is not yet practical on polygonal graphics hardware, which so far has utilized mostly single-perspective (pin-hole or orthographic) projections.In this paper, we present a methodology for real-time multi-perspective rendering on polygonal graphics hardware. Our approach approximates a general multi-perspective projection surface (such as a curved mirror and lens) via a piecewise-linear triangle mesh, upon which each triangle is a simple multi-perspective camera, parameterized by three rays at triangle vertices. We derive analytic formula showing that each triangle projection can be implemented as a pair of vertex and fragment programs on programmable graphics hardware. We demonstrate real-time performance of a variety of applications enabled by our technique, including reflection, refraction, caustics, and visualization.

[1]  Leonard McMillan,et al.  A Framework for Multiperspective Rendering , 2004, Rendering Techniques.

[2]  Baining Guo,et al.  Real-time Multi-perspective Rendering on Graphics Hardware , 2006, Rendering Techniques.

[3]  John C. Hart,et al.  The ray engine , 2002, HWWS '02.

[4]  James F. Blinn,et al.  Texture and reflection in computer generated images , 1976, CACM.

[5]  László Szirmay-Kalos,et al.  Approximate Ray‐Tracing on the GPU with Distance Impostors , 2005, Comput. Graph. Forum.

[6]  Keenan Crane,et al.  Fast GPU ray tracing of dynamic meshes using geometry images , 2006, Graphics Interface.

[7]  Paul Rademacher,et al.  Multiple-center-of-projection images , 1998, SIGGRAPH.

[8]  Leonard McMillan,et al.  Real-time reflection mapping with parallax , 2005, I3D '05.

[9]  Andrew S. Glassner,et al.  Cubism and Cameras: Free-form Optics for Computer Graphics , 2000 .

[10]  Voicu Popescu,et al.  The Occlusion Camera , 2005, Comput. Graph. Forum.

[11]  Cyril Soler,et al.  Graphics gems revisited: fast and physically-based rendering of gemstones , 2004, SIGGRAPH 2004.

[12]  Erik Lindholm,et al.  A user-programmable vertex engine , 2001, SIGGRAPH.

[13]  Pat Hanrahan,et al.  Photon mapping on programmable graphics hardware , 2003, HWWS '03.

[14]  Maneesh Agrawala,et al.  Artistic Multiprojection Rendering , 2000, Rendering Techniques.

[15]  Cyril Soler,et al.  Graphics gems revisited: fast and physically-based rendering of gemstones , 2004, ACM Trans. Graph..

[16]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[17]  Don Herbison-Evans,et al.  Solving Quartics and Cubics for Graphics , 1995 .

[18]  Steven M. Seitz,et al.  Multiperspective Imaging , 2003, IEEE Computer Graphics and Applications.

[19]  Leonard McMillan,et al.  Modelling reflections via multiperspective imaging , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Yoshifumi Kitamura,et al.  Interactive stereoscopic display for three or more users , 2001, SIGGRAPH.

[21]  Wolfgang Straßer,et al.  Real‐Time Caustics , 2003, Comput. Graph. Forum.

[22]  John M. Snyder,et al.  Parameterized environment maps , 2001, I3D '01.

[23]  Pat Hanrahan,et al.  Beam tracing polygonal objects , 1984, SIGGRAPH.

[24]  Chris Wyman.  Interactive image-space refraction of nearby geometry , 2005, GRAPHITE '05.

[25]  Pedro V. Sander,et al.  Silhouette clipping , 2000, SIGGRAPH.

[26]  Ari Rappoport,et al.  Interactive reflections on curved objects , 1998, SIGGRAPH.

[27]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[28]  Philipp Slusallek,et al.  The OpenRT Application Programming Interface - Towards A Common API for Interactive Ray Tracing , 2003 .

[29]  Chris Wyman,et al.  Interactive image-space techniques for approximating caustics , 2006, I3D '06.

[30]  Andreas Simon,et al.  Omnistereo for panoramic virtual environment display systems , 2004, IEEE Virtual Reality 2004.

[31]  Norman I. Badler,et al.  Multi-pass pipeline rendering: realism for dynamic environments , 1997, SI3D.

[32]  Charles T. Loop,et al.  Resolution independent curve rendering using programmable graphics hardware , 2005, ACM Trans. Graph..

[33]  Shree K. Nayar,et al.  Non-Single Viewpoint Catadioptric Cameras: Geometry and Analysis , 2006, International Journal of Computer Vision.

[34]  Pat Hanrahan,et al.  Ray tracing on programmable graphics hardware , 2002, SIGGRAPH Courses.

[35]  Pat Hanrahan,et al.  Ray tracing on a connection machine , 1988, ICS '88.

[36]  J William,et al.  IEEE Computer Graphics and Applications , 2019, Computer.