User:HeroCam/sandbox

For other uses, see Caustic (disambiguation).

Caustics produced by a glass of water

In optics, a caustic or caustic network is the envelope of light rays reflected or refracted by a curved surface or object, or the projection of that envelope of rays on another surface. The caustic is a curve or surface to which each of the light rays is tangent, defining a boundary of an envelope of rays as a curve of concentrated light. Therefore, in the adjacent image, the caustics can be the patches of light or their bright edges. These shapes often have cusp singularities.

Nephroid caustic at bottom of tea cup

Caustics made by the surface of water

Explanation

Concentration of light, especially sunlight, can burn. The word caustic, in fact, comes from the Greek καυστός, burnt, via the Latin causticus, burning. A common situation where caustics are visible is when light shines on a drinking glass. The glass casts a shadow, but also produces a curved region of bright light. In ideal circumstances (including perfectly parallel rays, as if from a point source at infinity), a nephroid-shaped patch of light can be produced. Rippling caustics are commonly formed when light shines through waves on a body of water.

Another familiar caustic is the rainbow. Scattering of light by raindrops causes different wavelengths of light to be refracted into arcs of differing radius, producing the bow.

Computer graphics

Photograph of a typical wine glass caustic

Computer rendering of a wine glass caustic

In computer graphics, most modern rendering systems support caustics. Some of them even support volumetric caustics. This is accomplished by raytracing the possible paths of a light beam, accounting for the refraction and reflection. Photon mapping is one implementation of this. Volumetric caustics can also be achieved by volumetric path tracing. Some computer graphic systems work by "forward ray tracing" wherein photons are modeled as coming from a light source and bouncing around the environment according to rules. Caustics are formed in the regions where sufficient photons strike a surface causing it to be brighter than the average area in the scene. “Backward ray tracing” works in the reverse manner beginning at the surface and determining if there is a direct path to the light source. Some examples of 3D ray-traced caustics can be found here.

The focus of most computer graphics systems is aesthetics rather than physical accuracy. This is especially true when it comes to real-time graphics in computer games where generic pre-calculated textures are mostly used instead of physically correct calculations.

Caustic engineering

Caustic engineering describes the process of solving the inverse problem to computer graphics. That is, given a specific image, to determine a surface whose refracted or reflected light forms this image.

In the discrete version of this problem, the surface is divided into several micro-surfaces which are assumed smooth, i.e. the light reflected/refracted by each micro-surface forms a Gaussian caustic. Gaussian caustic means that each micro-surface obey gaussian distribution. The position and orientation of each of the micro-surfaces is then obtained using a combination of Poisson integration and simulated annealing.

There have been many different approaches to address the continuous problem. One approach uses an idea from transportation theory called optimal transport to find a mapping between incoming light rays and the target surface. After obtaining such a mapping, the surface is optimized by adapting it iteratively using Snell's law of refraction.

Optimal-transport-based caustic pattern design

Basic principle

Controlling caustic pattern is rather a challenging problem as very minor changes of the surface will significantly affect the quality of the pattern since light ray directions might be interfered by other light rays as they intersects with and refract through the material. This will lead to a scattered, discontinuous pattern. To tackle this problem, optimal-transport-based is one of the existing proposed methods to control caustic pattern by redirecting light's directions as it propagates through the surface of a certain transparent material. This is done by solving an inverse optimization problem based on optimal transport. Given a reference image of an object/pattern, the target is to formulate the mathematical description of the material surface through which light refracts and converges to the similar pattern of the reference image. This is done by rearranging/recomputing the initial light intensity until the minimum of the optimization problem is reached.

Design pipeline

Here considering only refractive caustic, the objective can be determined as follows (similar principle for reflective caustic with different output):

Input: image of pattern to be obtained after propagating lights through the material, given the light source position.

Output: caustic geometry on the receiver (flat solid surface, e.g.: floor, wall, etc...)

In order to achieve the target pattern, the surface where light refracts through and exits to the outer environment must be manufactured into certain shape to achieve desired pattern on the other side of the material.

As mentioned, given an input image, this process will produce the similar caustic pattern as the output. In principle, there are two core stages with each includes two sub-stages:

• 

  Optimal-transport-based caustic design

  Solving Optimal Transport Problem
  1. Compute Target Light Distribution
  2. Compute Mapping from Initial Distribution to Target Distribution
• Optimizing Target Surface
  1. Compute Normal Representation of Surface
  2. Surface Refinement

Solving optimal transport problem

As the case refraction occurs through a transparent surface, for instance the patterns appearing under clear water surface, 3 main phenomena can be observed:

• Very bright (condensed light intensity) points (so-called singularity)
• Curve-like objects that connect the points
• Regions with low light intensity

To perform computation, the following 3 quantities are being respectively introduced to describe the geometric characteristics of the pattern: point singularity $\Phi _{p}$ (measuring light intensity at certain highly concentrated light-point), curve singularity $\Phi _{c}$ (measuring light intensity at/around a light-curve), and irradiance measure $\Phi _{I}$ (measuring intensity in a certain poorly concentrated light-area). Putting them altogether, the following function defines the total radiant flux measure $\Phi _{T}$ at a certain section Ω on the target surface:

$\Phi _{T}(\Omega )=\textstyle \sum _{i=1}^{N_{\delta }}\Phi _{p}^{i}(\Omega )+\sum _{j=1}^{N_{\gamma }}\Phi _{c}^{j}(\Omega )+\Phi _{I}(\Omega )\displaystyle$

After this step, there are two existing measures of the radiant flux measures of the source $\Phi _{S}$ (uniform distribution, by initialization) and the target $\Phi _{T}$ (computed in previous step). What remains to compute is the mapping from the source to target. In order to do this, there are several quantities to be defined. Firstly, two light intensities evaluated by probabilities: $\mu _{S}$ (light intensity evaluated by dividing $\Phi _{S}$ by the flux of the union region between $\Phi _{S}$ and $\Phi _{T}$), $\mu _{T}$ (light intensity evaluated by dividing $\Phi _{T}$ by the flux of the union region between $\Phi _{S}$ and $\Phi _{T}$) are defined. Secondly, the source mesh is generated as multiple sites $s_{i}\in (\Phi _{S}\cup \Phi _{T})$, which is later being deformed. Next, a power diagram $P_{w}$ (a set of $C_{i}^{w}$ power cells) is defined on this set of sites $s_{i}$ weighted by a weight vector $\omega$. Finally, the goal is to decide whether which power cells are going to be move. Considering all $x$ vertices on the surface, finding the minimizer $\omega _{min}$ of the following convex function will produce the matched power diagram for the target:

$f(\omega )=\sum _{s_{i}\in S}(\omega _{i}.\mu _{S}(C_{i}^{0})-\int \limits _{C_{i}^{\omega }}(\|x-s_{i}\|^{2}-\omega _{i})d\mu _{T}(x))$

Optimizing target surface

Computation Process

After solving optimal transport problem, the vertices are achieved. However, this gives no information about what the final surface should look like. To achieve the desired target surface given the incoming light ray $d_{I}$, outgoing light ray $d_{O}$ and power diagram from the step above, the surface normals representation can be computed according to Snell's law as:

$n=d_{I}+{\eta x \over \lVert d_{I}+\eta d_{T}\rVert }=d_{I}+{\eta x \over \lVert d_{I}+\eta {(x_{R}-x) \over ||x_{R}-x||}\rVert }$

where,

$\eta$: refraction coefficient

$x_{R}$: target position obtained from solving above optimal transport problem

As the normal representation is obtained, surface refinement is then achieved by minimizing the following compound energy function:

${\underset {x}{\operatorname {arg\,max} }}\,\omega \,\cdot [E_{int},\,E_{dir},\,E_{flux},\,E_{reg},\,E_{bar}]$

where,

$E_{int}=\sum _{v\in M_{T}}\lVert n_{o}-n\rVert _{2}^{2}$ is the integration energy that aligns the vertex normals $n_{o}$ obtained from the Optimal Transport with the target normals $n$ obtained from the Snell's law computation above.

$E_{dir}=\sum _{v\in M_{T}}\lVert x-{\textbf {proj}}_{(x_{S},\,d_{I})}(x)\rVert _{2}^{2}$ as mesh generated in step Solving Optimal Transport cannot adapt to the sharp instances from the discontinuities, this energy is to penalize the vertices to not change significantly from the incoming light ray.

$E_{flux}=\sum _{t\in M_{T}}\lVert \Phi _{T}(t)-\Phi _{S}(t_{s})\rVert _{2}^{2}$ is the energy measuring the flux over the triangle $t$ in the mesh.

$E_{reg}=\lVert {\textbf {L}}{\textbf {X}}\rVert _{2}^{2}$ is the energy that regularizes the shape of the triangles to maintain its well-shapedness.

$E_{bar}=\sum _{v\in M_{T}}\lVert max(0,-log((1-n_{R}.(x-x_{R}))+d_{TH})\rVert ^{2}$ is barrier energy to ensure that surface does not deform beyond a certain distance threshold $d_{TH}$.

Implementation

x_i = # Vertex position of M_s
r = # Optimal transport mapping
x_o = # Vertex position of M_T

def target_optimize(x_i, r):
    """Target optimize."""
    x_r = solve_optimal_transport(x_i, r)
    while not_converged:
        compute_outgoing_light_ray(x_r - x_i)
        n_prime = compute_refract_normal(x_i, D_T)
        x_o = refine_surface(x_i, n_prime)
    
    return x_o

Differentiable inverse rendering caustic pattern design

Basic principle

Inverse graphics is a method to observe the data from image and infer all possible properties including 3D geometry, lighting, materials, and motion, thus generating realistic image. In conventional computer graphics, to render an image with desired appearance and effects, it is given all the properties/characteristics. This could be considered as the forward process. On the contrary, in caustic design, the properties and characteristics of objects (especially the material surface) are not trivial. The given constraint is the target image to obtain . Therefore, the goal is to get the properties and characteristics by observing and infering the target image. This can be considered the inverse/backward process.

The following is the basic loss function explaining how to optimize the parameters:

$L(c)=\lVert f(c)-I\rVert ^{2}$

where,

L(c): loss function, mean square error of the rendered image and the target

c: contains elements which can influence the generated image

I: target image

Designed Pipeline

Differentiable inverse rendering caustic design

At first, the target pattern is designed and compute the forward pass to get the synthetic pattern. It's compared to the target pattern and get the loss. The objection is to let the synthetic pattern is similar to the target pattern as much as possible. And then do the back propagetion to get the optimized properties need to use in caustic manufacturing.

Elements contributing to generated image

• Appearance ($A$): per-pixel surface appearance is modeled as product of mipmapped texture and per-pixel brightness.
• Geometry ($V$): assume a 3D scene to be approximated by triangles, parameterized by vertices $V$.
• Camera ($C$): focal length, the point of view, the center of the camera.

There could be more elements, for example albedo and refraction coefficient.

General differentiable framework

Introduce U as an intermediate variable indicating 2D projected vertex coordinate positions. The gradient of these properties can be derived by chain rule indirectly.

${\frac {\partial f}{\partial V}}={\frac {\partial f}{\partial U}}\times {\frac {\partial U}{\partial V}}$

${\frac {\partial f}{\partial V}}={\frac {\partial f}{\partial A}}\times {\frac {\partial A}{\partial V}}$

${\frac {\partial f}{\partial C}}={\frac {\partial f}{\partial U}}\times {\frac {\partial U}{\partial C}}$

After applying the stochastic gradient descent, the optimal $A$, $V$ and $C$ could be achieved. Subsequently, these quantities are used to carve or mill the material to generate the target pattern.

Implementation

One common approach is to utilize the ability to perform differential operations in various Deep Learning auto-differentiation frameworks/libraries such as: Tensorflow, PyTorch, Theano.

One more approach is to make use of the OpenDR framework to build a forward graphics model and to automatically obtain derivatives with respect to the model parameters for optimization. As optimization properties are obtained, the target image can be generated. OpenDR provides a local optimization method that can be incorporated into probabilistic programming frameworks. This can be used to solve the problem of caustic.

Per-pixel discrete caustic pattern design

Basic Principle

Per-pixel manipulation can generate a diverse array of artistic images. In discrete caustic design, each pixel can be absorbed and redirected light in different position so that can be generated different patterns. Each pixel is considered to be "a stick" and it can be replaced or rotated to redirect the light in different positions, generating the target image. However, mimicking this process is too time-consuming to generate some complicated patterns since there are millions of combinations for these sticks. In order to achieve the goal more easily, it is necessary to determine the layout of the sticks in such a way that the light is redirected by the sticks to form the target caustic geometry on the receiver.

Cautisc in Pixel Art

Each stick can redirect light in four directions

Constraints

The binary variable $A_{i,\,j,\,k}={0\ or\ 1}$ represents all of the possible placement of the sticks. The integer $i=1...N_{T}$ denotes the type of the stick and $N_{T}$ is the number of types. Different types of material have different refracted index, which means that light would be refracted in different angles. In , the material is only acrylate resin. The integer $j=1,\,2,\,3,\,4$ denotes the rotated orientation. Each stick can be rotated in four directions ${0^{\circ },90^{\circ },180^{\circ },270^{\circ }}$. Therefore, for a specific stick, the light can be refracted in four positions. The integer $k=1...N_{P}$ denotes the position of stick and $N_{P}$ is the number of pixel.

$s_{x}$ and $s_{y}$ denote as described above instead of $i$, and $p_{x}$ and $p_{y}$ instead of $k$. And the color of desired pattern at the position $(q_{x},\,q_{y})$ denotes as $c(q_{x},\,q_{y})$. In practice, there would be some variations from the desired light. Therefore, it is able to represent the amount of these variations by using variable $n(q_{x},\,q_{y})$. The following constraint is considered:

$\sum _{s_{x,j}+p_{x}=q_{x}\ \ s_{y,j}+p_{y}=q_{y}}A_{(s_{x},s_{y}),j,(p_{x},p_{y})}=c(q_{x},q_{y})+n(q_{x},q_{y})$

Because the intensity of the pixels on the screen should not be negative, the third constraint must be satisfied as:

$\ c(q_{x},q_{y})+n(q_{x},q_{y})$ ≥ 0

Objective Function

The goal is to make the noise small and smooth. Therefore, minimizing the sum of variation and the gradient ensures the minimal noise without fluctuating significantly. The objective function is formulated as:

${\underset {A_{i,j,k};n_{q_{x},q_{y}}}{\operatorname {arg\,min} }}\,w_{a}\sum _{q_{x},q_{y}}n^{2}(q_{x},q_{y})+w_{b}\sum _{q_{x},q_{y}}|\nabla n(q_{x},q_{y})|^{2}$

The sticks can be rearranged with respect to the optimal parameters to form the target geometry.

Manufacturing, materials and applications

Manufacturing

As the caustic pattern has been designed computationally, the processed data will be then sent to manufacturing stage to get final product. The most common approach is subtractive manufacturing.

Design and manufacturing process

Materials

In general, the caustic pattern principles can apply to any refractive (or reflective) materials and this is mostly done by machining methods (i.e.: subtractive manufacturing). There are various materials that can be used depending on the quality of the caustic, the effort it takes to manufacture and the available manufacturing method. There are some of the most common materials that can be used to design caustic pattern, such as:

• Refractive materials: Poly(methyl methacrylate) (so called arcrylic glass), Polycarbonate, Polyethylene, Silicate glass, Fiber glass, Diamond, etc...
• Reflective materials: Steel, Iron, Aluminum, Gold, Silver, Titanium, Nickel, etc...

Applications

The caustic pattern design has many real-world applications, for example in the following fields:

Architecture

• Luminaires
• Jewelry
• Architecture
• Decoration in glass production

See also

• Focus (optics)
• Circle of confusion
• Caustic (mathematics)
• Voronoi diagram
• Imperative programming
• Parallel programming model

References

• Born, Max; Wolf, Emil (1999). Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light (7th ed.). Cambridge University Press. ISBN 978-0-521-64222-4.
• Nye, John (1999). Natural Focusing and Fine Structure of Light: Caustics and Wave Dislocations. CRC Press. ISBN 978-0-7503-0610-2.

Further reading

• Ferraro, Pietro (1996). "What a caustic!". The Physics Teacher. 34 (9): 572–573. Bibcode:1996PhTea..34..572F. doi:10.1119/1.2344572.
• Dachsbacher, Carsten; Liktor, Gábor (February 2011). "Real-time volume caustics with adaptive beam tracing". Symposium on Interactive 3D Graphics and Games. ACM: 47–54.

Category:Geometrical optics