# Green Screen Virtual Studio Real-time Green Screen Virtual Studio is a specialized production setup used in film, television, and other media industries. It involves shooting a subject or scene against a cyclorama, which is replaced with your real-time rendered image by Reality 5.3 using **`RealityKeyer`**. ### Process * Select the **Example Project** from the **Renderers** section inside the Reality Hub **Launcher** module.

* Select Reality 5.3 in the **Launch With** section as illustrated above. * Click on the **Launch** button.

* Go to the Engines tab, drag and drop the **`UE5`** node into the Nodegraph canvas.

* Select the **`UE5`** in the nodegraph canvas. * Click on the UE5 in the **Nodes** section. * Click on the **Spawn Reality Camera** and **Spawn Reality Projection Cube** buttons as illustrated above.

* Add **`AJAIn`** and **`AJAOut`** nodes to the Nodegraph canvas. * Right-click on the **`AJAIn`** node and select an input channel from [Node Context Menu](https://zerodensitydocumentation.gitbook.io/docs/reality-5.3-sp1/reality-5.3-sp1/user-guide/nodegraph-actions/nodegraph/node-context-menu). * Right-click on the **`AJAOut`** node and select an output channel. * Connect the corresponding **`SingleLink`** output pin of the **`AJAIn`** node to **`SingleLink`** input of the **`AJAOut`** node. (In our example we utilized **`SingleLink 2`** and **`SingleLink 3`**)

* Right click on the **`SingleLink 2`** and utilize [APM](https://zerodensitydocumentation.gitbook.io/docs/reality-5.3-sp1/reality-5.3-sp1/user-guide/nodegraph-actions/nodegraph/advanced-preview-monitor). * Add a Tracking Node (in our example it is the **`Xync`** node) into canvas.

* Go to the **`Xync`** node property, click on the **`Enable`** checkbox. ### Changing the Transform Mapping

**`Xync`** Node | **`Transform Mapping`** Property Group

Depending on your studio setup, you may be required to change the **`Transform Mapping`** property group settings. In our example, we have to change the **`NegateX`**, **`NegateZ`**, **`CoordinateSystem`**, and **`NegatePan`** properties, as illustrated above. ### Breaking Track In order to get Lens Distortion data, you need to use the **`Break Track`** node. ![Break Track Node](https://1481147318-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fm7K18wy4t0ZT0jAPo8rR%2Fuploads%2F5S3o102bzZL6DVQkivXj%2Fimage.png?alt=media\&token=68b02e90-fe5c-480a-8f5a-358af1be2f05) * Create a **`Break Track`** node. * Connect the **`Xync`** node's Track **`Output`** pin to the **`Break Track`** node's **`Input`** pin.

* Create an **`Undistort`** node. {% hint style="info" %} Undistorting the image taken by your studio camera is necessary because almost every camera lens has some degree of optical distortion. On the other hand, the **`Cyclorama`** node creates a 3D shape that isn't affected by lens distortions. To make sure the Cyclorama and camera image match up correctly, it's crucial to use the undistortion process. {% endhint %} * Go to the **Properties** of the **`Undistort`** node. * Right-click on the **`Distortion`** property and select the "**Show as Input"** option. * Connect the **`Lens Distortion`** output of the **`Break Track`** node to the **`Distortion`** input pin of the **`Undistort`** node. * Connect the **`SingeLink`** output pin of the **`AJAIn`** node to the **`In`** input pin of the **`Undistort`** node. * Connect the **`Out`** output pin of the **`Undistort`** node to **`Video`** input of the **`Cyclorama`** node. * Connect the **`Track`** output pin of the **`Xync`** node to **`Track`** input of the **`Cyclorama`** node.

* Create a **`RealityKeyer`** node and two **`Distort`** nodes. * Right-click on each **`Distort`** node's **`Distortion`** property and select the "**Show as Input"** option. * Connect the **`Render`** output pin of the **`Cyclorama`** node to the **`In`** input pin of the **`Distort`** node. * Connect the **`Mask`** output pin of the **`Cyclorama`** node to the **`In`** input pin of the second **`Distort`** node. * Connect the **`Lens Distortion`** output pin of the **`Break Track`** node to the **`Distortion`** input pin of the **first** **`Distort`** node. * Connect the **`Lens Distortion`** output pin of the **`Break Track`** node to the **`Distortion`** input pin of the **second** **`Distort`** node. * Connect the **`Out`** output pin of the first **`Distort`** node to the **`Clean Plate`** input of the **`RealityKeyer`** node. * Connect the **`Out`** output pin of the second **`Distort`** node to the **`Clean Plate Mask`** the input of the **`RealityKeyer`** node. * Connect the **`SingleLink 2`** output pin of the **`AJAIn`** node to the **`Input`** input pin of the **`RealityKeyer`** node. ### Utilizing Portal Ping and Routing Features At this stage, by its nature, the nodegraph gets complicated and hard to read as illustrated above. To overcome such issues, you can utilize a [Portal Pin](https://zerodensitydocumentation.gitbook.io/docs/reality-5.3-sp1/reality-5.3-sp1/user-guide/nodegraph-actions/nodegraph/portal-pin) and [Reroute](https://zerodensitydocumentation.gitbook.io/docs/reality-5.3-sp1/reality-5.3-sp1/user-guide/nodegraph-actions/nodegraph/reroute) feature.

* Right-click on the **`SingleLink 2`** output pin of the **`AJAIn`** node and select the "**Copy Pin"** option * Right-click on an empty space inside the Nodegraph Canvas and select & paste the previously copied pin as a portal pin as illustrated above. ![Portal Pin Example](https://1481147318-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fm7K18wy4t0ZT0jAPo8rR%2Fuploads%2FsYA7mkuDBGaalaINbjKd%2Fimage.png?alt=media\&token=c3580c2d-8b17-4952-ae40-9665104b178b) The **`AJAIn`** node's **`SingleLink 1`** output pin becomes a **`Portal`** as illustrated above and can be used anywhere inside the nodegraph with the same functionality. Portal Pin also inherits any changes in the main node.

Node Network Example with Pin Portal and Reroute Features

* Connect the **`SingleLink 2`** portal pin to **`In`** input pin of the **`Undistort`** node. * Right-click on an empty space in the nodegraph canvas and paste the **`SingleLink 2`** portal pin again. * Connect the second **`SingleLink 2`** portal pin to the **`Sync`** input pin of the **`Xync`** node. * By following the previous behavior, convert the **`Lens Distortion`** output pin of the **`Break Track`** node into the portal pin. * Paste and connect the **`Lens Distortion`** portal pin to the corresponding input pins of nodes. * Add **Rerouting** between node connections you desire.

Green Screen Virtual Studio Pipeline Example

* Add a second **`Undistort`** node to nodegraph. * Right-click on the **`Distortion`** property and select the "**Show as Input"** option. * Connect the **`Lens Distortion`** output pin of the **`Break Track`** node to the **`Distortion`** input pin of the **`Undistort`** node or create another **`Lens Distortion`** portal pin and connect it to the **`Distortion`** input pin of the **`Undistort`** node. {% hint style="warning" %} If you are doing VR (Virtual Reality) projects, at this point, you have to connect RealityKeyer node's Output pin directly to the Video input of the Composite Passes node. {% endhint %} * Connect the **`Output`** pin of the **`RealityKeyer`** node to the **`In`** input pin of the **`Undistort`** node. * Connect the **`Out`** output pin of the **`Undistort`** node to the **`Projection Cube Video Input`** input of the **`UE5`** node. * Create another **`Xync Track`** portal pin and connect it to the **`Reality Camera Track`** input of the **`UE5`** node. * Create a **`Composite Passes`** node. * Connect the **`RealityKeyer`** node's **`Output`** pin to **`Video`** input pin of the **`Composite Passes`** node. * Create another **`Xync Track`** portal pin and connect it to the **`Track`** input pin of the **`Composite Passes`** node. * Connect the **`RealityCamera Scene`** output pin of the **`RE5`** node to the **`Render`** input of the **`Composite Passes`** node. * Connect the **`Output`** output pin of the **`Composite Passes`** node to **`SingleLink`** input pin of the **`AJAOut`** node.

Image Courtesy of Brand Mind Live Virtual Studio