Green Screen Virtual Studio
Real-time Green Screen Virtual Studio is a specialized production setup used in film, television, and other media industries. It involves shooting a subject or scene against a cyclorama, which is replaced with your real-time rendered image by Reality 5.3 using RealityKeyer
.
Process
Select the Example Project from the Renderers section inside the Reality Hub Launcher module.
Select Reality 5.2 in the Launch With section as illustrated above.
Click on the Launch button.
Go to the Engines tab, drag and drop the
UE5
node into the Nodegraph canvas.
Select the
UE5
in the nodegraph canvas.Click on the UE5 in the Nodes section.
Click on the Spawn Reality Camera and Spawn Reality Projection Cube buttons as illustrated above.
Add
AJAIn
andAJAOut
nodes to the Nodegraph canvas.Right-click on the
AJAIn
node and select an input channel from Node Context Menu.Right-click on the
AJAOut
node and select an output channel.Connect the corresponding
SingleLink
output pin of theAJAIn
node toSingleLink
input of theAJAOut
node. (In our example we utilizedSingleLink 2
andSingleLink 3
)
Right click on the
SingleLink 2
and utilize APM.Add a Tracking Node (in our example it is the
Xync
node) into canvas.
Go to the
Xync
node property, click on theEnable
checkbox.
Changing the Transform Mapping
Depending on your studio setup, you may be required to change the Transform Mapping
property group settings.
In our example, we have to change the NegateX
, NegateZ
, CoordinateSystem
, and NegatePan
properties, as illustrated above.
Breaking Track
In order to get Lens Distortion data, you need to use the Break Track
node.
Create a
Break Track
node.Connect the
Xync
node's TrackOutput
pin to theBreak Track
node'sInput
pin.
Create an
Undistort
node.
Undistorting the image taken by your studio camera is necessary because almost every camera lens has some degree of optical distortion. On the other hand, the Cyclorama
node creates a 3D shape that isn't affected by lens distortions. To make sure the Cyclorama and camera image match up correctly, it's crucial to use the undistortion process.
Go to the Properties of the
Undistort
node.Right-click on the
Distortion
property and select the "Show as Input" option.Connect the
Lens Distortion
output of theBreak Track
node to theDistortion
input pin of theUndistort
node.Connect the
SingeLink
output pin of theAJAIn
node to theIn
input pin of theUndistort
node.Connect the
Out
output pin of theUndistort
node toVideo
input of theCyclorama
node.Connect the
Track
output pin of theXync
node toTrack
input of theCyclorama
node.
Create a
RealityKeyer
node and twoDistort
nodes.Right-click on each
Distort
node'sDistortion
property and select the "Show as Input" option.Connect the
Render
output pin of theCyclorama
node to theIn
input pin of theDistort
node.Connect the
Mask
output pin of theCyclorama
node to theIn
input pin of the secondDistort
node.Connect the
Lens Distortion
output pin of theBreak Track
node to theDistortion
input pin of the firstDistort
node.Connect the
Lens Distortion
output pin of theBreak Track
node to theDistortion
input pin of the secondDistort
node.Connect the
Out
output pin of the firstDistort
node to theClean Plate
input of theRealityKeyer
node.Connect the
Out
output pin of the secondDistort
node to theClean Plate Mask
the input of theRealityKeyer
node.Connect the
SingleLink 2
output pin of theAJAIn
node to theInput
input pin of theRealityKeyer
node.
Utilizing Portal Ping and Routing Features
At this stage, by its nature, the nodegraph gets complicated and hard to read as illustrated above. To overcome such issues, you can utilize a Portal Pin and Reroute feature.
Right-click on the
SingleLink 2
output pin of theAJAIn
node and select the "Copy Pin" optionRight-click on an empty space inside the Nodegraph Canvas and select & paste the previously copied pin as a portal pin as illustrated above.
The AJAIn
node's SingleLink 1
output pin becomes a Portal
as illustrated above and can be used anywhere inside the nodegraph with the same functionality. Portal Pin also inherits any changes in the main node.
Connect the
SingleLink 2
portal pin toIn
input pin of theUndistort
node.Right-click on an empty space in the nodegraph canvas and paste the
SingleLink 2
portal pin again.Connect the second
SingleLink 2
portal pin to theSync
input pin of theXync
node.By following the previous behavior, convert the
Lens Distortion
output pin of theBreak Track
node into the portal pin.Paste and connect the
Lens Distortion
portal pin to the corresponding input pins of nodes.Add Rerouting between node connections you desire.
Add a second
Undistort
node to nodegraph.Right-click on the
Distortion
property and select the "Show as Input" option.Connect the
Lens Distortion
output pin of theBreak Track
node to theDistortion
input pin of theUndistort
node or create anotherLens Distortion
portal pin and connect it to theDistortion
input pin of theUndistort
node.Connect the
Output
pin of theRealityKeyer
node to theIn
input pin of theUndistort
node.Connect the
Out
output pin of theUndistort
node to theProjection Cube Video Input
input of theUE5
node.Create another
Xync Track
portal pin and connect it to theReality Camera Track
input of theUE5
node.Create a
Composite Passes
node.Connect the
RealityKeyer
node'sOutput
pin toVideo
input pin of theComposite Passes
node.Create another
Xync Track
portal pin and connect it to theTrack
input pin of theComposite Passes
node.Connect the
RealityCamera Scene
output pin of theRE5
node to theRender
input of theComposite Passes
node.Connect the
Output
output pin of theComposite Passes
node toSingleLink
input pin of theAJAOut
node.
Last updated