Spatial Camera Tracker 1.05

The Spatial Camera Tracker is a noteworthy tool for filmmakers looking to enhance their projects with computer-generated (CG) content. It offers an innovative solution for synchronizing real and virtual cameras, making it particularly appealing for those interested in creating Mixed Reality footage.

This virtual production tool enables users to capture high-definition video alongside positional tracking information for both the camera and the subjects in the frame. One of its standout features is the ability to operate without external sensors, allowing for recordings in various locations and over considerable distances, all utilizing an iPhone or iPad. However, it is important to note that not all features are compatible with every device, so prospective users should consult the specifications for details.

Once the tracking information is captured, users can effortlessly import it into Unreal or Unity engines to manipulate virtual cameras, effectively recreating original camera movements. This facilitates the integration of CG footage with live-action recordings through standard video editing software or in-engine techniques. Additionally, the iterative process allows creators to refine their virtual scenes until achieving the desired outcome.

The Spatial Camera Tracker includes three distinct capture modes:

• Camera World Tracking: Offers six degrees of freedom (DOF) tracking of the device's location and rotation in 3D space. It is suitable for aligning CG greenscreen footage with recorded footage and is available on any ARKit-supported device.
• Green Screen Recording: Functions similarly to Camera World Tracking but applies a green screen effect to segment out subjects being filmed. This mode is ideal for aligning real footage with CG-rendered scenes and requires a device equipped with an A12 chip or higher.
• Body Tracking: Provides comprehensive human skeleton joint tracking for a single subject. This mode allows for CG effects to be anchored directly to the individual being filmed, requiring a device with an A12 chip or higher.

Additionally, Spatial Camera Tracker supports LiDAR technology on the latest iPad Pro models, enabling users to capture environmental geometry. This capability can be leveraged to align CG objects and effects with real-world footage or assist in recreating a virtual representation of physical spaces.

For those looking to maximize the utility of recorded spatial data, plugins are available via GitHub for both Unreal and Unity:

• Unreal Plugin
• Unity Plugin