• Download the App
• About ToF AR
• Overview of ToF AR Samples Basic
• Component
• Assets
• Development environment
• Notes
• Contributing

Experience immersive AR scenes made with ToF AR.
Download ToF AR Samples Basic now from App Store and Google Play and try it out!

ToF AR, Time of Flight Augmented Reality, is a toolkit library for Unity providing application developers with tools to start building immersive worlds for iOS and Android devices. ToF AR mainly targets iOS and Android smartphones with a ToF sensor from Sony, but it also works with other depth sensors, such as structured light method sensors.

As well as ToF AR, Unity and compatible devices with ToF sensors are required to build and execute the ToF AR Samples Basic application.

Please see the ToF AR Site on Developer World for ToF AR downloads and development guides, sample applications, and a list of compatible devices.

ToF AR Samples Basic is a simple sample application that uses the functions of ToF AR and provides the following 17 scenes:

Color	ColorDepth	BasicStream	DepthConfidence
Display Color image	Superimpose Color image and Depth image	Tile Depth, Confidence and Color images	Display Depth image and Confidence image side by side

PointCloud	ColoredPointCloud	HumanPointCloud	Segmentation
Display a subject as a single color PointCloud	Display a subject as a color PointCloud	Display a human body as a color PointCloud	Display segmentation results for person and sky as masks

Hand	LiveMeshOcclusion	ColorHandOcclusion	Body
Display a hand bone model	Display a virtual cube occluded by the subject based on distance measurement	Display a virtual cube occluded by the hand based on distance measurement, and display hand bone model	Display a human bone model on the Depth image

ColorBody	HandMark	ColorHandMark	SLAM
Display a human bone model on superimposed Depth and Color image	Recognize the mark drawn with the index finger and display the mark name	Recognize the mark drawn with the index finger and display the mark name. Superimpose Color image and Depth image.	Display the coordinates of the SLAM-supported camera

Face
Overlay a white mask on the face based on face recognition. Also display the recognition result from the shape of the mouth.

Using the built application is described below.

1. When you start the application, the scene list is displayed on the screen. Select a scene from the list and tap it to start it.

2. Tap the camera icon at the bottom left of the screen to display a list of available cameras for the selected scene. Select an appropriate camera, and the scene will start working.

3. Tap the screen with four fingers to return to the top screen.

The table below shows the relationships between the 17 scenes in the sample application and the ToF AR components used by each scene. The scene names are arranged vertically and the component names are arranged horizontally. A check mark indicates that the component is used.

ToF AR Samples Basic provides the following assets. Assets include URP (Universal Render Pipeline) and VRM (Virtual Reality Model) for 3D characters and avatars.

17 sample scene scripts and resources are stored for each component.

Prefabs and scripts are stored as the configuration change UI used by each component.

URP is the standard lightweight rendering pipeline of Unity for displaying scene content. URP is included in the asset.

Please see Universal Render Pipeline documentation.

VRM is a platform-independent 3D avatar file format for humanoid characters and avatars. VRM is included in the asset.

Please see VRM documentation.

ToF AR is required for build. Download the ToF AR toolkit from the ToF AR Site on Developer World, then import it and use it in a Unity project. Note that both Base and Hand components are required by ToF AR Server.

If the project is opened before ToF AR is set up, a confirmation message to enter safe mode may appear, depending on your settings. If you start Unity in safe mode, exit safe mode and then import the ToF AR package.

ToF AR Development documents are also available on Developer World.

• ToF AR user manual for overview and usage
• ToF AR reference articles for articles about each component
• ToF AR API references

Operation was verified in the following environment:

• Unity Version : 2021.3.18f1
• ToF AR Version : 1.3.0

Be aware that recognizable hand gestures may have different meaning in countries/areas.
Prior cultural checks are advisable.

We cannot accept any Pull Request (PR) at this time. However, you are always welcome to report bugs and request new features by creating issues.

We have released this program as a sample app with a goal of making ToF AR widely available. So please feel free to create issues for reporting bugs and requesting features, and we may update this program or add new features after getting feedback.