In Spark AR Studio, use the face tracker to create an effect that responds to or augments someone's face.
When a face tracker is combined with a face mesh, it creates a surface that can detect facial movements and expressions. You can add a material to the face mesh to create a mask effect. Follow this video tutorial to build a mask effect yourself.
You can add more than one face tracker to a scene, to create an effect that can be used by more than one person. You can also use the face tracker to create a texture that replicates the face of the person using the effect.
To add a face tracker to your effect:
You'll see an axis tracking the face in the Viewport:
If your effect has a face tracker in it, an instruction saying Find a face! will appear until a face is detected by the camera. You can also add custom instructions to effects.
Objects that are children of a face tracker will move with the face detected in the scene.
To make an object the child of the face tracker, simply drag the object onto the face tracker in the Scene panel. You can then use the manipulators to adjust its position. To track objects to precise positions on the face, you can use face landmark patches.
When you've selected the face tracker in the Scene panel, you'll see its properties in the Inspector on the right of the interface.
Adjust these properties to make changes to how the face tracker works.
Click the dropdown next to Layer to adjust which layer the face tracker is assigned to.
Uncheck the box next to Visible to stop the face tracker and any children from being rendered in the scene.
Choose which face the face tracker will track.
Adjust this property if you're creating an effect with more than one face tracker, to be used by more than one person.
For example, if a face tracker is set to Face 1, it will track the first face to appear in the camera after the effect has been opened. Find out more.
You can't change the position, scale or rotation of a face tracker. This is because these values are controlled by the position of the face detected by the face tracker.
Turn the points being tracked on the face into a texture.
Insert simple combinations of patches involving the face tracker into the Patch Editor.
Choose whether the face tracker and its children are rendered in the front or back camera, or both.
Adding multiple face trackers to a scene will have an impact on performance, so it's good idea test your effect as you build it using the Spark AR Player app.
You can create a patch representing the face tracker by dragging it from the Scene panel into the Patch Editor.
Three patches will be created: