Clear
Back

The Face Mesh

The face mesh is a 3D model of a face. It works in combination with the face tracker in Spark AR Studio to create a surface that reconstructs someone's expressions.

Once you've added a face tracker and face mesh to your project you can create mask effects, add retouching or change the shape of the face.

Learn about:

Adding a face mesh

To add a face mesh:

  1. Click Add Object.
  2. Select Face Mesh.

If you add a face mesh without a face tracker, a face tracker will be added automatically.

Applying a material to the face mesh

One of the simplest effects you can make in Spark AR Studio is a mask effect that places a texture over someone's face. All you need to do is apply a material to the face mesh.

To do this:

  1. Select the face mesh in the Scene panel.
  2. In the Inspector, click + next to Materials.

Next add a material to the face mesh. Either:

  • Choose a material you've already added to your project.
  • Select Create New Material.

To build the appearance of the mask, add custom textures and color to the material.

Watch this short tutorial video for a step-by-step guide to making a mask effect.

Changing the shape of the face mesh

Use a 3D object called a blend shape to adjust the shape of the face mesh. Either make your own using a 3D modeling program, or download the face distortion pack. The face distortion pack includes options to distort many facial features - see how it's used in this tutorial.

To add a blend shape:

  1. Click + next to Deformation in the Inspector.
  2. Select the blend shape you want to use from your computer.

Under deformation a range of sliders will appear, depending on what's included in the blend shape. Adjust the sliders until you're happy with the effect:

Fading the edges of the face mesh

Fading the edges of the face mesh makes an effect blend seamlessly with the head.

Spark AR Studio provides a range of assets you can use to make face effects. One of these is the face mesh mask, which you can use the fade the edges of the face mesh.

In the image below, we've used the face mesh mask in the effect on the right:



Find out more about downloading and using the face mesh mask.

Face mesh - properties

Visible

Uncheck this box to stop the face mesh from rendering in the scene.

Face Tracker

You can have more than one face tracker in the scene. Choose which face tracker will drive the face mesh.

Eyes

Choose whether you want the face mesh to have an opening for someone's eyes, or not.

Mouth

Choose whether you want the face mesh to have an opening for a mouth, or not.

Transformations

Edit the position, scale and rotation of the face mesh.

Material

Choose the material you want to apply to the mesh, or create a new one.

Deformation

Make changes to the shape of the face, using blend shapes you've created in 3D modeling software. Find out more about deforming the face mesh.

Morph Object

If you want to deform the shape of the face, you'd apply the blend shape here.

Blend Shapes

Use the slider to change the appearance of the face, if you've applied a blend shape to your face mesh.

Actions

Insert simple combinations of patches into the Patch Editor, like tap gestures.

Enable For

Choose the camera or cameras on a mobile device in which you want to render the face mesh

Creating patches to represent the face mesh

To create a patch to represent the face mesh, all you need to do is select the face mesh in the Scene panel and drag it into the Patch Editor.

Connect this patch to the Object Tap patch, to create a boolean signal each time the face mesh in the scene is tapped.

Optimization

Avoid including more than 5 face meshes in a project. Including too many will impact the performance of your effect.

Next steps

Join the Spark AR Creator's community

Find inspiration, see examples, get support, and share your work with a network of creators.

Join Community

Join the Spark AR Creator's community

Find inspiration, see examples, get support, and share your work with a network of creators.

Join Community

Frequently asked questions

Have a specific question? Maybe it's been answered.


Read FAQs
Was this document helpful?