Clear
Back

The Face Mesh

The face mesh is a 3D model of a face. It works in combination with the face tracker in Spark AR Studio to create a surface that reconstructs someone's expressions.

Once you've added a face tracker and face mesh to your project you can create mask effects, add retouching or change the shape of the face.

Find out about:

Adding a face mesh

To add a face mesh:

  1. Click Add Object.
  2. Select Face Mesh.

If you add a face mesh without a face tracker, a face tracker will be added automatically.

Applying a material to the face mesh

One of the simplest effects you can make in Spark AR Studio is a mask effect. All you need to do is apply a material to the face mesh. To do this:

  1. Select the face mesh in the Scene panel.
  2. In the Inspector, click + next to Materials.

Next either:

  • Choose a material you've already added to your project.
  • Select Create New Material.

The best type of material to use for a mask is the face paint material.

It's worth watching this short tutorial video, for a step-by-step guide to making a mask effect.

Changing the shape of the face mesh

You can use a 3D object called a blend shape to adjust the shape of the face mesh.

You can either make your own using a 3D modeling program, or download the face distortion pack. The face distortion pack includes options to distort many facial features - you can download it and see how we've used it in this tutorial.

To add a blend shape:

  1. Click + next to Deformation in the Inspector.
  2. Select the blend shape you want to use from your computer.

Under deformation a range of sliders will appear, depending on what's included in the blend shape. Adjust the sliders until you're happy with the effect:

Fading the edges of the face mesh

Spark AR Studio provides a range of assets you can use to make face effects.

One of these is the face mesh mask. Use it to fade the edges of the face mesh, so effects like masks blend seamlessly with the head.

Find out more about downloading and using the face mesh mask

Face mesh - properties

Visible

Uncheck this box to stop the face mesh from rendering in the scene.

Face Tracker

You can have more than one face tracker in the scene. Choose which face tracker will drive the face mesh.

Eyes

Choose whether you want the face mesh to have an opening for someone's eyes, or not.

Mouth

Choose whether you want the face mesh to have an opening for a mouth, or not.

Transformations

Edit the position, scale and rotation of the face mesh.

Material

Choose the material you want to apply to the mesh, or create a new one.

Deformation

Make changes to the shape of the face, using blend shapes you've created in 3D modeling software. Find out more about deforming the face mesh.

Morph Object

If you want to deform the shape of the face, you'd apply the blend shape here.

Blend Shapes

Use the slider to change the appearance of the face, if you've applied a blend shape to your face mesh.

Actions

Insert simple combinations of patches into the Patch Editor, like tap gestures.

Enable For

Choose the camera or cameras on a mobile device in which you want to render the face mesh

Creating patches to represent the face mesh

To create a patch to represent the face mesh, all you need to do is select the face mesh in the Scene panel and drag it into the Patch Editor.

Connect this patch to the Object Tap patch, to create a boolean signal each time the face mesh in the scene is tapped.

Optimization

Including multiple face meshes in a scene will impact the performance of your effect. It's best to avoid layering more than 5.

Next steps

Join the Spark AR Creator's community

Find inspiration, see examples, get support, and share your work with a network of creators.

Join Community

Join the Spark AR Creator's community

Find inspiration, see examples, get support, and share your work with a network of creators.

Join Community

Frequently asked questions

Have a specific question? Maybe it's been answered.


Read FAQs
Was this document helpful?