Patches in Spark AR Studio allow you to add interaction, animation and logic to your effects. You can also use them to create materials.
Patches act as visual building blocks, with each patch performing a unique function. You'll connect them together in what's known as a graph, allowing the patches you've connected to pass and receive information to and from one another. Many capabilities available in scripting can be added to your effect as patches, so you can add interaction and complexity without knowing how to code.
Once you've learned the basics, it's worth taking a look at the different ways we've used patches to build full effects, in our sample effect tutorials.
Add animations to effects, including adding procedural animation to 3D objects with bones and joints.
Add effects like distortion and pitch changing to audio sources and control how audio plays in your effects.
Capture the precise position of parts of the face, such as eyes and nose.
Detect gestures from the person using your effect and make something happen as a result.
Define the conditions needed for something to happen in an effect, such as triggering an animation to play when when the user interacts with the device in a certain way.
Perform math operations on inputted patches.
Change the appearance of a material.
Create procedural textures like shapes and patterns.
Track the number of seconds an effect is running.
Add UI functions to your effect.
Broad range of patches, from face trackers to random number generators.
To open the Patch Editor:
The Patch Open will open at the bottom of the Spark AR Studio interface.
Many elements of your project can be represented as patches.
The patches you'll use to add logic, interaction, animation and other audio effects are known as Intermediary patches. These patches take the information from the producer patch and manipulate it - depending on the type of intermediary patch you choose.
Objects in the Scene Panel
Drag objects from the Scene Panel, into the Patch Editor. To try this out, add a face tracker to your scene, and drag it into the Patch Editor.
The face tracker will detect the position and movement of the face of the person using your effect, and produce a signal that can be passed to the patches it's connected to. Because of this, it's known as a producer patch.
Properties in the Inspector
Every graph you build will eventually pass a signal to a patch representing the property of something in your scene, making something happen to that property.
To create a patch representing a property, select the object in the Scene tab, and click the arrow next to the property in the Inspector.
A yellow patch will be created:
These patches will generally be the final patches in a graph. This is because they consume the signals created by the producer patch and other patches you've added. As a result, changes will be made to the property the patch represents.
You can drag and drop assets into the Patch Editor too, for example to create patches representing textures and audio files.
Create intermediary patches by right-clicking in the Patch Editor, and selecting the patch you need from the menu.
There are lots of intermediary patches to choose from in Spark AR Studio, that you can use to achieve all kinds of different effects.
Let's take a closer look at the labels and features you can see on patches in Spark AR Studio.
The name is at the top of the patch. In the example above, the patch is called Loop Animation. You can rename some patches by double-clicking their name at the top of the patch.
The small circles with arrows in along each side of the patch are known as 'ports'. Ports along the right side of a patch are known as 'output ports'. The ports on the left are 'input ports'.
You'll link one patch to another by making a connection from an output port, to an input port.
Ports are labelled to indicate what they do. Loop Animation has 3 input ports:
It has 1 output port, Progress. This port creates a signal representing the progress of the animation.
When a port has a box next to it, it means you can edit the value associated with the port.
In the Loop Animation patch, 2 values can be edited. Editing the Duration value will change how long the animation plays for.
Checking the box next to Mirrored will mean the animation plays in reverse, after it completes.
You'll choose different data types for some of the patches. For example, if you're manipulating the shape of a 2D object, you'd set the data type of certain patches to Vector 2. If you're applying a color to a material, you'd change the data type of certain patches to Color.
To change the data type of a patch, select the patch. A box containing the current data type will appear at the bottom of the patch.
The data type of the Transition patch in the example is set to Vector3. That means the patch can be used, for example, to transition an object from one position to another in 3D space. To change this, you'd click the arrow next to Vector 3, and select an option from the list:
If you changed the data type to say, Color, it could be used to transition the color of an element in your scene.
Connect patches using their ports — the small dots on each patch.
Patches can only be connected from left to right. This means you'd always connect a port on right side of a patch - known as an output port - to a port on the left side of another patch - known as an input port.
To connect patches together:
You should see a grey line appear, which will turn blue once it has found a connection. Only the compatible ports will be visible, ports with incompatible data points will be greyed out.
If you let go, you should see a connection made between your patches.
Making multiple connections
An output can have more than one outgoing connection, but an input can only have one incoming connection. This means that the result of an output port can be applied to more than one patch.
To disconnect patches, either:
Here's an example of a simple graph. It uses:
As a result of connecting these patches, when a face with an open mouth is detected, 3 objects will appear in the effect.
Let's take a closer look at how the patches in this graph makes this happen.
The Face output port in the the face tracker patch captures data on the face detected by the face tracker. It's connected to the the Smile patch, which narrows down this information to focus on gesture the face is making.
The Smile patch outputs a signal when a smile is detected. If we connect the output of the Smile patch to the input of the Visible patches, it means the objects will be visible when a smile is detected.
Spark AR Studio offers different features to help you manage and organize your graph more easily.
You can group patches to help organize your graph. You can also save patch groups to use again in other projects, and share with other creators. Find out more.
Wireless Sender and Receiver patches
Larger and more complicated patch graphs can quickly become untidy as cables begin to overlap. To declutter your graph, use wireless sender and receiver patches to transmit data between any patches across your graph without using cables. These type of patches are most valuable when working with large and complicated graphs containing different patch groups.
The Sender patch
The Sender patch sends data to one or many receiver patches set to receive this data. Double-click the sender patch title to rename it.
The Receiver patch
The receiver patch outputs the value received from the sender patch.
Click the dropdown menu to select the sender patch you want to receive data from. Once the sender patch is set, click Locate Sender in the dropdown to find the patch wherever it is on the graph.
The example below shows a sender patch wirelessly transmitting the red color value to multiple receiver patches that are set to receive data from this sender.
The receiver patches are then outputting the red color value to patches representing the color properties of different lights in the scene.
When you zoom out of your graph beyond a certain threshold the labels and features of your patches will no longer be visible. This improves Spark AR studio performance.
If you want to see a version of your graph where the details of all patches are visible regardless of zoom level: