In this tutorial you'll build a world effect, visible through the back camera of a mobile device. In the effect, a 2D photo with dynamic text shows the date and location. You'll use the Patch Editor to add interactivity, so the frame changes color and a clicking sound plays when it's tapped:
Download the sample content to follow this tutorial. You can adapt any of the assets in this effect in your own projects.
To get started open the unfinished effect in the sample content folder. We've already imported the assets you need, to help you get started quickly. We've also removed the directional and ambient lighting from the scene. This is a good idea when you're creating effects with 2D objects, as they don't need lighting to add depth to objects.
Adding the 2D objects
We're going to add all the objects at the same time and then assign them to layers so you can clearly see what you're building.
Your project should look like this:
It's worth renaming the objects to help you keep track. Rename:
You'll need 2 layers in this effect, to control the order objects render in.
There will already be 1 layer in the project, named layer0. In the Layers panel, create 1 more.
To keep track of layers, it's a good idea to rename them. We've called:
Back in the Scene panel, assign:
Editing the canvas
First you'll need to make a couple of edits to the canvas. Because the rectangles are children of the canvas, they will take on any changes made to it.
In the Inspector, change the Mode from Camera Space to World Space.
Because the canvas is in World Space it will no longer scale with the screen of the device. This allows you to change its size and position. In the Inspector, change:
Editing the rectangles
Editing the rectangles will make them the right size, and position them in the correct place. Start by setting Flexibility, so the rectangles scale with the screen of the device:
To adjust the size of the rectangles:
The rectangles are the correct size now:
At the moment, one rectangle covers the other. To adjust this, In the Inspector change the Position values:
To build the appearance of the frame, start by creating a material for each rectangle:
In the Assets panel, rename:
Editing the materials
Set the Shader Type to Flat for both materials, because we don't need them to omit or respond to light. It's more performant than a standard shader, so it helps keep the size of the effect down.
Now select overlay_mat. In the Inspector:
The frame is taking shape now:
Overlay_mat changes color when the screen is tapped. You'll use the Patch Editor to do this. Start by creating clicking the arrow next to Texture in the Inspector to make a patch representing the Diffuse Texture property of the material.
We'll add the other patches later.
The text in this effect is a dynamic text object. Dynamic text takes data from a user's device, like their location or the time, and represents it as text.
To add the dynamic text:
There are lots of other types of dynamic text to choose from when creating your own effects.
You'll see the text is in the middle of the frame. To fix this, change the Width and Height values:
Pinning the text means it will always keep the same distance from the canvas's border. Next to Pinning in the Inspector, pin the text to the top, bottom and right side of the canvas. Make sure the rectangle isn’t pinned to the top or bottom of the canvas. This will maintain a relative distance to the center of the canvas on the Y axis, keeping the text under the overlay.
Now we'll make the color of the frame change in response to a tap on the screen of the device.
You've already created the frame_color_mat patch. Create the other 3 patches by right-clicking anywhere in the Patch Editor, and choosing them from the menu. Select:
Adding the colors
You'll add the colors to the Option Picker. First change the Option Picker's data type to Color:
To add the colors, click the squares in the Option Picker. Choose a color for each one from the menu:
Connecting the patches
You can test the effect in the Simulator, by clicking the gear and selecting Simulate Touch:
To finish the effect, add a sound that plays each time the screen is tapped. This is known as 'one-shot' audio:
This audio effect is easy to create, all you’ll do is add 4 more patches to your graph.
We’ve already added the audio file you’ll need to the project - it’s listed as arl_sfx_UITick_os_01.m4a in the Assets panel
Add a speaker
To render sound in any effect, you’ll need a scene object called a speaker. To add it to the project:
The network of patches you’ll build will send a signal to a patch representing the speaker, playing the sound in the scene.
To create a patch for the speaker:
A yellow patch will be added to the Patch Editor:
Adding the one-shot audio effect
To do this you’ll connect the Screen Tap patch to the speaker patch, using a Multi-Clip Controller patch and Audio Player patch to play this audio file through the speaker.
The Multi-Clip Controller patch can play the same sound multiple times, overlapping with previous playback instances. With longer audio clips, it’s worth experimenting with the Single-Clip Controller instead, which will stop the previous playback instance before playing a new one.
To create these patches, right-click in the Patch Editor to open the menu. Select the:
You’ll also need a patch representing the audio file. To create it, just select arl_sfx_UITick_os_01.m4a in the Assets panel and drag it into the Patch Editor. An orange patch will be added:
Now connect the patches. Connect:
Here’s how the graph will look:
You’ve now added the audio clip to your effect! You can test it by clicking in the Simulator. You might need to click the Refresh button in the toolbar to hear it.
Tapping the screen in this effect is a subtle interaction, so the sound shouldn’t stand out too much. Complete the effect by adjusting the volume:
Use interaction patches animate objects in your effect.
Combine segmentation, particles and interactivity to create a world effect.