3D Object Tracking Inside Your Facility Map

Recognize a machine from its scan or its CAD, follow a part as it moves in the hand, and know which unit it is. The object and the building share one map, on phones, glasses, headsets and robots.
6DoF

object pose in the map's frame, read the same way by every device

5cm

smallest object, with 10 cm and up working best

<10min

usual processing time from upload to a trackable object

360°

start the track from whichever side the camera sees

Scan or untextured CADCloud or on-deviceSame map as VPS

MultiSet docs and SDKs, November 2026.

01

What is 3D object tracking?

3D object tracking finds a known physical object in a camera image and returns its 6-DoF pose, so content stays locked to it as the camera moves. You give it a 3D model of the object. It works out where the object sits and which way it faces.

MultiSet runs object tracking inside the same map its visual positioning system localizes against. Every object pose is also a place in the building, which is how the system tells the pump in bay 3 from the identical one in bay 4.

02

Track it from CAD, and follow it in the hand

Edge-based tracking works from untextured CAD, the files an engineering team already holds and a Vuforia Model Target library is built from. It suits the plain or shiny parts that were hard to track before, as long as they have a clear shape. Upload the model as STEP, IGES, FBX, OBJ, STL, PLY, glTF or GLB, choose Edge based, and track it with no scan and no texturing step.

It runs on the device and follows the object in real time as the object or the camera moves, including a part in someone's hand and one that bends or flexes. Once the tracking file has downloaded, a saved guide view starts the track offline, or Automatic start finds the object from any side with one picture sent to the cloud. When the device has localized, the pose sits in the facility map. It works in Unity, native iOS and Android, and WebXR, on every plan.

Bring the CAD library you already have.

Upload one untextured part and track it today, with no texturing step.

03

Six identical generators, and the map knows which one is G-3

Recognition gives you the model. The map gives you the position, so the work order, the readings and the instructions land on the unit in front of you, with no tag or QR code on it.

Generator hall · six units of one model
Six identical generators, each matched to the same model, with no way to tell them apart The same six generators named G-1 to G-6 by their position in the map, with G-3 tracked and its work order shown

Recognition aloneEvery unit matches the model, so six identical generators read as six of the same thing.

Inside the mapEach match also has a position, so G-3 gets G-3's hours, readings and work order.

Input
Textured GLB, glTF or PLY from any scan, or CAD as STEP, IGES, FBX, OBJ, STL, PLY, glTF or GLB with edge-based tracking
Output
The object's 6-DoF pose in the map's frame, read the same way by every device on that map
Size
5 cm and up, with about 10 cm and up working best
Accuracy
Millimeter-scale on objects 1 m and larger, measured in your pilot
Objects
Up to 10 per cloud query, with no fixed limit on the device
Motion
Edge-based tracking follows moving, hand-held and deformable objects in real time, on the device and offline once downloaded
Start
From any side with Automatic start, or offline from a saved guide view
Setup
Processing usually under 10 minutes, then the track starts from any side
Platforms
Unity, WebXR, native iOS and Android, visionOS, ROS 2 and the REST API
Deploy
MultiSet Cloud, Dedicated Cloud, Private Cloud / VPC or on-device

Upload one object and track it today.

The Free plan includes 5 objects and doesn't expire. Upload a textured scan or a CAD file and track it from the SDK.

04

From a scan or a CAD file to a tracked object in one upload

Scan the object with a phone, a LiDAR scanner or a photogrammetry rig and upload the textured model as GLB, glTF or PLY, or upload the untextured CAD you already have as STEP, IGES, FBX, OBJ, STL, PLY, glTF or GLB. Either way, processing usually takes under 10 minutes. Then point a camera at the object from any side.

Quadruped robot captured as a textured 3D scan

01Scan it, or use the CAD

Any textured scan works, from a phone, a LiDAR scanner or a photogrammetry rig. Untextured CAD skips the scan.

02Upload it

A textured GLB, glTF or PLY scan, or CAD as STEP, IGES, FBX, OBJ, STL, PLY, glTF or GLB. Pick Feature based for a scan or Edge based for CAD, and the object turns active with a code your app passes to the SDK.

MultiSet app outlining three identical pumps in a working pump room

03Track it

Point the camera from any side. The object locks and stays locked as it moves, along with everything you anchored to it.

05

Filmed in a working pump room with our own app

Identical pumps stand side by side. The app outlines each one from its scan and keeps the lock while the phone moves down the row.

Screen recording · phone
Pump room · two rows of identical pumps

Screen capture from the MultiSet app, trimmed only.

06

Where object tracking does the work

Refinery pipe rack as the device localizes in its map
Oil, gas and chemicals

Find it in the building, then lock to it

The map routes a technician to the unit. Object tracking takes over at arm's length.

Heat exchanger with live readings and a work order step beside it
Maintenance and inspection

Work orders and live readings on the asset

Steps from your work order system and values from your historian sit on the equipment they belong to.

Generator recognized in a row of identical units, with its run hours and next service
Power and facilities

One record per unit across identical machines

Recognition matches the model and the map picks the unit, with no tag to fit or scan.

Open engine bay with the engine oil and washer fluid caps labeled by the MultiSet app
Automotive and manufacturing

Parts named on the vehicle in front of you

Labels and instructions land on the right cap, connector or bracket, filmed here in our own app.

Bring the equipment that matters most to a pilot.

A pilot measures accuracy on your own objects, inside your own map.

07

What changes when the object lives in the map

Most object trackers keep the pose inside one AR session on one device. MultiSet keeps it in the map, so it survives a restart and every device reads the same answer.

MultiSet, object inside the map Object tracking in one AR session
Which unit is it Model plus position, so G-3 stays G-3 The model matches, and identical units look alike
After an app restart Same pose from the persistent map Starts again from nothing
A second device or a robot The same object pose in the same frame Its own session and its own frame
Starting the track Point the camera from any side, or line up a saved guide view offline Often an on-screen outline to line up first
A part in someone's hand Edge-based tracking follows it on the device, and its pose stays in the map Followed inside one session
Devices Phones, tablets, glasses, headsets, browsers, robots and REST Usually one engine on one platform
Deployment MultiSet Cloud, Dedicated Cloud, Private Cloud / VPC or on-device Usually on the device only

Frequently asked questions

What is MultiSet Object Tracking?

MultiSet Object Tracking recognizes a known object from its 3D model and returns its 6-DoF pose, so AR content and machine actions stay locked to it. It runs in the same persistent map as MultiSet's visual positioning system, so the object and the facility share one coordinate frame.

How is it different from Vuforia Model Targets?

You start from a scan or from the untextured CAD your Model Targets already use, processing usually takes under 10 minutes, and the camera can find the object from any side. Objects and the building share one map, so one SDK covers both. Deployment runs from MultiSet Cloud to fully on-device.

Which file formats does it accept?

Scans come in as textured GLB, glTF or PLY from phones, LiDAR scanners and photogrammetry. Edge-based tracking takes CAD as STEP, IGES, FBX, OBJ, STL, PLY, glTF or GLB, with textures optional. STEP, IGES and FBX files carry their own units, and OBJ, STL and PLY are read as metres.

How small can an object be?

Objects need to be at least 5 cm across, and about 10 cm and up works best. For a first test, pick an object of 10 cm or more with a well-textured scan or its CAD.

How accurate is MultiSet Object Tracking?

Millimeter-scale on objects 1 m and larger, measured in your pilot. Accuracy depends on the object's size, its surface and the quality of its model, so we measure it on your object.

How many objects can one app track?

Each cloud query checks up to 10 objects and returns the best match, and a session can cycle through more objects from one query to the next. A query counts as one API call however many objects it checks. On the device there's no fixed limit, so the hardware and the size of the object bundles set it.

Does it track objects that move?

Yes. Edge-based tracking follows a moving object in real time on the device, including a part in someone's hand and objects that bend or flex, on phones, headsets and smart glasses. Equipment that gets moved between visits is picked up again by a quick relocalization.

Does it run on the device?

Edge-based tracking runs on the device on every plan, Free included. Once an object's tracking file has downloaded it works offline from a saved guide view, and Automatic start needs a connection only for its first picture. On-device tracking for textured scans runs in the native iOS and Android SDKs and in Unity on Enterprise plans.

Which platforms and devices does it support?

Unity, WebXR, native iOS and Android, visionOS, ROS 2 and the REST API. That covers phones, tablets, smart glasses, XR headsets, browsers and robots. Edge-based tracking runs in Unity, native iOS and Android, and WebXR.

What does it cost?

The Free plan includes 5 objects and doesn't expire. Lite covers 10 objects and Plus covers 25, at published prices. Edge-based tracking comes with every plan, Free included. Pricing follows objects and usage, so adding devices doesn't raise the bill. Enterprise and Dedicated Cloud are quoted, and so is on-device tracking for textured scans.

Start with one object, or bring us a whole plant.

The Free plan covers a first object. For production rollouts and on-device deployments, talk to us.