Movis
An adaptable four-wheel skid-steer ground robot with a pan-tilt camera. It runs fully on-device on a Jetson Orin Nano, with no network needed.
What it is
Movis is a robot platform: it provides the camera, perception, safe teleoperated and autonomous driving, and mapping, so that task logic can be built on top. The software is built on ROS 2 Jazzy.
Two speeds of thinking
| Fast layer | Object detection and tracking at about 28 frames per second. A safety gate sits between every motion command and the wheels and has the final say: in simulation tests it stops forward motion when an obstacle is closer than 0.25 m, and a human operator's teleop command overrides the autonomous one. |
|---|---|
| Slow layer | A small vision-language model, running locally on the robot, looks at the newest camera frame and the list of tracked objects and writes one line of reasoning plus a structured action: forward, turn left, turn right, stop or look. The reasoning is shown live to the operator. |
The decision layer starts in observe-only mode and acts only when a kill switch is enabled and a mission is set; each decision becomes one bounded movement that still passes through the safety gate.
Measured on the robot's computer
- Perception: YOLO26n (TensorRT FP16) with ByteTrack at about 28 Hz on the real camera, about 40 ms from camera to detection.
- Decisions: Qwen3.5-2B running locally gave 16 of 16 valid decisions in a 10-minute soak test, with a median of 5.6 s per decision.
- Attention: the camera head turns toward new or moving objects in a closed loop, with habituation so it does not stare at one thing forever (tested in a virtual room).
Memory and privacy
A passive episodic memory records events on the robot itself (when objects appear and disappear, the robot's thoughts and actions, its position, and one image per event). There is no external sync. Keyframes are kept 30 days and events 90 days.
Simulation
Navigation (Nav2) and mapping (SLAM) run in a Gazebo simulation with lidar-based odometry, and the full decision → safety gate → motion chain is tested there before it runs on hardware.