How Does a Low Latency Camera Improve Autonomous Drone Navigation and Object Tracking?
A low latency camera improves drone navigation and object tracking by shortening the time between a change in the scene and a usable frame in the flight computer. Less delay means the position estimate and the tracker work from fresher data, so the drone corrects its path sooner.
This article breaks latency into its stages, puts numbers on what delay costs at flight speed, and compares three Vadzo GigE cameras with published specifications: the IMX662, AR0234, and AR0821 models.
What is a low latency camera, and where does the delay come from?
Camera latency is the time from light reaching the sensor to the frame or result reaching the software that acts on it. It is a sum of stages, and each one can be measured on its own:
Exposure: the sensor collects light for the exposure time, which auto exposure can lengthen in dim scenes.
Readout: the sensor transfers the pixel data. On a rolling shutter sensor, rows are read one after another.
ISP: the image signal processor turns raw data into an image, and its pipeline gives processed data.
Encode: a GigE camera usually compresses video before sending it, and the codec settings change how long that takes.
Link: the data crosses the interface, such as Gigabit Ethernet, MIPI, or USB.
Decode and process: the host decodes the stream, then runs on software.
A fast pipeline trims every stage it controls. The frame rate adds its own wait, because a scene change can land anywhere inside a frame interval. On average the camera sees it half a frame period later, and in the worst case, a full period later.
How does camera latency affect drone navigation and object tracking?
Latency turns directly into distance. A drone moving at speed v travels v times the delay before the software sees the scene as it was. At 10 m/s (an illustrative speed), every 10 ms of delay is 100 mm of travel.
The table uses frame rates published on the three Vadzo product pages. The frame period is the time between frames, and the distance column shows travel during one period at 10 m/s.
Frame rate | Frame period | Travel per frame at 10 m/s | Published mode |
15 FPS | 66.7 ms | 667 mm | AR0821, 4K linear mode |
60 FPS | 16.7 ms | 167 mm | AR0234, 1T Standard variant |
120 FPS | 8.3 ms | 83 mm | AR0234, 4T High Performance, HD, and FHD |
240 FPS | 4.2 ms | 42 mm | AR0234, 4T High Performance, VGA |
300 FPS | 3.3 ms | 33 mm | AR0234, 4T High Performance, QVGA |
For object tracking, a stale frame means the tracker works from where the target was, not where it is. Higher frame rates shrink that gap, and resolution trades against frame rate: the AR0821 gives 8.3MP at 15 FPS, while the AR0234 4T variant gives 300 FPS at QVGA.
Exposure time adds to latency. In dim light, auto exposure lengthens the exposure, which delays the frame and blurs a moving target. A sensor with strong low-light sensitivity can hold a shorter exposure for the same scene.
How does shutter type change what a drone camera records?
A rolling shutter sensor exposes and reads the frame row by row, so the top and bottom rows capture the scene at different moments. At 10 m/s, each millisecond of readout time shifts a moving object by 10 mm between the top and bottom of the frame. Airframe vibration can add visible wobble.
A global shutter sensor exposes every pixel at the same time. A 2MP global shutter camera such as the AR0234 model records a moving target without that skew, which keeps object shapes intact for the tracker and geometry consistent for navigation.
Rolling shutter suits some jobs. A 2MP rolling shutter GigE camera such as the IMX662 model targets low light, and skew stays small when readout is fast and the drone moves slowly relative to the frame. Ask Vadzo for the row readout time of the model you plan to use.
What else sets end-to-end latency?
The Vadzo IMX662 and AR0234 pages list H.264, H.265, and MJPEG video formats. The AR0821 page lists H.264 for video and MJPEG for image capture. Codec choice and its settings change encode delay. Formats that compress across frames typically add buffering, while MJPEG compresses each frame on its own at a higher bitrate.
Gigabit Ethernet carries 1 Gbps at most. An uncompressed 1920 x 1200 stream at 8 bits per pixel and 60 FPS needs about 1.1 Gbps, so a GigE camera has to compress at that frame rate, and the compression stage becomes part of the latency budget.
Interface choice also changes the path. Vadzo lists MIPI and USB versions of the AR0234, such as the AR0234 2MP MIPI color camera and the AR0234 2MP USB 3.0 color camera, for designs that connect the camera straight to the processor. A board-level link removes the network stack from the path, though the gain should be confirmed by measurement.
GigE has its own advantages: one RJ45 cable can carry power and data, and a companion computer with an Ethernet port needs no extra hardware to receive the stream.
Which Vadzo GigE cameras suit a low latency embedded camera design?
Choosing a low latency camera for a drone means matching the sensor, shutter, and frame rate to the job. The three Innova GigE models below share a form factor and software and differ in the sensor.
All three are three-board modules measuring 38 mm x 38 mm and weighing 25 g without lenses. They use an S-mount (M12) lens holder with an auto-switch IR-cut filter, a standard RJ45 connector, and 100Base-T or 1000Base-T links. Power comes over PoE (802.3af) or from a 5 VDC input. Vadzo NXT software and the NXT SDK cover Windows, Linux, and Android, and the cameras run as RTSP or ONVIF GigE cameras.
IMX662: ultra low light, rolling shutter
The Innova-662CRE is an ultra low light GigE camera built on the Sony Starvis 2 IMX662 sensor with a 1/2.8-inch format and 2.9 µm pixels. As a 2MP color GigE camera with 1920 x 1080 resolution, it streams 1080p and 720p video. It is a 2MP rolling shutter GigE camera, so the skew behavior described earlier applies. Vadzo lists UAVs and drones and AGVs and robotics among its applications. The IMX662 low-light GigE camera suits flights in dim light, where sensitivity allows a shorter exposure.
AR0234: global shutter, up to 300 FPS
The Innova-234CGE is an AR0234 global shutter camera with a 1/2.6-inch format, 3.0 µm pixels, and 1920 x 1200 resolution. It is also an AR0234 color GigE camera, available in two variants. The 1T Standard variant runs up to 60 FPS. The 4T High Performance variant reaches 300 FPS at QVGA, 240 FPS at VGA, and 120 FPS at HD and FHD. Vadzo lists UAVs and drones, AGVs and robotics, and mobile robotics among its applications.
AR0821: 4K HDR for detail
The Innova-821CRS is the AR0821 HDR 4K GigE camera in this group. Vadzo describes the AR0821 Color HDR GigE Camera as having 140+ dB embedded HDR from Onsemi DR-Pix dual conversion gain, with 3-exposure, 4-exposure eHDR, and line-interleaved HDR modes. As an AR0821 4K Color GigE Camera, it outputs 8.3 MP (3848 x 2168) at 15 FPS in linear mode, which is a 66.7 ms frame interval. The sensor is 1/1.7-inch with 2.1 µm pixels. IEEE 1588 PTP supports multi-camera synchronization. At 15 FPS it suits a payload or inspection camera better than a navigation camera.
Parameter | IMX662 | AR0234 | AR0821 |
Shutter | Rolling | Global | Rolling |
Max resolution | 1920 x 1080 | 1920 x 1200 | 3848 x 2168 |
Highest published frame rate | Not listed on page | 300 FPS at QVGA | 15 FPS at 4K |
Pixel size | 2.9 µm | 3.0 µm | 2.1 µm |
Video formats | H.264, H.265, MJPEG | H.264, H.265, MJPEG | H.264 |
Drone role | Low-light flight | Fast navigation and tracking | Payload and inspection imaging |
How do you choose a camera for low latency drone vision?
Start from a delay budget and work backward. The example below is illustrative.
First decide how far the drone may travel between a change in the scene and the software reacting to it. Dividing that distance by the flight speed gives the time allowed for the whole camera-to-decision path. Frame rate takes the first share of that time, since a new frame cannot arrive faster than the frame period. Exposure, sensor readout, ISP processing, encoding, the interface, and host processing share the rest, so each stage should be measured on its own and trimmed in turn. A higher frame rate mode, a short exposure, a low-delay encoder profile, and a direct board-level link all leave more of the budget for the flight software.
Frame rate and resolution: pick the mode that meets the delay budget, then check that the resolution still covers the target at working distance.
Shutter: choose global shutter for fast motion and vibration and rolling shutter when low-light sensitivity or resolution comes first.
Codec: set the encoder for low delay and test MJPEG against H.264 in the real pipeline.
Interface and power: compare GigE with MIPI or USB for the processor board, and confirm PoE or 5 VDC power on the airframe.
Weight and temperature: each module weighs 25 g without lens and measures 38 mm x 38 mm. The IMX662 and AR0234 models list -40 to 85 °C, and the AR0821 lists -30 to +85 °C.
Customization: Vadzo lists board redesigns, firmware changes, ToF, mmWave radar, and IMU integration, lens holder changes, and IP-rated or non-IP-rated enclosures.
Hardware encoders, whether on the camera or on the host processor, keep encode time short and consistent.
Key takeaways
Camera latency is the sum of exposure, readout, ISP, encode, link, and host processing, plus the wait for the next frame.
At 10 m/s, each 10 ms of delay is 100 mm of travel, so frame rate and delay decide how stale the data gets.
Global shutter removes skew on fast drones, while rolling shutter suits low-light work when motion is slow.
The AR0234 4T variant lists up to 300 FPS at QVGA, the IMX662 targets low light, and the AR0821 gives 4K HDR at 15 FPS.
Measure end-to-end latency in the target system, since it depends on codec, interface, and host software.
Frequently Asked Questions
How does camera latency impact real-time applications?
Latency is the age of the data a system acts on, so it limits how well the system can react. A late frame makes a drone steer around an obstacle that has already moved and lets a tracker trail a moving target. Delayed images can also fall out of step with other sensors, such as an IMU, and destabilize a control loop that expects fresh input. A short delay and a high frame rate keep these errors small.
Which Vadzo GigE cameras suit low latency video streaming?
For streaming, a low latency camera needs a high frame rate and short encode time. The Innova-234CGE leads on published frame rates, with up to 60 FPS in FHD in the 1T Standard variant and up to 120 FPS at FHD in the 4T High Performance variant. The Innova-662CRE suits 1080p and 720p streaming in dim light. All three models run as RTSP or ONVIF GigE cameras.
How do I set up a Vadzo GigE camera for low latency streaming?
Power the camera over PoE or with 5 VDC, connect it by RJ45, and open the stream as an RTSP or ONVIF GigE camera. Vadzo’s GigE application for Windows and Linux exposes the full feature set, and the NXT SDK provides codec control, region of interest configuration, and Smart GPIO control. A Swagger-based REST API documents the camera controls, so settings can be changed from any HTTP client or script. Set the codec for low delay.
Which Vadzo camera suits low light drone flight?
The IMX662 low light GigE camera (Innova-662CRE) is built on the Sony Starvis 2 IMX662 sensor and described by Vadzo as ultra low light. It lists UAVs and drones among its applications, with 1080p and 720p video and an operating range of -40 to 85 °C.
Does the AR0234 GigE camera support high frame rates?
Yes. The 4T High Performance variant reaches up to 300 FPS at QVGA, 240 FPS at VGA, and 120 FPS at HD and FHD. The 1T Standard variant runs up to 60 FPS. Both use a global shutter sensor, which avoids rolling shutter skew on fast-moving targets.
What does the AR0821 camera offer for high dynamic range scenes?
The Innova-821CRS has an onsemi AR0821 sensor with DR-Pix dual conversion gain and 140+ dB embedded HDR, according to Vadzo. It offers 3-exposure, 4-exposure eHDR, and line-interleaved HDR modes.
What power options and Dimensions does the Innova GigE series have?
The cameras accept PoE (802.3af, 36 to 57 V) or a 5 VDC input. Each module has three boards measuring 38 mm x 38 mm.
Why choose Vadzo Imaging for an OEM embedded camera project?
Vadzo Imaging develops OEM embedded camera solutions and lists customization for the Innova series, including board redesigns, firmware changes, ToF, mmWave radar, and IMU integration, lens holder changes, and IP-rated enclosures. The sales team supports sample and volume orders without a minimum order quantity.
