IFF SDK benchmarks
The latest test results of Standard Machine Vision cases where IFF SDK helps:
-
Full HD / 4K UHD / 8K UHD image pre-processing and streaming
-
Noise reduction
-
Image recording (coming)
-
Color processing (coming)
Full HD / 4K UHD / 8K UHD image pre-processing and streaming from a remote computer
Remote computer with high-performance camera:
- XIMEA PCIe machine vision camera
- NVIDIA Jetson module or desktop computer with NVIDIA GPU
- Jetson Linux or Windows/Linux for desktop
- IFF SDK farsight sample application for raw image acquisition, color pre-processing (black level, auto white balance, demosaicing, color correction, gamma, format conversion), HEVC encoding, and streaming
Receiving station:
- MSI Raider x86 laptop with NVIDIA GeForce RTX 3070 Ti GPU
- Ethernet / Wi-Fi connection to the host
- IFF SDK imagebroker application for Windows (receiving images, decoding, image export, rendering)

Image processing parameters for Full HD / 4K / 8K images and various remote computers:
-
Camera framerate (12-bit raw image mode)
-
Image processing time on the remote computer / Glass-to-Glass latency from the camera to the receiving computer screen
-
Power consumption of NVIDIA Jetson module (when applicable)
Full HD (1920×1080) image stream
Jetson AGX Orin
440 FPS
7 ms / 20 ms
44 W
Jetson Orin NX
230 FPS
15 ms / 30 ms
25 W
Jetson AGX Xavier
180 FPS
10 ms / 25 ms
28 W
Jetson Xavier NX
120 FPS
16 ms / 35 ms
14 W
4K UHD (3840×2160) image stream
Jetson AGX Orin
140 FPS
23 ms / 45 ms
48 W
Jetson Orin NX
65 FPS
40 ms / 60 ms
25 W
x86 host with NVIDIA RTX 2080Ti
200 FPS
10 ms / 30 ms
–
8K UHD (7680×4320) image stream
Jetson AGX Orin
35 FPS
79 ms / 115 ms
47 W
Jetson Orin NX
17 FPS
136 ms / 175 ms
26 W
x86 host with NVIDIA RTX 2080Ti
50 FPS
30 ms / 90 ms
–
Denoise
To remove noise from images, IFF SDK has a denoising module that uses Discrete Wavelet Transform (DWT) and thresholding. There are two denoise options available in the SDK:
- RGB denoise which is applied after demosaicing (debayering),
- RAW denoise for Mono and Bayer (raw) images.
See denoise implementation details and parameter descriptions in the IFF SDK technical manual.
Testing results of the denoising module on a system with 4K camera and different NVIDIA GPUs are shown in the table.
Denoise performance for 4K UHD (3840 x 2160) 16-bit images
GeForce RTX 3070 Ti Laptop
- RAW Denoise: 1.77 ms
- RGB Denoise: 3.25 ms
GeForce RTX 2080 Ti
- RAW Denoise: 2.20 ms
- RGB Denoise: 3.55 ms
Jetson AGX Orin
- RAW Denoise: 3.72 ms
- RGB Denoise: 7.19 ms
Jetson AGX Xavier
- RAW Denoise: 6.76 ms
- RGB Denoise: 13.45 ms
Image comparison
Download the original TIFF images to explore the noise reduction result for a specific case with XIMEA MC124CG-SY color camera as an image source and laptop equipped with RTX 3070 Ti GPU.
Standard image processing pipeline with:
- 3840 x 2160 ROI on the camera
- DFPD high-quality demosaic with 11×11 processing window
- Denoise:
- without any denoise or
- with both RAW and RGB denoise options applied
- Image recording in TIFF format
Comparison of two cropped (900 x 600) images with Before/After image slider:
- Before – without any denoise
- After – with both RAW and RGB denoise

