IMX327 Datasheet
IMX327 Datasheet
Image Sensor
Sony
Vendor / Name
IMX327LQR1
Shutter Type CMOS Rolling Shutter
Chromaticity Color
Optical Format 1/2.8“
Pixel Size 2.9 x 2.9 µm
Max. Resolution 2.1 Mpx / 1920 x 1080 px
60 FPS (4-Lane)
Framerate (max.)
Key Benefits & Features: 60 FPS (2-Lane)
▪ 2.1 Mpx Sony CMOS Rolling Shutter sensor Bit Depth(s) 10 / 12 bit
module, ready to embed! Interface
▪ All FSMs are part of a rapid prototyping Data Interface MIPI CSI-2 (2 / 4 Lane)
ecosystem, consisting of: Communication Interface I²C (4-wire serial)
✓ Adapters to various processing boards Drive Frequency(s) 37.125 / 74.25 MHz
✓ Design sources for deep embedding
Input Voltages 1.2V, 1.8V, 2.9V
✓ Various accessories and design in services
Interface Connector Hirose DF40C-60DP-0.4V(51)
EEPROM (Sensor ID) No
FSM-IMX327C (Color):
Mechanical
Dimensions (HxWxD) 26.5 mm x 26.5 mm
Environmental
-30°C to +85°C (function)
Operating Temperature
-10°C to +60°C (performance)
Storage Temperature -40°C to +85°C
Ambient Humidity 20% to 95% RH, non condensing
Software Support
Driver V4L2 Based Device Driver
NVIDIA Jetson Family:
Supported Platform(s) AGX Xavier, Nano, TX2, Xavier NX
Qualcomm DragonBoard 410C
NVIDIA JP4.5 / L4T32.5
Software Version(s)
DB410C: Linaro 18.01 / Kernel 4.14
Suggested Accessories & Adapters
Compatible FSA FSA-FT3/A
FSM-IMX327x/TXA_Devkit (TX2, AGX)
Recommended Devkit(s)
FSM-IMX327x/NVN_Devkit (Nano, NX)
Lens Mounts M12 or C/CS-Mount options
A matrix with compatible Sensor Adapters (FSA) and Processor Board Adapters
(FPA) for various setups can be found at the end of this document.
Mechanical Drawing
Connector Pinout
Type: Hirose DF40C-60DP-0.4V(51)
Mating Type: Hirose DF40HC(4.0)-60DS-0.4V(51)
CSI_D0_N
CSI_D2_N
XMASTER
CSI_D0_P
CSI_D2_P
XTRIG
Name
XCLR
GND
GND
GND
GND
GND
GND
INCK
SDA
XHS
2V9
2V9
1V8
XVS
XCE
SCL
NC
NC
NC
NC
NC
NC
NC
NC
Pin 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59
Pin 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60
CSI_CLK_N
CSI_CLK_P
CSI_D3_N
CSI_D1_N
CSI_D3_P
CSI_D1_P
TENABLE
Name
TOUT
GND
GND
GND
GND
GND
GND
SDO
1V2
1V2
NC
NC
NC
NC
NC
NC
NC
NC
NC
NC
NC
NC
NC
Signals are routed directly from image sensor to connector. Details on specific signals are described in the
respective image sensor datasheet.
Table of Contents
1 FRAMOS Sensor Module Ecosystem ........................................................................................................ 2
1.1 Ecosystem Overview........................................................................................................................ 3
1.2 Materials and Services ..................................................................................................................... 4
2 Software Package and Drivers ................................................................................................................. 5
2.1 Reference Software: NVIDIA Jetson Family ...................................................................................... 6
2.1.1 Platform and Sensor Device Drivers ......................................................................................... 6
2.1.2 Image Pre-Processing Examples ............................................................................................... 7
3 Ecosystem Compatibility Matrix ............................................................................................................ 10
3.1 Hardware Support ......................................................................................................................... 10
During the evaluation and proof-of-concept phase, off-the-shelf sensor modules with a versatile adapter
framework allow the connection of latest image sensor technology to open processing platforms, like the
NVIDIA Jetson Family or the 96boards.org standard. Reference drivers and sample applications deliver images
immediately after installation, supporting V4L2 and an optional derivate API providing comfortable integration.
Within the development phase, electrical design references and driver sources guide with a solid and proven
baseline to quickly port into individual system designs and extend scope, while decreasing risk and efforts.
To simplify and relieve the whole supply chain, all FRAMOS Sensor Modules and adapters are optimized and
ready for delivery in volume and customization with pre-configured lens holder, lens and further accessories.
▪ FRAMOS Sensor Modules (FSM) from stock, ▪ Drivers with basic sensor integration:
ready for evaluation and optimized for initial ▪ Platform specific device drivers
mass production. ▪ V4L2 subdevice drivers for specific image
▪ Versatile adapter framework, allowing sensors (low-level C API)
flexible testing of different modules, on ▪ Streamlined V4L2 library (LibSV) with
different processing boards: comfortable and generic C/C++ API
▪ FRAMOS Sensor Adapter (FSA): ▪ Example applications demonstrating
Everything the specific sensor needs for initialization, main configuration and image
operation stream processing
▪ FRAMOS Processor Adapter (FPA):
Connect up to four FSM + FSA to a
specific processor board
▪ From lenses, mechanics and cables, all
needed imaging accessories from one hand
Further to the off-the-shelf hard- and software, the Ecosystem supports you on project basis with:
▪ Driver sources allowing the focus on application specific scope and sensor features
▪ Electrical references for FSA and FPA, supporting quick and optimized embedding of FSMs
▪ Engineering services via FRAMOS and its partners, allowing you to focus on your product’s unique value
The figure below shows a map of compatibility with all components inside the Ecosystem. Every element (or
hardware) and connection displayed in Green operates with native MIPI CSI-2 (D-PHY) data.
Every component and connection displayed in Orange or Blue operates with proprietary (Sub-LVDS, SLVS) or
standardized (SLVS-EC) LVDS data, that requires further attention to the physical processing of the image data
by either data conversion or specific FPGA IP. Users of MIPI CSI-2 based processing systems are supported by
FSM specific data conversion located on dedicated FRAMOS Sensor Adapters (FSAs).
Lens Mount
(C/CS)
Processor Adapter
(FPA)
Figure 1: Assembly of a typical Sensor Module Development Kit
Specification and compatibility of all individual components are listed in the appropriate chapter of the full
datasheet. Access to software and drivers is only granted with the purchase of the appropriate development
kit. Electrical design sources, support and services are provided on individual basis, they are not part of the
development kit or component purchase.
3
Below you can find a list of materials and services as part of the FRAMOS Sensor Module Ecosystem.
Hardware
▪ FRAMOS Sensor Module Development Kits
▪ Individual Parts:
▪ FRAMOS Sensor Modules
▪ FRAMOS Sensor Adapters
▪ FRAMOS Processor Adapters
▪ FRAMOS Module Accessories (Cables, Mounts)
Design Services
▪ Off-the-shelf hardware customization including size, shape, connector and extended functionality
▪ Software customization and extension
▪ Additional processor board support
▪ Further sensor features and image (pre-)processing
▪ Integration of additional sensors
▪ Optimization for volume production
▪ Lens assembly and alignment
▪ System / solution development
▪ Production and integration
1
SLVS-EC based FPGA reference implementation as part of the SLVS-EC RX IP Core offering. 5
The software package provided with the Development Kits of the FRAMOS Sensor Module Ecosystem provided
for NVIDIA Jetson platforms provides a reference implementation of sensor and device drivers for MIPI CSI-2.
It contains a minimum feature set demonstrating how to utilize the platform specific data interface and
communication implementation, as well as the initialization of the image sensor and implementation of basic
features.
Package Content:
▪ Platform and device drivers with Linux for Tegra Support
▪ V4L2 based subdevice drivers (low-level C API)
▪ Streamlined V4L2 library (LibSV) providing generic C/C++ API
▪ Image Pre-Processing Examples:
▪ OpenCV (Software)
▪ LibArgus (Hardware)
Supported Devices:
▪ NVIDIA Jetson Nano Developer Kit (B01)
▪ NVIDIA Jetson TX2 Developer Kit
▪ NVIDIA Jetson Xavier NX Developer Kit
▪ NVIDIA Jetson AGX Xavier Developer Kit
The driver divides into two main parts that are configured in separate ways – the Image Modes and the General
Features of the image sensor.
Image Modes
These are major attributes that have impact to the image data stream formatting. They require a static pre-
configuration within the device tree (DT):
Each driver provides access to 3 – 5 pre-built configurations, reflecting the main operation modes of the
imager. Beside the full resolution, that is always available, they allow to receive image streams in common
video resolutions like VGA, Full HD and UHD as they are supported or make sense by the imagers, and utilize
sensor features like ROI and binning.
They act as an example for implementation and usage and are available as source. Due to the size limitation
of the device tree, it is not possible to integrate an extensive set of options.
General Features
These are attributes of the image sensor that do not manipulate the data stream formatting. The drivers
provided with the Software Pack integrate the sensor features as shown in the table below.
Synchronizing Master
IS Mode (Master / Slave)
Sensor Mode ID
Pre-Implemented
Exposure Time
Flip / Mirror
HDR Output
Features per
Frame Rate
Black Level
Broadcast
Data Rate
Model
FSM-AR0144
FSM-AR0521
FSM-AR1335
FSM-HDP230
FSM-IMX264
FSM-IMX283
FSM-IMX290
FSM-IMX296 *
FSM-IMX297 *
FSM-IMX304
FSM-IMX327
FSM-IMX334
FSM-IMX335
FSM-IMX412
FSM-IMX415
FSM-IMX462 V4L (libsv) and libargus
FSM-IMX464 V4L (libsv)
FSM-IMX477 Not Implemented
FSM-IMX485
FSM-IMX530
FSM-IMX565
FSM-IMX577
Table 2: Supported sensor features on NVIDIA Jetson TX2 / AGX Xavier
*Only supported in all pixel mode
Further features, as been supported by the image sensor, can be integrated into the driver sources using the
image sensor datasheet.
The provided image processing examples show the general mechanisms of data handling, for an image
processing using 3rd-party IP. Both, the OpenCV and the LibArgus examples do not output data that is tuned
for best visual experience.
LibArgus Example:
▪ Closed source ISP implementation
▪ Using hard ISP in NVIDIA Jetson SOCs
▪ Most performant option
▪ Example Implementation: Full but not tuned image pipeline, displaying
7
Color tuning and lens correction needs to be calibrated for every image sensor separately and depends on
sensor and lens attributes as well as illumination situation.
Edge Enhancement
Black Level Comp.
Image
Noise Reduction
Color Correction
Pre-Processing
Downscaling
Features
Demosaic
per Model
FSM-AR0144
FSM-AR0521
FSM-AR1335
FSM-HDP230
FSM-IMX264
FSM-IMX283
FSM-IMX290
FSM-IMX296
FSM-IMX297
FSM-IMX304
FSM-IMX327
FSM-IMX334
FSM-IMX335
FSM-IMX412
FSM-IMX415
FSM-IMX462
FSM-IMX464
FSM-IMX477
FSM-IMX485
FSM-IMX530 Implemented
FSM-IMX565 Using Default Config
FSM-IMX577 Not Implemented
Table 3: Implemented LibArgus features for NVIDIA Jetson TX2 / AGX Xavier
Default Config
Image streaming is performed through the LibArgus pipeline, using a common configuration. It demonstrates
the usage of LibArgus but is not optimized for the certain sensor configuration and might not lead to good
image representation.
Note: Systems are diverse, as the utilized lenses, filters and illuminations are. As NVIDIA camera partner,
FRAMOS provides individual ISP calibrations services for the customer hardware on per project basis.
OpenCV Example:
▪ Open software library
▪ Easy to use and large feature set
▪ Extremely performance hungry (CPU)
▪ Not recommended for pre-processing
▪ Example Implementation: Demosaicing, Displaying
Edge Enhancement
Black Level Comp.
Noise Reduction
Color Correction
Image
Pre-Processing
Downscaling
Features
Demosaic
per Model
FSM-AR0144
FSM-AR0521
FSM-AR1335
FSM-HDP230
FSM-IMX264
FSM-IMX283
FSM-IMX290
FSM-IMX296
FSM-IMX297
FSM-IMX304
FSM-IMX327
FSM-IMX334
FSM-IMX335
FSM-IMX412
FSM-IMX415
FSM-IMX462
FSM-IMX464
FSM-IMX477 Implemented
FSM-IMX485 Not Implemented
FSM-IMX530
FSM-IMX565
FSM-IMX577
Table 4: Implemented features in OpenCV example
Due to limited performance and extreme resource utilization, it is not planned to enhance the image
processing support on software side.
The following matrix shows the compatibility of FSMs, FSAs and FPAs to each other. The FSAs differentiate to
each other by supplied voltages, power up sequence, generated clock (oscillator) and physical attributes.
2
Not verified, Xilinx Development Board with hard MIPI CSI-2 / D-PHY interface.
3
FSM-IMX334 is not supported due to the sensor requiring 4-lanes MIPI. 10
11