0% found this document useful (0 votes)
140 views13 pages

IMX327 Datasheet

Uploaded by

Tiwana Mohsin
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
140 views13 pages

IMX327 Datasheet

Uploaded by

Tiwana Mohsin
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

FSM-IMX327 Datasheet

Sony IMX327LQR1 Sensor Module

FRAMOS Sensor Module


FSM-IMX327 FSM-IMX327C v1.1c Datasheet
Specification
Model Name FSM-IMX327C (V1B)

Image Sensor
Sony
Vendor / Name
IMX327LQR1
Shutter Type CMOS Rolling Shutter
Chromaticity Color
Optical Format 1/2.8“
Pixel Size 2.9 x 2.9 µm
Max. Resolution 2.1 Mpx / 1920 x 1080 px
60 FPS (4-Lane)
Framerate (max.)
Key Benefits & Features: 60 FPS (2-Lane)
▪ 2.1 Mpx Sony CMOS Rolling Shutter sensor Bit Depth(s) 10 / 12 bit
module, ready to embed! Interface
▪ All FSMs are part of a rapid prototyping Data Interface MIPI CSI-2 (2 / 4 Lane)
ecosystem, consisting of: Communication Interface I²C (4-wire serial)
✓ Adapters to various processing boards Drive Frequency(s) 37.125 / 74.25 MHz
✓ Design sources for deep embedding
Input Voltages 1.2V, 1.8V, 2.9V
✓ Various accessories and design in services
Interface Connector Hirose DF40C-60DP-0.4V(51)
EEPROM (Sensor ID) No
FSM-IMX327C (Color):
Mechanical
Dimensions (HxWxD) 26.5 mm x 26.5 mm
Environmental
-30°C to +85°C (function)
Operating Temperature
-10°C to +60°C (performance)
Storage Temperature -40°C to +85°C
Ambient Humidity 20% to 95% RH, non condensing
Software Support
Driver V4L2 Based Device Driver
NVIDIA Jetson Family:
Supported Platform(s) AGX Xavier, Nano, TX2, Xavier NX
Qualcomm DragonBoard 410C
NVIDIA JP4.5 / L4T32.5
Software Version(s)
DB410C: Linaro 18.01 / Kernel 4.14
Suggested Accessories & Adapters
Compatible FSA FSA-FT3/A
FSM-IMX327x/TXA_Devkit (TX2, AGX)
Recommended Devkit(s)
FSM-IMX327x/NVN_Devkit (Nano, NX)
Lens Mounts M12 or C/CS-Mount options
A matrix with compatible Sensor Adapters (FSA) and Processor Board Adapters
(FPA) for various setups can be found at the end of this document.

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

Mechanical Drawing

Sensor image optical center is in mechanical board center.

Connector Pinout
Type: Hirose DF40C-60DP-0.4V(51)
Mating Type: Hirose DF40HC(4.0)-60DS-0.4V(51)

CSI_D0_N

CSI_D2_N
XMASTER

CSI_D0_P

CSI_D2_P
XTRIG
Name

XCLR
GND
GND

GND

GND

GND

GND
INCK
SDA
XHS
2V9
2V9
1V8

XVS
XCE
SCL
NC
NC

NC

NC
NC

NC

NC
NC

Pin 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59

Pin 1 according to print on PCB.

Pin 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60
CSI_CLK_N
CSI_CLK_P
CSI_D3_N

CSI_D1_N
CSI_D3_P

CSI_D1_P
TENABLE
Name

TOUT
GND
GND

GND

GND

GND

GND
SDO
1V2
1V2
NC
NC

NC

NC

NC
NC
NC
NC
NC

NC
NC

NC
NC

Signals are routed directly from image sensor to connector. Details on specific signals are described in the
respective image sensor datasheet.

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

Table of Contents
1 FRAMOS Sensor Module Ecosystem ........................................................................................................ 2
1.1 Ecosystem Overview........................................................................................................................ 3
1.2 Materials and Services ..................................................................................................................... 4
2 Software Package and Drivers ................................................................................................................. 5
2.1 Reference Software: NVIDIA Jetson Family ...................................................................................... 6
2.1.1 Platform and Sensor Device Drivers ......................................................................................... 6
2.1.2 Image Pre-Processing Examples ............................................................................................... 7
3 Ecosystem Compatibility Matrix ............................................................................................................ 10
3.1 Hardware Support ......................................................................................................................... 10

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

1 FRAMOS Sensor Module Ecosystem


The FSM Ecosystem consists of FRAMOS Sensor Modules, Adapters, Software and Sources, and provides one
coherent solution supporting the whole process of integrating image sensors into embedded vision products.

During the evaluation and proof-of-concept phase, off-the-shelf sensor modules with a versatile adapter
framework allow the connection of latest image sensor technology to open processing platforms, like the
NVIDIA Jetson Family or the 96boards.org standard. Reference drivers and sample applications deliver images
immediately after installation, supporting V4L2 and an optional derivate API providing comfortable integration.
Within the development phase, electrical design references and driver sources guide with a solid and proven
baseline to quickly port into individual system designs and extend scope, while decreasing risk and efforts.

To simplify and relieve the whole supply chain, all FRAMOS Sensor Modules and adapters are optimized and
ready for delivery in volume and customization with pre-configured lens holder, lens and further accessories.

Off-the-Shelf Hardware Ready to go Software Package

▪ FRAMOS Sensor Modules (FSM) from stock, ▪ Drivers with basic sensor integration:
ready for evaluation and optimized for initial ▪ Platform specific device drivers
mass production. ▪ V4L2 subdevice drivers for specific image
▪ Versatile adapter framework, allowing sensors (low-level C API)
flexible testing of different modules, on ▪ Streamlined V4L2 library (LibSV) with
different processing boards: comfortable and generic C/C++ API
▪ FRAMOS Sensor Adapter (FSA): ▪ Example applications demonstrating
Everything the specific sensor needs for initialization, main configuration and image
operation stream processing
▪ FRAMOS Processor Adapter (FPA):
Connect up to four FSM + FSA to a
specific processor board
▪ From lenses, mechanics and cables, all
needed imaging accessories from one hand

Further to the off-the-shelf hard- and software, the Ecosystem supports you on project basis with:

▪ Driver sources allowing the focus on application specific scope and sensor features
▪ Electrical references for FSA and FPA, supporting quick and optimized embedding of FSMs
▪ Engineering services via FRAMOS and its partners, allowing you to focus on your product’s unique value

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

1.1 Ecosystem Overview

The figure below shows a map of compatibility with all components inside the Ecosystem. Every element (or
hardware) and connection displayed in Green operates with native MIPI CSI-2 (D-PHY) data.

Every component and connection displayed in Orange or Blue operates with proprietary (Sub-LVDS, SLVS) or
standardized (SLVS-EC) LVDS data, that requires further attention to the physical processing of the image data
by either data conversion or specific FPGA IP. Users of MIPI CSI-2 based processing systems are supported by
FSM specific data conversion located on dedicated FRAMOS Sensor Adapters (FSAs).

Lens Mount
(C/CS)

Sensor Module (FSM)


Sensor Adapter (FSA)
Flex Cable

Processor Adapter
(FPA)
Figure 1: Assembly of a typical Sensor Module Development Kit

Specification and compatibility of all individual components are listed in the appropriate chapter of the full
datasheet. Access to software and drivers is only granted with the purchase of the appropriate development
kit. Electrical design sources, support and services are provided on individual basis, they are not part of the
development kit or component purchase.
3

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

1.2 Materials and Services

Below you can find a list of materials and services as part of the FRAMOS Sensor Module Ecosystem.

Hardware
▪ FRAMOS Sensor Module Development Kits
▪ Individual Parts:
▪ FRAMOS Sensor Modules
▪ FRAMOS Sensor Adapters
▪ FRAMOS Processor Adapters
▪ FRAMOS Module Accessories (Cables, Mounts)

Software (part of the Development Kit)


▪ Software Package for NVIDIA Jetson AGX Xavier, Nano, TX2 and Xavier NX
▪ Software Package for DragonBoard 410c (96Boards)
▪ Xilinx FPGA reference implementation for SLVS-EC (Sony IMX421, IMX530)

Design Sources (on Project Basis)


▪ Software Driver Sources
▪ Electrical References for FSA, FPA (Schematics)

Design Services
▪ Off-the-shelf hardware customization including size, shape, connector and extended functionality
▪ Software customization and extension
▪ Additional processor board support
▪ Further sensor features and image (pre-)processing
▪ Integration of additional sensors
▪ Optimization for volume production
▪ Lens assembly and alignment
▪ System / solution development
▪ Production and integration

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

2 Software Package and Drivers


As FRAMOS we know that the getting started with a new technology is the biggest challenge. The idea behind
the Software Package is to enable embedded software engineers to get quickly to a streaming system and
provide at the same time all tools that are needed to extend and adapt it according the individual needs of the
application.

What the software package and driver are:


▪ A reference for a custom sensor implementation
▪ Demonstrating how to use the required interfaces
▪ Demonstrating how to communicate with the image sensor
▪ Demonstrating how to generaly initialize and configure the image sensor
▪ Provide initial image streaming output to the user space
▪ Demonstrating how to run basic image processing on pixel data

Supported Processor Platforms


The table below shows which platforms are supported by the standard driver package, and how many FSMs
can at maximum be operated in parallel.

NVIDIA 96Boards Xilinx


NVIDIA NVIDIA DragonBoard
Sensor Module Jetson Nano, Consumer Development
Jetson TX2 AGX Xavier 410c
Xavier NX Edition Boards
FSM-AR0144 4 2
FSM-AR0521 4 2 2
FSM-AR1335 4 2
FSM-HDP230 4 4 2
FSM-IMX264 2 4 -
FSM-IMX283 2 4 -
FSM-IMX290 4 2 2
FSM-IMX296 4 2 2
FSM-IMX297 4 2
FSM-IMX304 2 4 -
HW only, driver development
FSM-IMX327 4 2 2
on project basis.
FSM-IMX334 2 4 -
FSM-IMX335 4 2
FSM-IMX412 4 2 2
FSM-IMX415 4 2
FSM-IMX462 4 2
FSM-IMX464 4 2
FSM-IMX477 4 2
FSM-IMX485 4 2
FSM-IMX565 4 2
FSM-IMX577 4 2
FSM-IMX530 2 4 - 11
Table 1: Ecosystem Software Package - Supported number of FSMs per processing board

1
SLVS-EC based FPGA reference implementation as part of the SLVS-EC RX IP Core offering. 5

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

2.1 Reference Software: NVIDIA Jetson Family

The software package provided with the Development Kits of the FRAMOS Sensor Module Ecosystem provided
for NVIDIA Jetson platforms provides a reference implementation of sensor and device drivers for MIPI CSI-2.
It contains a minimum feature set demonstrating how to utilize the platform specific data interface and
communication implementation, as well as the initialization of the image sensor and implementation of basic
features.

Package Content:
▪ Platform and device drivers with Linux for Tegra Support
▪ V4L2 based subdevice drivers (low-level C API)
▪ Streamlined V4L2 library (LibSV) providing generic C/C++ API
▪ Image Pre-Processing Examples:
▪ OpenCV (Software)
▪ LibArgus (Hardware)

Supported Devices:
▪ NVIDIA Jetson Nano Developer Kit (B01)
▪ NVIDIA Jetson TX2 Developer Kit
▪ NVIDIA Jetson Xavier NX Developer Kit
▪ NVIDIA Jetson AGX Xavier Developer Kit

2.1.1 Platform and Sensor Device Drivers

The driver divides into two main parts that are configured in separate ways – the Image Modes and the General
Features of the image sensor.

Image Modes
These are major attributes that have impact to the image data stream formatting. They require a static pre-
configuration within the device tree (DT):

▪ Image / streaming resolution


▪ Pixel format / bit depth
▪ Data rate / lane configuration

Each driver provides access to 3 – 5 pre-built configurations, reflecting the main operation modes of the
imager. Beside the full resolution, that is always available, they allow to receive image streams in common
video resolutions like VGA, Full HD and UHD as they are supported or make sense by the imagers, and utilize
sensor features like ROI and binning.

They act as an example for implementation and usage and are available as source. Due to the size limitation
of the device tree, it is not possible to integrate an extensive set of options.

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

General Features
These are attributes of the image sensor that do not manipulate the data stream formatting. The drivers
provided with the Software Pack integrate the sensor features as shown in the table below.

Synchronizing Master
IS Mode (Master / Slave)

Test Pattern Output


Gain (Analog / Digital)

Sensor Mode ID
Pre-Implemented
Exposure Time
Flip / Mirror

HDR Output
Features per
Frame Rate

Black Level

Broadcast
Data Rate
Model

FSM-AR0144
FSM-AR0521
FSM-AR1335
FSM-HDP230
FSM-IMX264
FSM-IMX283
FSM-IMX290
FSM-IMX296 *
FSM-IMX297 *
FSM-IMX304
FSM-IMX327
FSM-IMX334
FSM-IMX335
FSM-IMX412
FSM-IMX415
FSM-IMX462 V4L (libsv) and libargus
FSM-IMX464 V4L (libsv)
FSM-IMX477 Not Implemented
FSM-IMX485
FSM-IMX530
FSM-IMX565
FSM-IMX577
Table 2: Supported sensor features on NVIDIA Jetson TX2 / AGX Xavier
*Only supported in all pixel mode
Further features, as been supported by the image sensor, can be integrated into the driver sources using the
image sensor datasheet.

2.1.2 Image Pre-Processing Examples

The provided image processing examples show the general mechanisms of data handling, for an image
processing using 3rd-party IP. Both, the OpenCV and the LibArgus examples do not output data that is tuned
for best visual experience.

LibArgus Example:
▪ Closed source ISP implementation
▪ Using hard ISP in NVIDIA Jetson SOCs
▪ Most performant option
▪ Example Implementation: Full but not tuned image pipeline, displaying
7

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

Color tuning and lens correction needs to be calibrated for every image sensor separately and depends on
sensor and lens attributes as well as illumination situation.

Color Artifact Suppr.


Auto Exposure, Gain
Bad Pixel Correction

Auto White Balance

Edge Enhancement
Black Level Comp.
Image
Noise Reduction

Color Correction
Pre-Processing

Downscaling
Features

Demosaic
per Model

FSM-AR0144
FSM-AR0521
FSM-AR1335
FSM-HDP230
FSM-IMX264
FSM-IMX283
FSM-IMX290
FSM-IMX296
FSM-IMX297
FSM-IMX304
FSM-IMX327
FSM-IMX334
FSM-IMX335
FSM-IMX412
FSM-IMX415
FSM-IMX462
FSM-IMX464
FSM-IMX477
FSM-IMX485
FSM-IMX530 Implemented
FSM-IMX565 Using Default Config
FSM-IMX577 Not Implemented
Table 3: Implemented LibArgus features for NVIDIA Jetson TX2 / AGX Xavier

Default Config
Image streaming is performed through the LibArgus pipeline, using a common configuration. It demonstrates
the usage of LibArgus but is not optimized for the certain sensor configuration and might not lead to good
image representation.

Note: Systems are diverse, as the utilized lenses, filters and illuminations are. As NVIDIA camera partner,
FRAMOS provides individual ISP calibrations services for the customer hardware on per project basis.

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

OpenCV Example:
▪ Open software library
▪ Easy to use and large feature set
▪ Extremely performance hungry (CPU)
▪ Not recommended for pre-processing
▪ Example Implementation: Demosaicing, Displaying

Color Artifact Suppr.


Auto Exposure, Gain
Bad Pixel Correction

Auto White Balance

Edge Enhancement
Black Level Comp.
Noise Reduction

Color Correction
Image
Pre-Processing

Downscaling
Features
Demosaic

per Model

FSM-AR0144
FSM-AR0521
FSM-AR1335
FSM-HDP230
FSM-IMX264
FSM-IMX283
FSM-IMX290
FSM-IMX296
FSM-IMX297
FSM-IMX304
FSM-IMX327
FSM-IMX334
FSM-IMX335
FSM-IMX412
FSM-IMX415
FSM-IMX462
FSM-IMX464
FSM-IMX477 Implemented
FSM-IMX485 Not Implemented
FSM-IMX530
FSM-IMX565
FSM-IMX577
Table 4: Implemented features in OpenCV example

Due to limited performance and extreme resource utilization, it is not planned to enhance the image
processing support on software side.

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

3 Ecosystem Compatibility Matrix


3.1 Hardware Support

The following matrix shows the compatibility of FSMs, FSAs and FPAs to each other. The FSAs differentiate to
each other by supplied voltages, power up sequence, generated clock (oscillator) and physical attributes.

Sensor Modules with MIPI CSI-2 (D-PHY) Output


FSM-IMX290
FSM-IMX327
FSM-IMX334
FSM-IMX335
FSM-IMX412 FSM-IMX462
FSM-IMX477 FSM-IMX464 FSM-IMX296 FSM-AR0521
Item FSM-IMX577 FSM-IMX485 FSM-IMX297 FSM-AR1335 FSM-IMX415 FSM-IMX283 FSM-AR0144 FSM-HDP230 FSM-IMX565
FPA-4.A/TXA
FPA-A/NVN
FSA-FT1/A FPA-2.A/96B
FPA-ABC/XX1 2
FPA-4.A/TXA
FPA-A/NVN3
FSA-FT3/A
FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FPA-A/NVN
FSA-FT6/A FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FPA-A/NVN
FSA-FT7/A
FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FPA-A/NVN
FSA-FT11/A
FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FSA-FT12/A FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FPA-A/NVN
FSA-FT13/A
FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FPA-A/NVN
FSA-FT19/A FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FPA-A/NVN
FSA-FT26/A
FPA-2.A/96B
FPA-ABC/XX12
Table 5: Ecosystem Compatibility Matrix – Native CSI-2 (D-PHY) FSMs

2
Not verified, Xilinx Development Board with hard MIPI CSI-2 / D-PHY interface.
3
FSM-IMX334 is not supported due to the sensor requiring 4-lanes MIPI. 10

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.
FSM-IMX327C Datasheet

Sensor Modules with (Sub-) LVDS and SLVS Output


Item Data Output (FSA) FSM-IMX264 FSM-IMX304 FSM-IMX421 FSM-IMX530
FPA-4.A/TXA
FSA-FT14/A-00G MIPI CSI-2 FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FSA-FT15/A-00G MIPI CSI-2 FPA-2.A/96B
FPA-ABC/XX12
FPA-4.A/TXA
FSA-FT18/A-00G MIPI CSI-2 FPA-2.A/96B
FPA-ABC/XX12

FSA-FT18/BC SLVS, SLVS-EC FPA-ABC/XX1

FSA-FT20/BC SLVS-EC FPA-ABC/XX1

Table 6: Ecosystem Compatibility Matrix – Sub-LVDS, SLVS and SLVS-EC FSMs

11

Version v1.1c from 2021-03-24


www.framos.com © FRAMOS 2021, information is subject to change without prior notice.

You might also like