索尼IMX304LQR IMX304LLR传感器模块说明书-USB迷|专注于互联网分享

2024年2月21日发(作者：肥溶)

FSM-IMX304 Datasheet

Sony IMX304LQR / IMX304LLR Sensor Module

FRAMOS Sensor Module

FSM-IMX304 FSM-IMX304M FSM-IMX304C v1.0g Datasheet

Specification

Model Name

Image Sensor

Vendor / Name

Shutter Type

Chromaticity

Optical Format

Pixel Size

Max. Resolution

Framerate (max.)

Bit Depth(s)

Interface

Data Interface

Communication Interface

Drive Frequency(s)

Input Voltages

Interface Connector

EEPROM (Sensor ID)

Mechanical

Dimensions (HxWxD)

Environmental

Operating Temperature

Storage Temperature

Ambient Humidity

Driver

Supported Platform(s)

Linux Version(s)

API Languages

Suggested Accessories

Flex Cable 150 mm (FSM to FSA)

Lens Mounts:

FMA-FC-150/60

C/CS-Mount option

FSM-IMX304M / FSM-IMX304C (v1)

Key Benefits & Features:

▪ 12.4 Mpx Sony CMOS Global Shutter sensor

module, ready to embed!

▪ All FSMs are part of a rapid prototyping

ecosystem, consisting of:

✓ Adapters to various processing boards

✓ Design sources for deep embedding

✓ Various accessories and design in services

Sony

IMX304LQR / IMX304LLR

CMOS Global Shutter

Color / Mono

1.1“

3.45 x 3.45 µm

12.4 Mpx / 4112 x 3008 px

23 FPS (at full resolution)

12 bit

SubLVDS (4 / 8 Lane)

I²C (4-wire serial)

37.125 / 54 / 74.25 MHz

1.2V, 1.8V, 3.3V

Hirose DF40C-60DP-0.4V(51)

Yes

28 mm x 28 mm

-30°C to +75°C (function)

-10°C to +60°C (performance)

-40°C to +85°C

20% to 95% RH, non condensing

V4L2 Based Device Driver

NVIDIA Jetson TX2 / AGX Xavier

L4T 32.2.1 (JetPack 4.2.2)

C / C++

FSM-IMX304M (Monochrome):

FSM-IMX304C (Color):

Software Support (requires FSA with MIPI CSI-2 conversion)

A matrix with compatible Sensor Adapters (FSA) and Processor Board Adapters

(FPA) for single- and multi-sensor setups can be found separately at the end of

this document.

Development kits available

for various processor boards

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Mechanical Drawing

Sensor image optical center is in mechanical board center.

Datasheet

Connector Pinout

Type: Hirose DF40C-60DP-0.4V(51)

Mating Type: Hirose DF40HC(4.0)-60DS-0.4V(51)

D_DATA_6_N

D_DATA_4_N

D_DATA_2_N

D_DATA_0_N

D_CLK_0_N

D_DATA_6_P

D_DATA_4_P

D_DATA_2_P

D_DATA_0_P

D_CLK_0_P

TOUT0

TOUT1

TOUT2

Name

MCLK

GND

SDO

SDA

3V3

1V8

RST

Pin 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59

Pin 1 according to print on PCB.

Pin 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60

1V8_EEPROM

1V2

D_DATA_7_N

D_DATA_5_N

D_DATA_3_N

Signals are routed directly from image sensor to connector. Details on specific signals are described in the

respective image sensor datasheet.

Version v1.0g from 2020-03-30

D_DATA_1_N

D_DATA_7_P

D_DATA_5_P

D_DATA_3_P

D_DATA_1_P

SLAMODE

XMASTER

Name

XTRIG

GND

XHS

XCE

XVS

SCL

FSM-IMX304M / FSM-IMX304C

Datasheet

Table of Contents

1 FRAMOS Sensor Module Ecosystem ............................................................................................................ 4

2 Software Package and Drivers ...................................................................................................................... 5

2.1 Reference Software: NVIDIA Jetson TX2, AGX Xavier ........................................................................... 6

Platform and Sensor Device Drivers ............................................................................................. 6

Image Pre-Processing Examples ................................................................................................... 7

2.1.1

2.1.2

3 Ecosystem Compatibility Matrix ................................................................................................................. 10

3.1 Hardware Support .............................................................................................................................. 10

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Datasheet

1 FRAMOS Sensor Module Ecosystem

The FSM Ecosystem consists of FRAMOS Sensor Modules, Adapters, Software and Sources, and provides one

coherent solution supporting the whole process of integrating image sensors into embedded vision products.

During the evaluation and proof-of-concept phase, off-the-shelf sensor modules with a versatile adapter

framework allow the connection of latest image sensor technology to open processing platforms, like the

NVIDIA Jetson TX2, AGX Xavier or the standard. Reference drivers and sample applications deliver

images immediately after installation, supporting V4L2 and an optional derivate API providing comfortable

integration. Within the development phase, electrical design references and driver sources guide with a solid

and proven baseline to quickly port into individual system designs and extend scope, while decreasing risk and

efforts.

Processing Board

To simplify and relieve the whole supply chain, all FRAMOS Sensor Modules and adapters are optimized and

ready for delivery in volume and customization with pre-configured lens holder, lens and further accessories.

Key Benefits & Features

Hardware Offering:

▪

Off-the-shelf FRAMOS Sensor Modules (FSM), ready for

evaluation and mass production.

Versatile adapter framework, allowing flexible testing of

different modules, on different processing boards:

▪ FRAMOS Sensor Adapter (FSA) – everything the

specific sensor needs for operation

▪ FPAMOS Processor Adapter (FPA) – connecting up

to four FSM + FSA to a specific processor board

From lenses, mechanics and cables, all needed imaging

accessories from one hand

Software Package:

▪ Drivers providing base level sensor integration:

▪ Platform specific device drivers

▪ V4L2 subdevice drivers for specific image sensors

(low-level C API)

Streamlined V4L2 library (LibSV) with comfortable and

generic C/C++ API

Example application demonstrating initialization, basic

configuration and image stream processing

▪

Further to off-the-shelf hard- and software, the Ecosystem supports you with:

▪ Driver sources allowing the focus on application specific scope and sensor features

▪ Electrical references for FSA and FPA, supporting quick and optimized embedding of FSMs

▪ Engineering services via FRAMOS and its partners, allowing you to focus on your product’s unique value

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Datasheet

2 Software Package and Drivers

As FRAMOS we know that the getting started with a new technology is the biggest challenge. The idea behind

the Software Pack is to enable embedded software engineers to get quickly to a streaming system and provide

at the same time all tools that are needed to extend and adapt it according the individual needs of the

application.

What the software package and driver are:

▪ A reference for a custom sensor implementation

▪ Demonstrating how to use the required interfaces

▪ Demonstrating how to communicate with the image sensor

▪ Demonstrating how to generaly initialize and configure the image sensor

▪ Provide initial image streaming output to the user space

▪ Demonstrating how to run basic image processing on pixel data

What it is not:

▪ A fully featured camera implementation (not all sensors features implemented)

▪ Ready to be use in the field

▪ A benchmark for the capabilities of the image sensor

▪ Focused on image processing

Supported Processor Platforms

The table below shows which platforms are supported by the standard driver package, and how many FSMs

can at maximum be operated in parallel.

Sensor Module

FSM-AR0144

FSM-AR0521

FSM-AR1335

FSM-HDP230

FSM-IMX264

FSM-IMX283

FSM-IMX290

FSM-IMX296

FSM-IMX297

FSM-IMX304

FSM-IMX327

FSM-IMX334

FSM-IMX335

FSM-IMX412

FSM-IMX415

FSM-IMX462

FSM-IMX477

FSM-IMX485

FSM-IMX577

FSM-IMX530

NVIDIA

Jetson TX2

NVIDIA

AGX Xavier

DragonBoard

410c

96Boards

Consumer Edition

Xilinx

Development Boards

HW only, driver

development on

project basis.

HW only, driver

development on project

basis.

4 11

Table 1: Ecosystem Software Package - Supported number of FSMs per processing board

1 SLVS-EC based FPGA reference implementation as part of the SLVS-EC RX IP Core offering.

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Datasheet

2.1 Reference Software: NVIDIA Jetson TX2, AGX Xavier

The software package provided with the Development Kits of the FRAMOS Sensor Module Ecosystem provided

for NVIDIA Jetson platforms provides a reference implementation of sensor and device drivers for MIPI CSI-2.

It contains a minimum feature set demonstrating how to utilize the platform specific data interface and

communication implementation, as well as the initialization of the image sensor and implementation of basic

features.

Package Content:

▪ Platform and device drivers with Linux for Tegra Support

▪ V4L2 based subdevice drivers (low-level C API)

▪ Streamlined V4L2 library (LibSV) providing generic C/C++ API

▪ Image Pre-Processing Examples:

▪ OpenCV (Software)

▪ LibArgus (Hardware)

2.1.1 Platform and Sensor Device Drivers

Image Modes – Image Format and Speeds

Their impact of several major attributes to the main configuration of the image data stream formatting,

requires a static pre-configuration within the device tree:

▪ Image / streaming resolution

▪ Pixel format / bit depth

▪ Data rate / lane configuration

Each driver provides access to 3 – 5 pre-built configurations, reflecting the main operation modes of the

imager. Beside the full resolution, that is always available, they allow to receive image streams in common

video resolutions like VGA, Full HD and UHD as they are supported or make sense by the imagers, and utilize

sensor features like ROI and binning.

They act as an example for implementation and usage and are available as source. Due to the size limitation

of the device tree, it is not possible to integrate an extensive set of options.

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Datasheet

General Features – Sensor Attributes

The drivers as part of the Software Pack support the sensor features as shown in the table below.

Synchronizing

Master

Mode

(Master

Slave)

Test

Pattern

Output

Gain

(Analog

Digital)

Flip

Mirror

HDR

Output

Frame

Rate

Black

Level

Broadcast

FSM-AR0144

FSM-AR0521

FSM-AR1335

FSM-HDP230

FSM-IMX264

FSM-IMX283

FSM-IMX290

FSM-IMX296

FSM-IMX297

FSM-IMX304

FSM-IMX327

FSM-IMX334

FSM-IMX335

FSM-IMX412

FSM-IMX415

FSM-IMX462

FSM-IMX477

FSM-IMX485

FSM-IMX530

FSM-IMX577

Table 2: Supported sensor features on NVIDIA Jetson TX2 / AGX Xavier

Data

Rate

Pre-Implemented

Features per

Model

Sensor

Mode

Exposure

Time

V4L (libsv) and libargus

V4L (libsv)

Not Implemented

*Only supported in all pixel mode

2.1.2 Image Pre-Processing Examples

The provided image processing examples show the general mechanisms of data handling, for an image

processing using 3rd-party IP. Both, the OpenCV and the LibArgus examples do not output data that is tuned

for best visual experience.

LibArgus Example:

▪ Closed source ISP implementation

▪ Using hard ISP in NVIDIA SoC

▪ Most performant option

▪ Example Implementation: Full but not tuned image pipeline, Displaying

Color tuning and lens correction needs to be calibrated for every image sensor separately and depends on

sensor and lens attributes as well as illumination situation.

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Color

Artifact

Suppr.

Auto

Exposure,

Gain

Bad

Pixel

Correction

Auto

White

Balance

Edge

Enhancement

Datasheet

Black

Level

Comp.

Noise

Reduction

FSM-AR0144

FSM-AR0521

FSM-AR1335

FSM-HDP230

FSM-IMX264

FSM-IMX283

FSM-IMX290

FSM-IMX296

FSM-IMX297

FSM-IMX304

FSM-IMX327

FSM-IMX334

FSM-IMX335

FSM-IMX412

FSM-IMX415

FSM-IMX477

FSM-IMX485

FSM-IMX530

FSM-IMX577

Table 3: Implemented LibArgus features for NVIDIA Jetson TX2 / AGX Xavier

Downscaling

Demosaic

Image

Pre-Processing

Features

per Model

Color

Correction

Implemented

Using Default Config

Not Implemented

Default Config

Image streaming is performed through the libargus pipeline, using a common configuration. It demonstrates

the usage of libargus but is not optimized for the certain sensor configuration and might not lead to good

image representation.

Appropriate tuning can be applied on project basis for the individual sensor and lens combination.

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

OpenCV Example:

▪ Open software library

▪ Easy to use and large feature set

▪ Extremely performance hungry (CPU)

▪ Not recommended for pre-processing

▪ Example Implementation: Demosaicing, Displaying

Color

Artifact

Suppr.

Auto

Exposure,

Gain

Bad

Pixel

Correction

Auto

White

Balance

Edge

Enhancement

Black

Level

Comp.

Noise

Reduction

Color

Correction

Datasheet

FSM-AR0144

FSM-AR0521

FSM-AR1335

FSM-HDP230

FSM-IMX264

FSM-IMX283

FSM-IMX290

FSM-IMX296

FSM-IMX297

FSM-IMX304

FSM-IMX327

FSM-IMX334

FSM-IMX335

FSM-IMX412

FSM-IMX415

FSM-IMX477

FSM-IMX485

FSM-IMX530

FSM-IMX577

Table 4: Implemented features in OpenCV example

Downscaling

Demosaic

Image

Pre-Processing

Features

per Model

Implemented

Not Implemented

Due to limited performance and extreme resource utilization, it is not planned to enhance the image

processing support on software side.

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Datasheet

3 Ecosystem Compatibility Matrix

3.1 Hardware Support

The following matrix shows the compatibility of FSMs, FSAs and FPAs to each other. The FSAs differentiate to

each other by supplied voltages, power up sequence, generated clock (oscillator) and physical attributes.

Sensor Modules with MIPI CSI-2 (D-PHY) Output

FSM-IMX290

FSM-IMX327

FSM-IMX334

FSM-IMX412 FSM-IMX335

FSM-IMX477 FSM-IMX462 FSM-IMX296 FSM-AR0521

Item FSM-IMX577 FSM-IMX485 FSM-IMX297 FSM-AR1335 FSM-IMX415 FSM-IMX283 FSM-AR0144 FSM-HDP230

FPA-4.A/TXA

FSA-FT1/A

FPA-2.A/96B

FPA-ABC/XX12

FSA-FT3/A

FSA-FT6/A

FSA-FT7/A

FSA-FT11/A

FSA-FT12/A

FSA-FT13/A

FSA-FT19/A

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

Table 5: Ecosystem Compatibility Matrix – Native CSI-2 (D-PHY) FSMs

2 Not verified, Xilinx Development Board with hard MIPI CSI-2 / D-PHY interface.

Version v1.0g from 2020-03-30

FSM-IMX304M / FSM-IMX304C

Sensor Modules with (Sub-) LVDS and SLVS Output

Item

FSA-FT14/ A-00G

FSA-FT14/BC

FSA-FT15/A-00G

FSA-FT15/BC

FSA-FT18/A-00G

FSA-FT18/BC

FSA-FT20/BC

Data Output

(FSA)

MIPI CSI-2

Sub-LVDS

MIPI CSI-2

Sub-LVDS

MIPI CSI-2

SLVS, SLVS-EC

FSM-IMX264

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-ABC/XX1

FSM-IMX304

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-ABC/XX1

FSM-IMX421

FPA-ABC/XX1

Datasheet

FSM-IMX530

FPA-4.A/TXA

FPA-2.A/96B

FPA-ABC/XX12

FPA-ABC/XX1

Table 6: Ecosystem Compatibility Matrix – Sub-LVDS, SLVS and SLVS-EC FSMs