patents.google.com

CN112291446A - A non-uniformity correction method for large area array CMOS image sensor - Google Patents

  • ️Fri Jan 29 2021

CN112291446A - A non-uniformity correction method for large area array CMOS image sensor - Google Patents

A non-uniformity correction method for large area array CMOS image sensor Download PDF

Info

Publication number
CN112291446A
CN112291446A CN202011135899.XA CN202011135899A CN112291446A CN 112291446 A CN112291446 A CN 112291446A CN 202011135899 A CN202011135899 A CN 202011135899A CN 112291446 A CN112291446 A CN 112291446A Authority
CN
China
Prior art keywords
image
matrix
image sensor
uniformity
cmos image
Prior art date
2020-10-22
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011135899.XA
Other languages
Chinese (zh)
Other versions
CN112291446B (en
Inventor
张贵祥
王士伟
徐伟
陶淑苹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changchun Institute of Optics Fine Mechanics and Physics of CAS
Original Assignee
Changchun Institute of Optics Fine Mechanics and Physics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
2020-10-22
Filing date
2020-10-22
Publication date
2021-01-29
2020-10-22 Application filed by Changchun Institute of Optics Fine Mechanics and Physics of CAS filed Critical Changchun Institute of Optics Fine Mechanics and Physics of CAS
2020-10-22 Priority to CN202011135899.XA priority Critical patent/CN112291446B/en
2021-01-29 Publication of CN112291446A publication Critical patent/CN112291446A/en
2022-03-01 Application granted granted Critical
2022-03-01 Publication of CN112291446B publication Critical patent/CN112291446B/en
Status Active legal-status Critical Current
2040-10-22 Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/63Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/67Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
    • H04N25/671Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/20Circuitry for controlling amplitude response
    • H04N5/202Gamma control

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

本发明涉及一种大面阵CMOS图像传感器的非均匀性校正方法,有效解决了CMOS图像传感器的非均匀性问题,同时减少了参数存储,易于硬件系统的实现,保证了实时性要求。首先在积分球均匀光照下,对CMOS图像传感器进行原始图像采集,并对采集到的图像进行非均匀度计算,得到非均匀度最大值对应的图像,然后根据CMOS图像传感器的结构特点,将大面阵CMOS图像的列进行分组处理,利用分组进行参数求取,最终建立用于对CMOS图像传感器进行非均匀性校正的校正模型。本发明引入了最小二乘法,增加了校正精度,同时所得参数远远小于传统定标法的参数量,节约了硬件资源,降低了系统功耗,而且算法结构简单,计算量小,易于硬件实现。

Figure 202011135899

The invention relates to a non-uniformity correction method for a large area array CMOS image sensor, which effectively solves the non-uniformity problem of the CMOS image sensor, reduces parameter storage, facilitates the realization of a hardware system, and ensures real-time requirements. First, under the uniform illumination of the integrating sphere, the original image of the CMOS image sensor is collected, and the non-uniformity of the collected image is calculated to obtain the image corresponding to the maximum non-uniformity. Then, according to the structural characteristics of the CMOS image sensor, the large The columns of the area array CMOS image are processed in groups, and the parameters are obtained by grouping, and finally a correction model for non-uniformity correction of the CMOS image sensor is established. The invention introduces the least squares method, which increases the correction accuracy, and at the same time, the obtained parameters are far smaller than the parameters of the traditional calibration method, which saves hardware resources and reduces the system power consumption. Moreover, the algorithm has a simple structure, a small amount of calculation, and is easy to implement in hardware. .

Figure 202011135899

Description

Non-uniformity correction method for large-area array CMOS image sensor

Technical Field

The invention relates to the technical field of image preprocessing, in particular to a non-uniformity correction method of a large-area array CMOS image sensor.

Background

With the continuous development and progress of the integrated circuit technology, the imaging performance of the CMOS device is continuously improved, and the imaging quality of the CMOS device can meet most application scenarios. Meanwhile, the imaging system based on the CMOS design has the advantages of low cost, low power consumption, simple structure, easy realization of system-on-chip integration and the like, so that the imaging system is more and more widely applied. However, any type of image sensor has a problem of non-uniformity with different degrees, and in practical applications, it is mostly necessary to use a corresponding non-uniformity correction technique for correction.

The non-uniformity of the CMOS image sensor is mainly represented by stripe noise, which is mainly caused by the non-uniform response of the pixels of the CMOS detector, including the subtle difference in the size of the pixels detected by the detector, the influence of weak dark current, the incompleteness of the correction of the response function, the non-uniformity of the optical coating on the surface of the detector, the influence of the external environment and temperature variation on the photoelectric system of the detector, and the like. The non-uniformity correction is an effective method for reducing the fixed pattern noise of the CMOS image sensor, and has important significance for acquiring high-quality images.

In engineering, calibration methods are generally used for non-uniformity correction, and calibration method based on calibration methods mainly include two-point correction, piecewise linear correction, polynomial fitting correction and sigmoid curve correction. The S-shaped curve correction method has the best effect on the non-uniformity correction of the image, but the calculation correction algorithm is complex to realize, and the realization difficulty is high by adopting the FPGA. Although the two-point correction method is easy to implement, the correction effect is not good when the two-point correction method has a nonlinear response characteristic. The correction effect of the piecewise linear correction is related to the length of the piecewise interval, and the more the piecewise interval is, the better the correction effect is, but the more parameters need to be obtained. For hardware real-time operation, too many interval segmentation cannot be realized, so that the segmentation uniformity correction result cannot be ensured. The polynomial fitting correction method fits the coefficients of the polynomial through a least square method, and can balance between calculated amount and correction effect by combining with actual engineering requirements.

However, with the continuous increase of the number of pixels of a large-area array CMOS image sensor, some pixels reach tens of millions and even hundreds of millions, and the frame rate is also continuously increased, so that the original algorithm is difficult to implement in hardware, the storage space of the required correction parameter is increased, the correction time is long, and the real-time processing cannot be guaranteed.

Disclosure of Invention

The invention provides a non-uniformity correction method of a large-area array CMOS image sensor, which can effectively solve the non-uniformity problem of the CMOS image sensor, simultaneously reduces parameter storage, is easy to realize a hardware system and ensures the real-time requirement, in order to overcome the problems of difficult hardware realization, large parameter storage space required for correction, long correction time, incapability of ensuring real-time correction processing and the like of the non-uniformity correction method in the prior art.

In order to solve the technical problems, the invention adopts the following technical scheme:

a non-uniformity correction method of a large-area array CMOS image sensor comprises the following steps:

the method comprises the following steps: under the uniform illumination of the integrating sphere, original image acquisition is carried out on the CMOS image sensor to obtain N images I with different irradiances1,I2,…,IN

Step two: for the collected image I1,I2,…,INCalculating the non-uniformity to obtain an image I corresponding to the maximum value of the non-uniformitymax

Step three: finding an image ImaxDetermining the average value of the gray scale of each column of pixels to determine the maximum average value of the gray scale TmaxAnd minimum mean value of gray scale Tmin

Step four: will [ Tmin,Tmax]The interval is divided into k sub-intervals on average;

step five: according to image ImaxThe number of pixel rows m and the number of pixel columns n establish k m x n zero matrices a1,a2,…,ai,…,akWherein a isiI is more than or equal to 1 and less than or equal to k and is a zero matrix corresponding to the ith subinterval;

step six: according to image ImaxImage I is obtained by averaging the gray levels of each column of pixelsmaxColumn mean matrix A of1Column mean matrix A1A matrix | x of 1 × n1,x2,…,xj,…,xnL, where xjAs an image ImaxJ is more than or equal to 1 and less than or equal to n of the gray level mean value of the jth row of pixels;

step seven: according to the column mean matrix A1The subinterval corresponding to each element of (1), image ImaxAre respectively assigned to the corresponding zero matrix a1,a2,…,ai,…,akIn the corresponding column position, the corresponding matrix beta is obtained12,…,βk

Step eight: according to the step seven pairs of images ImaxFor the image I respectively1,I2,…,INGrouping to obtain k groups of matrix data:

Figure BDA0002736647440000031

step nine: respectively solving a gray level mean value for each non-zero matrix element in the k groups of matrix data to obtain k gray level mean value matrixes:

Figure BDA0002736647440000032

step ten: calculating the mean value of each gray mean value matrix to obtain an image I1,I2,…,INCorresponding image gray average value avg1,avg2,…,avgN

Step eleven: taking the gray level mean value obtained in the ninth step as a vertical coordinate, taking the corresponding image gray level mean value obtained in the tenth step as a horizontal coordinate, and establishing a data relation to obtain k groups of data for curve fitting:

Figure BDA0002736647440000033

step twelve: introducing a least square method, and respectively performing curve fitting on the k groups of data according to the residual square sum minimum principle to obtain k curves f containing correction parametersi(x),i=1,2,…,k;

Step thirteen: will matrix beta12,…,βkThe elements with the internal non-zero value are assigned to be 1 to obtain a matrix theta12,…,θk

Fourteen steps: according to curve fi(x) And matrix theta12,…,θkEstablishing a correction model for carrying out non-uniformity correction on the CMOS image sensor:

Figure BDA0002736647440000041

wherein, IpreFor the input image of the CMOS image sensor before correction, IafterAnd outputting an image for the corrected CMOS image sensor.

Compared with the prior art, the invention has the following beneficial effects:

(1) according to the structural characteristics of the CMOS image sensor, grouping the large-area array CMOS image columns, and solving parameters by utilizing the grouping;

(2) a least square method is introduced, so that the correction precision is increased;

(3) the obtained parameters are far smaller than the parameter quantity of the traditional scaling method, so that hardware resources are saved, and the system power consumption is reduced;

(4) the algorithm has simple structure, small calculation amount and easy hardware realization.

Drawings

Fig. 1 is a flowchart of a non-uniformity correction method for a large-area array CMOS image sensor according to an embodiment of the present invention;

FIG. 2 is a diagram of an image I according to an embodiment of the present inventionmaxThe column division results for example 10 pixels × 10 pixels, k — 3 are illustratedFigure (a).

Detailed Description

The technical solution of the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments.

Due to the influence of factors such as manufacturing process and the like, the photo-generated charge diffusion length, the photon absorption depth and the size of a photosensitive surface of each pixel photosensitive element are different, and each column of the CMOS image sensor is provided with an amplifier and an AD converter, so that thousands of amplifiers and AD converters cannot be guaranteed to have completely the same parameters in the manufacturing process. Therefore, when the same light intensity is input, the output signal of each pixel is different, so that the output image may have column stripes, which seriously affects the imaging quality.

The invention provides a non-uniformity correction method of a large-area array CMOS image sensor based on a polynomial fitting correction method by combining the structural characteristics of the CMOS image sensor, wherein in one embodiment, as shown in figure 1, the method comprises the following steps:

the method comprises the following steps: under the uniform illumination of the integrating sphere, original image acquisition is carried out on the CMOS image sensor to obtain N images I with different irradiances1,I2,…,IN

Step two: for the collected image I1,I2,…,INPerforming non-uniformity (PRNU) calculation to obtain image I corresponding to non-uniformity maximum valuemax

Alternatively, the image I is represented by1,I2,…,INFor each image of the series:

Figure BDA0002736647440000051

in the formula: PRNU is the image non-uniformity, Avg is the image gray level mean, VijM 'and N' are the number of pixel rows and pixel columns, respectively, of the image, which are the gray scale values at pixel (i, j).

Step three: from the resulting image ImaxObtaining an image ImaxDetermining the average value of the gray scales of each column of pixels, and expressing the average value of the maximum gray scales as TmaxThe minimum gray mean value is represented as Tmin

Step four: will [ Tmin,Tmax]The interval is divided into k sub-intervals on average;

step five: obtaining an image ImaxThe number of pixel rows m and the number of pixel columns n, and k m × n zero matrixes a are established according to the number of pixel rows m and the number of pixel columns n1,a2,…,ai,…,akWherein a isiI is more than or equal to 1 and less than or equal to k and is a zero matrix corresponding to the ith subinterval;

step six: according to image ImaxImage I is obtained by averaging the gray levels of each column of pixelsmaxColumn mean matrix A of1Column mean matrix A1A matrix | x of 1 × n1,x2,…,xj,…,xnL, where xjAs an image ImaxJ is more than or equal to 1 and less than or equal to n of the gray level mean value of the jth row of pixels; original image ImaxIs an m x n matrix, and after the gray average value of each row of pixels is obtained, a new matrix of 1 x n is formed, and a row average value matrix A is obtained1

Step seven: according to the column mean matrix A1The subinterval corresponding to each element of (1), image ImaxIs assigned to the corresponding zero matrix a1,a2,…,akIn the corresponding column position, realize the image ImaxTo obtain a corresponding matrix beta12,…,βk

The specific process is as follows: column mean matrix A1Is a 1 × n matrix | x1,x2,…,xj,…,xnAccording to the column mean matrix A1The size of each element in the matrix may determine the sub-interval corresponding to each element, such as element x in the matrix1Is in the zero matrix a1Within the sub-interval, the image ImaxIs assigned to the zero matrix a1In the first column of (1), and so on, image ImaxAll columns of (a) are assigned to the corresponding zero matrix a1,a2,…,akIn (2), a corresponding matrix beta is obtained12,…,βk

Step eight: according to the step seven pairs of images ImaxThe column division result can know that each column of the image gray level matrix is specifically divided into the zero matrix, the columns of the image are correspondingly grouped into the zero matrix of the corresponding gray level interval according to the division result, and by analogy, after the image is divided into the same zero matrix, each zero matrix is correspondingly provided with N new matrixes, such as beta11Is I1Gray matrix division into zero matrix a1The new matrix, beta, obtained thereafter11,β21,β31,…βN1Is I1,I2,…,INIn the zero matrix a1The data of (c); by analogy, k groups of matrix data are obtained:

Figure BDA0002736647440000061

step nine: respectively solving a gray level mean value for each non-zero matrix element in the k groups of matrix data to obtain k gray level mean value matrixes:

Figure BDA0002736647440000071

in the gray-scale mean matrix, avg11Representing the non-zero matrix element beta11And (5) solving the gray level average value, and so on.

Step ten: calculating the mean value of each gray mean value matrix to obtain an image I1,I2,…,INCorresponding image gray average value avg1,avg2,…,avgNWherein avg is1Is represented by1And (5) averaging the gray levels of all pixels of the gray level image, and so on.

Step eleven: taking the gray level mean value obtained in the ninth step as a vertical coordinate, taking the corresponding image gray level mean value obtained in the tenth step as a horizontal coordinate, and establishing a data relation to obtain k groups of data for curve fitting:

Figure BDA0002736647440000072

step twelve: introducing a least square method, and respectively performing curve fitting on the k groups of data according to the residual square sum minimum principle to obtain k curves f containing correction parametersi(x),(i=1,2,…k);

Optionally, curve fi(x) For a first order function y ═ aix+biWherein a isiAnd biAre calibration parameters.

Step thirteen: will matrix beta12,…,βkThe elements with the internal non-zero value are assigned to be 1 to obtain a matrix theta12,…,θk

Fourteen steps: according to curve fi(x) And matrix theta12,…,θkEstablishing a correction model for carrying out non-uniformity correction on the CMOS image sensor:

Figure BDA0002736647440000073

wherein, IpreFor the input image of the CMOS image sensor before correction, IafterAnd outputting an image for the corrected CMOS image sensor.

The non-uniformity correction method for the large-area array CMOS image sensor provided by the embodiment has the following beneficial effects:

(1) according to the structural characteristics of the CMOS image sensor, grouping the large-area array CMOS image columns, and solving parameters by utilizing the grouping;

(2) a least square method is introduced, so that the correction precision is increased;

(3) the obtained parameters are far smaller than the parameter quantity of the traditional scaling method, so that hardware resources are saved, and the system power consumption is reduced;

(4) the algorithm has simple structure, small calculation amount and easy hardware realization.

The technical solution of the present invention will be described in detail below with specific examples.

Step S1: collecting a plurality of images under uniform illumination of integrating spheres with different irradiances to obtain 10 images I with different irradiances1,I2,…,I10

Step S2: the acquired image I is processed by1,I2,…,I10Performing non-uniformity (PRNU) calculation to obtain image I corresponding to PRNU maximum valuemax

Figure BDA0002736647440000081

In the formula: PRNU is the image non-uniformity, Avg is the image gray level mean, VijM 'and N' are the number of pixel rows and pixel columns, respectively, of the image, which are the gray scale values at pixel (i, j).

Step S3: from the resulting image ImaxObtaining an image ImaxDetermining the average value of the gray scale of each column of pixels to determine the maximum average value of the gray scale TmaxAnd minimum mean value of gray scale Tmin

Step S4: will [ Tmin,Tmax]The interval is divided into k subintervals with the period of t on average:

[Tmin,Tmin+t],[Tmin+t,Tmin+2t],…,[Tmin+(k-1)t,Tmax]

step S5: with image ImaxFor a 10pixel × 10pixel gray matrix (m is 10, n is 10), k is 3 for example, 3 10 × 10 zero matrices are established, each being a1,a2,a3

Step S6: according to image ImaxImage I is obtained by averaging the gray levels of each column of pixelsmaxColumn mean matrix A of1Column mean matrix A1Is a matrix | x of 1 × 101,x2,…,x10|;

Step S7: according to the column mean matrix A1The subinterval corresponding to each element of (1), image ImaxIs assigned to the corresponding zero matrixa1,a2,a3In the corresponding column position, realize the image ImaxTo obtain a corresponding matrix beta123(ii) a As shown in fig. 2, the corresponding column mean matrix a1By dividing the image ImaxEach column of to a1,a2,a3In (b) to obtain beta123

Step S8: for image I according to step S7maxFor the image I respectively1,I2,…,I10Grouping to obtain 3 groups of matrix data: beta is a1,12,1,…,β10,1,β1,22,2,…,β10,2,β1,32,3,…,β10,3

Step S9: respectively solving a gray average value for each non-zero matrix element in the 3 groups of matrix data to obtain 3 gray average value matrixes:

with one set of matrix data beta1,12,1,…,β10,1For example, the gray level mean value of each non-zero matrix element is calculated respectively to obtain 1 gray level mean value matrix:

avg1,1,avg2,1,…,avg10,1

step S10: according to the gray level mean matrix avg1,1,avg2,1,…,avg10,1Calculating the mean value to obtain an image I1,I2,…,I10Corresponding image gray average value avg1,avg2,…,avg10

Step S11: according to (avg)1,avg1,1),(avg2,avg2,1),(avg3,avg3,1),…,(avg10,avg10,1) Drawing a curve;

step S12: introducing a least square method, and fitting a curve according to a minimum principle of residual square sum;

curve fitting is performed taking the first order function y as an example of ax + b:

computing the sum of squares of the residuals

Figure BDA0002736647440000091

Making a and b reasonably valued to minimize the value of M;

by calculating the partial derivatives of a and b:

Figure BDA0002736647440000092

Figure BDA0002736647440000093

obtaining correction parameters a and b by the above formula;

Figure BDA0002736647440000101

Figure BDA0002736647440000102

for the

rest

2 sets of matrix data beta1,22,2,…,β10,2,β1,32,3,…,β10,3The calculations of steps S9 to S12 are performed, respectively, to obtain a total of 3 sets of correction parameters, a1,b1,a2,b2,a3,b3

Step S13: will matrix beta123The elements with the internal non-zero value are assigned to be 1 to obtain a matrix theta123

Step S14: according to curve fi(x) And matrix theta123Establishing a correction model for carrying out non-uniformity correction on the CMOS image sensor:

Figure BDA0002736647440000103

wherein, IpreTo input an image for the CMOS image sensor before correction,Iafterand outputting an image for the corrected CMOS image sensor.

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (3)

1.一种大面阵CMOS图像传感器的非均匀性校正方法,其特征在于,包括以下步骤:1. a non-uniformity correction method of a large area array CMOS image sensor, is characterized in that, comprises the following steps: 步骤一:在积分球均匀光照下,对CMOS图像传感器进行原始图像采集,得到N幅不同辐照度的图像I1,I2,…,INStep 1: Under the uniform illumination of the integrating sphere, the original image is collected on the CMOS image sensor to obtain N images I 1 , I 2 , . . . , I N with different irradiances; 步骤二:对采集到的图像I1,I2,…,IN进行非均匀度计算,得到非均匀度最大值对应的图像ImaxStep 2: Perform non - uniformity calculation on the collected images I 1 , I 2 , ..., IN to obtain an image I max corresponding to the maximum non-uniformity value; 步骤三:求取图像Imax每一列像元的灰度均值,确定最大灰度均值Tmax和最小灰度均值TminStep 3: Obtain the grayscale mean value of each column of pixels in the image Imax , and determine the maximum grayscale mean value Tmax and the minimum grayscale mean value Tmin ; 步骤四:将[Tmin,Tmax]区间平均划分为k个子区间;Step 4: Divide the interval [T min , T max ] into k sub-intervals on average; 步骤五:根据图像Imax的像素行数m和像素列数n建立k个m×n的零矩阵a1,a2,…,ai,…,ak,其中ai为第i个子区间对应的零矩阵,1≤i≤k;Step 5: Establish k m×n zero matrices a 1 , a 2 ,...,a i ,..., ak according to the pixel row number m and the pixel column number n of the image I max , where a i is the ith subinterval The corresponding zero matrix, 1≤i≤k; 步骤六:根据图像Imax每一列像元的灰度均值求取图像Imax的列均值矩阵A1,列均值矩阵A1为1×n的矩阵|x1,x2,…,xj,…,xn|,其中xj为图像Imax第j列像元的灰度均值,1≤j≤n;Step 6: Obtain the column mean matrix A 1 of the image I max according to the gray mean value of each column of pixels in the image I max, and the column mean matrix A 1 is a 1 ×n matrix |x 1 ,x 2 ,...,x j , ..., x n |, where x j is the average gray level of the pixel in the jth column of the image I max , 1≤j≤n; 步骤七:根据列均值矩阵A1的各元素所对应的子区间,将图像Imax的各列元素分别赋值到对应的零矩阵a1,a2,…,ai,…,ak相应列位置中,得到对应的矩阵β12,…,βkStep 7: According to the sub-intervals corresponding to the elements of the column mean matrix A 1 , assign the elements of each column of the image I max to the corresponding columns of the corresponding zero matrices a 1 , a 2 ,...,a i ,..., ak respectively In the position, the corresponding matrix β 12 ,…,β k is obtained; 步骤八:根据步骤七对图像Imax的列划分结果,分别对图像I1,I2,…,IN进行分组,得到k组矩阵数据:Step 8: According to the result of the column division of the image I max in step 7, the images I 1 , I 2 , .

Figure FDA0002736647430000011

Figure FDA0002736647430000011

步骤九:分别对k组矩阵数据中的各非零矩阵元素求取灰度均值,得到k个灰度均值矩阵:Step 9: Obtain the gray mean value of each non-zero matrix element in the k groups of matrix data, and obtain k gray mean value matrices:

Figure FDA0002736647430000021

Figure FDA0002736647430000021

步骤十:计算每一个灰度均值矩阵的均值,得到图像I1,I2,…,IN对应的图像灰度均值avg1,avg2,…,avgNStep 10: Calculate the mean value of each grayscale mean matrix, and obtain the image grayscale mean values avg 1 , avg 2 , ..., avg N corresponding to the images I 1 , I 2 , ..., I N ; 步骤十一:以步骤九求取得到的灰度均值为纵坐标,以步骤十计算得到的对应的图像灰度均值为横坐标,建立数据关系,得到用于曲线拟合的k组数据:Step 11: Take the gray mean value obtained in step 9 as the ordinate, and take the corresponding image gray mean value calculated in step 10 as the abscissa, establish a data relationship, and obtain k groups of data for curve fitting:

Figure FDA0002736647430000022

Figure FDA0002736647430000022

步骤十二:引入最小二乘法,根据残差平方和最小原则,对k组数据分别进行曲线拟合,得到包含校正参数的k条曲线fi(x),i=1,2,…,k;Step 12: Introduce the least squares method, and perform curve fitting on the k groups of data according to the principle of the minimum sum of squares of the residuals to obtain k curves f i (x) including correction parameters, i=1,2,...,k ; 步骤十三:将矩阵β12,…,βk内不为零的元素赋值为1,得到矩阵θ12,…,θkStep 13: Assign the non-zero elements in the matrix β 1 , β 2 ,..., β k to 1 to obtain the matrix θ 1 , θ 2 ,..., θ k ; 步骤十四:根据曲线fi(x)和矩阵θ12,…,θk建立用于对CMOS图像传感器进行非均匀性校正的校正模型:Step 14: According to the curve f i (x) and the matrix θ 1 , θ 2 ,..., θ k , establish a correction model for non-uniformity correction of the CMOS image sensor:

Figure FDA0002736647430000023

Figure FDA0002736647430000023

其中,Ipre为校正前的CMOS图像传感器输入图像,Iafter为校正后的CMOS图像传感器输出图像。Among them, I pre is the input image of the CMOS image sensor before correction, and I after is the output image of the CMOS image sensor after correction. 2.根据权利要求1所述的一种大面阵CMOS图像传感器的非均匀性校正方法,其特征在于,通过下式对图像I1,I2,…,IN中的每一幅图像进行非均匀度计算:2 . The non-uniformity correction method of a large area array CMOS image sensor according to claim 1 , wherein, each image in the images I 1 , I 2 , . . . , IN is performed by the following formula Non-uniformity calculation:

Figure FDA0002736647430000024

Figure FDA0002736647430000024

式中:PRNU为图像非均匀度,Avg为图像灰度均值,Vij为像素(i,j)处的灰度值,M’与N’分别为图像的像素行数和像素列数。In the formula: PRNU is the image non-uniformity, Avg is the average gray level of the image, V ij is the gray value at the pixel (i, j), M' and N' are the number of pixel rows and pixel columns of the image, respectively. 3.根据权利要求1或2所述的一种大面阵CMOS图像传感器的非均匀性校正方法,其特征在于,3. The non-uniformity correction method for a large area array CMOS image sensor according to claim 1 or 2, wherein, 曲线fi(x)为一阶函数y=aix+biThe curve f i (x) is a first-order function y=a i x+b i .
CN202011135899.XA 2020-10-22 2020-10-22 A non-uniformity correction method for large area array CMOS image sensor Active CN112291446B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011135899.XA CN112291446B (en) 2020-10-22 2020-10-22 A non-uniformity correction method for large area array CMOS image sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011135899.XA CN112291446B (en) 2020-10-22 2020-10-22 A non-uniformity correction method for large area array CMOS image sensor

Publications (2)

Publication Number Publication Date
CN112291446A true CN112291446A (en) 2021-01-29
CN112291446B CN112291446B (en) 2022-03-01

Family

ID=74423535

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011135899.XA Active CN112291446B (en) 2020-10-22 2020-10-22 A non-uniformity correction method for large area array CMOS image sensor

Country Status (1)

Country Link
CN (1) CN112291446B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112985269A (en) * 2021-02-20 2021-06-18 河北先河环保科技股份有限公司 Slit width uniformity measuring system, slit width uniformity measuring method and image processing device
CN115665579A (en) * 2022-10-17 2023-01-31 长春长光辰芯光电技术有限公司 Optical response nonuniformity correction method on COMS image sensor
CN115755155A (en) * 2022-11-04 2023-03-07 成都善思微科技有限公司 Detector image quality monitoring method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100128158A1 (en) * 2008-11-25 2010-05-27 Shen Wang Image sensors having non-uniform light shields
CN102622739A (en) * 2012-03-30 2012-08-01 中国科学院光电技术研究所 Image non-uniformity correction method for Bayer filter array color camera
US20140240512A1 (en) * 2009-03-02 2014-08-28 Flir Systems, Inc. Time spaced infrared image enhancement
CN106851141A (en) * 2016-12-14 2017-06-13 中国资源卫星应用中心 A kind of asymmetric correction method of remote sensing images
US20170195599A1 (en) * 2016-01-04 2017-07-06 Sensors Unlimited, Inc. Gain normalization and non-uniformity correction
CN109459135A (en) * 2018-12-07 2019-03-12 中国科学院合肥物质科学研究院 A kind of CCD imaging spectrometer image bearing calibration

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100128158A1 (en) * 2008-11-25 2010-05-27 Shen Wang Image sensors having non-uniform light shields
US20140240512A1 (en) * 2009-03-02 2014-08-28 Flir Systems, Inc. Time spaced infrared image enhancement
CN102622739A (en) * 2012-03-30 2012-08-01 中国科学院光电技术研究所 Image non-uniformity correction method for Bayer filter array color camera
US20170195599A1 (en) * 2016-01-04 2017-07-06 Sensors Unlimited, Inc. Gain normalization and non-uniformity correction
CN106851141A (en) * 2016-12-14 2017-06-13 中国资源卫星应用中心 A kind of asymmetric correction method of remote sensing images
CN109459135A (en) * 2018-12-07 2019-03-12 中国科学院合肥物质科学研究院 A kind of CCD imaging spectrometer image bearing calibration

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
郑亮亮等: "多通道宽响应域TDI CCD成像系统的非均匀性校正", 《光学学报》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112985269A (en) * 2021-02-20 2021-06-18 河北先河环保科技股份有限公司 Slit width uniformity measuring system, slit width uniformity measuring method and image processing device
CN115665579A (en) * 2022-10-17 2023-01-31 长春长光辰芯光电技术有限公司 Optical response nonuniformity correction method on COMS image sensor
CN115665579B (en) * 2022-10-17 2024-10-29 长春长光辰芯微电子股份有限公司 Photo-response non-uniformity correction method on COMS image sensor
CN115665579B9 (en) * 2022-10-17 2024-12-24 长春长光辰芯微电子股份有限公司 A method for correcting photoresponse non-uniformity on CMOS image sensors
CN115755155A (en) * 2022-11-04 2023-03-07 成都善思微科技有限公司 Detector image quality monitoring method and system
CN115755155B (en) * 2022-11-04 2024-06-11 成都善思微科技有限公司 Method and system for monitoring image quality of detector

Also Published As

Publication number Publication date
CN112291446B (en) 2022-03-01

Similar Documents

Publication Publication Date Title
CN112291446B (en) 2022-03-01 A non-uniformity correction method for large area array CMOS image sensor
CN100461216C (en) 2009-02-11 Techniques for modifying image field data
US9883178B2 (en) 2018-01-30 Method for measuring performance parameters and detecting bad pixels of an infrared focal plane array module
CN103377474B (en) 2016-08-03 Camera lens shadow correction coefficient determines method, camera lens shadow correction method and device
CN102625059B (en) 2017-05-03 Dynamic range extension for CMOS image sensors for mobile applications
CN102042878A (en) 2011-05-04 Infared nonuniformity correction method for removing temperature shift
CN114972085B (en) 2024-06-04 A fine-grained noise estimation method and system based on contrastive learning
CN102740008A (en) 2012-10-17 Method for correcting nonuniformity of space camera on-orbit radiation response
CN109709597B (en) 2023-10-03 Gain correction method for flat panel detector
CN106791506A (en) 2017-05-31 A kind of asymmetric correction method of cmos detector
CN111161183A (en) 2020-05-15 Method for correcting bad pixel points of flat panel detector in oral CT
CN106645220B (en) 2020-01-10 X-ray linear array detector correcting and filtering method
CN111504454A (en) 2020-08-07 CCD correction method and system and spectrometer with CCD correction system
Lefebvre et al. 2024 A mixed-signal near-sensor convolutional imager soc with charge-based 4b-weighted 5-to-84-tops/w mac operations for feature extraction and region-of-interest detection
CN114240801B (en) 2024-10-29 Non-uniform correction method for remote sensing image
CN112945897B (en) 2023-04-07 Continuous terahertz image non-uniformity correction method
CN115753691B (en) 2024-10-29 Water quality parameter detection method based on RGB reconstruction hyperspectrum
CN115420386B (en) 2024-11-08 Method for testing unstable pixels of infrared focal plane device based on relative current
RU2550523C2 (en) 2015-05-10 Method of determining coordinates of centre of gravity of image
CN105046674A (en) 2015-11-11 Nonuniformity correction method of multi-pixel parallel scanning infrared CCD images
CN110580692B (en) 2022-03-25 Method for correcting radiation consistency of multi-line time difference scanning image
CN114295226A (en) 2022-04-08 Calibration method for improving thermal imager temperature measurement resolution based on frame accumulation
CN110991225A (en) 2020-04-10 Method and device for crowd counting and density estimation based on multi-column convolutional neural network
CN114584757B (en) 2025-04-11 A Simple CCD Full Well Test Method
CN118732316B (en) 2025-03-11 Liquid crystal display production line screen detection management system based on machine vision

Legal Events

Date Code Title Description
2021-01-29 PB01 Publication
2021-01-29 PB01 Publication
2021-02-23 SE01 Entry into force of request for substantive examination
2021-02-23 SE01 Entry into force of request for substantive examination
2022-03-01 GR01 Patent grant
2022-03-01 GR01 Patent grant