CN106375653B - Image Acquisition control method and device - Google Patents

This application discloses a kind of Image Acquisition control method and devices, the described method includes: according to the depth distribution of the field depth of light-field camera and scene, determine an at least depth distribution sub-district for the scene, each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district；Adjust the focal length of the first sub-lens, to reduce the average blur circle that the object in the depth distribution sub-district is imaged on the first imaging region, wherein, first sub-lens are the sub-lens that the depth distribution sub-district Image Acquisition is influenced in the lenslet arrays of the light-field camera, and first imaging region is imaging region corresponding with first sub-lens in imaging surface；The light-field camera after adjusted carries out Image Acquisition to the scene.The application improves the image quality of scene entirety.

Image Acquisition control method and device

Technical field

This application involves a kind of field of terminal technology, more particularly to a kind of Image Acquisition control method and device.

Background technique

The depth of field (Depth of Field, abbreviation DoF) typically refers to the object distance that pick-up lens is capable of blur-free imaging to scene Range, that is to say, that in the depth direction can blur-free imaging with respect to the certain depth range before and after the focusing object plane of pick-up lens. The parameters such as aperture size, physics focal length length, the focal distance distance of camera lens and object by adjusting pick-up lens, can be one Determine to be adjusted the depth of field of pick-up lens in range, for example, field depth etc. can be reduced by tuning up aperture.

Larger field depth is obtained, especially there is larger field depth in the case where large aperture shoots situation, to camera shooting The requirement of camera lens is very high, and equipment manufacturing cost is expensive, usually can acquire respectively different focus by way of pick-up lens optically detecting Multiple images of object plane, further according to the Digital Signal Processing of multiple collected images to obtain the image of a larger field depth.

Summary of the invention

The brief overview about the application is given below, in order to provide the basic of some aspects about the application Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the application.It is not intended to determine the pass of the application Key or pith, nor intended limitation scope of the present application.Its purpose only provides certain concepts in simplified form, Taking this as a prelude to a more detailed description discussed later.

The embodiment of the present application provides a kind of Image Acquisition control method and device.

In a first aspect, the embodiment of the present application provides a kind of Image Acquisition control method, comprising:

According to the depth distribution of the field depth of light-field camera and scene, at least depth distribution of the scene is determined Area, each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district；

Adjust the focal length of the first sub-lens, with reduce the object in the depth distribution sub-district on the first imaging region at The average blur circle of picture, wherein first sub-lens divide to influence the depth in the lenslet arrays of the light-field camera The sub-lens of cloth sub-district Image Acquisition, first imaging region are imaging area corresponding with first sub-lens in imaging surface Domain；

The light-field camera after adjusted carries out Image Acquisition to the scene.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first sub-lens After Focussing, the object in the depth distribution sub-district is in first imaging region corresponding with first sub-lens The average blur circle of upper imaging is less than or equal to one and allows blur circle.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the field depth depth consecutive variations.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the discontinuous variation of field depth depth.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first son of adjustment is thoroughly The focal length of mirror, comprising: the phase difference that incident light passes through the different piece of first sub-lens is changed by outfield, to adjust State the focal length of the first sub-lens.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first son is adjusted thoroughly The focal length of mirror, comprising: according to the focal length of the main lens of the depth distribution of the depth distribution sub-district, the light-field camera, described Second between first distance and the lenslet arrays and the imaging surface between main lens and the lenslet arrays Distance determines the expectation focal length of first sub-lens；According at least to the coke of the first sub-lens described in the expectation Focussing Away from, with reduce the object in the depth distribution sub-district on first imaging region corresponding with first sub-lens at The average blur circle of picture.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, according at least to the expectation The focal length of first sub-lens described in Focussing, comprising: it is described to determine that incident light is each passed through according at least to the expectation focal length The phase difference formed after first sub-lens different piece；According to the mapping relations between phase difference and outfield, determination and the phase The corresponding outfield of potential difference；Change the phase difference that incident light passes through the different piece of first sub-lens by the outfield, with Adjust the focal length of first sub-lens.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first sub-lens are First liquid crystal sub-lens；After determining that incident light is each passed through the first sub-lens different piece according at least to the expectation focal length The phase difference of formation, comprising: according to expectation focal length, the radius of the first liquid crystal sub-lens and the wave of the incident light It is long, determine that the incident light is each passed through the phase difference formed after the different pieces of the first liquid crystal sub-lens.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, adjustment any described first The focal length of sub-lens, comprising: determine first sub-lens allows Focussing range；Focal length tune is allowed according at least to described Whole range adjusts the focal length of first sub-lens, to reduce the object in the depth distribution sub-district saturating with first son The average blur circle being imaged on corresponding first imaging region of mirror.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally it is determined that first son is thoroughly Mirror allows Focussing range, comprising: according to the main lens of the depth distribution of the depth distribution sub-district, the light-field camera Focal length, the first distance between the main lens and the lenslet arrays and the lenslet arrays and the imaging Second distance between face determines the expectation focal length of first sub-lens；First son is determined according to the expectation focal length Lens allow Focussing range.

Optionally allow according at least to described in conjunction with any Image Acquisition control method provided by the embodiments of the present application Focussing range adjusts the focal length of first sub-lens, comprising: allows Focussing range to determine incident light according to described Be each passed through formed after the first sub-lens different piece allow phase range；According to reflecting between phase difference and outfield Penetrate relationship, it is determining that the corresponding outfield of phase difference is allowed with one allowed in phase range；By the outfield change into Light is penetrated across the phase difference of the different piece of first sub-lens, to adjust the focal length of first sub-lens.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, first sub-lens are First liquid crystal sub-lens；Focussing range is allowed to determine that incident light is each passed through the first sub-lens difference portion according to described What is formed after point allows phase range, comprising: according to the maximum allowable focal length allowed within the scope of Focussing, described the The radius of one liquid crystal sub-lens and the wavelength of the incident light determine that the incident light is each passed through first liquid crystal respectively The first phase difference formed after the different piece of sub-lens；According to the minimum allowed within the scope of Focussing allow focal length, The radius of the first liquid crystal sub-lens and the wavelength of the incident light determine that the incident light is each passed through described respectively The second phase formed after the different piece of one liquid crystal sub-lens is poor；Really according to the first phase difference and second phase difference Phase range is allowed described in fixed.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally, the adjustment at least 1 the Before the focal length of one sub-lens, further includes: determining influences the depth distribution sub-district in the lenslet arrays of the light-field camera The sub-lens of Image Acquisition are first sub-lens.

In conjunction with any Image Acquisition control method provided by the embodiments of the present application, optionally it is determined that the light-field camera Lenslet arrays in influence the depth distribution sub-district Image Acquisition sub-lens be first sub-lens, comprising: according to Part corresponding with the depth distribution sub-district in the preview image for the scene that the light-field camera obtains, determining influences institute The sub-lens for stating depth distribution sub-district Image Acquisition are first sub-lens.

Second aspect, the embodiment of the present application also provides a kind of Image Acquisition control devices, comprising:

One depth distribution sub-district determining module, for according to the field depth of light-field camera and the depth distribution of scene, really Determine an at least depth distribution sub-district for the scene, each depth distribution sub-district is located at institute in an at least depth distribution sub-district It states except field depth；

One Focussing module, for adjusting the focal length of the first sub-lens, to reduce pair in the depth distribution sub-district As the average blur circle being imaged on the first imaging region, wherein first sub-lens are the sub-lens of the light-field camera Influence the sub-lens of the depth distribution sub-district Image Acquisition in array, first imaging region is in imaging surface with described the The corresponding imaging region of one sub-lens；

One image capture module carries out Image Acquisition to the scene for the light-field camera after adjusted.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens After Focussing, the object in the depth distribution sub-district is in first imaging region corresponding with first sub-lens The average blur circle of upper imaging is less than or equal to one and allows blur circle.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the field depth depth consecutive variations.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, an at least depth point At least one of cloth sub-district and the discontinuous variation of field depth depth.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the Focussing module It include: one first Focussing submodule, for changing the different piece that incident light passes through first sub-lens by outfield Phase difference, to adjust the focal length of first sub-lens.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the Focussing module It include: that an expectation focal length determines submodule, for the master according to the depth distribution of the depth distribution sub-district, the light-field camera First distance and the lenslet arrays between the focal length of lens, the main lens and the lenslet arrays with it is described Second distance between imaging surface determines the expectation focal length of first sub-lens；One second Focussing submodule, for extremely The focal length of few the first sub-lens according to the expectation Focussing, with reduce the object in the depth distribution sub-district with The average blur circle being imaged on corresponding first imaging region of first sub-lens.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, second Focussing Submodule includes: a phase difference determination unit, for determining that incident light is each passed through described according at least to the expectation focal length The phase difference formed after one sub-lens different piece；One outfield determination unit, for according to the mapping between phase difference and outfield Relationship determines outfield corresponding with the phase difference；One Focussing unit is passed through for changing incident light by the outfield The phase difference of the different piece of first sub-lens, to adjust the focal length of first sub-lens.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens are First liquid crystal sub-lens；The phase difference determination unit includes: that a phase difference determines subelement, for burnt according to the expectation Wavelength away from, the radius of the first liquid crystal sub-lens and the incident light, determines that the incident light is each passed through described The phase difference formed after the different piece of one liquid crystal sub-lens.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the Focussing module Include: to allow Focussing range determination submodule, allows Focussing range for determine first sub-lens；One Third Focussing submodule, for according at least to the focal length for allowing Focussing range to adjust first sub-lens, It is imaged with reducing the object in the depth distribution sub-district on first imaging region corresponding with first sub-lens Average blur circle.

It is optionally, described to allow Focussing in conjunction with any Image Acquisition control device provided by the embodiments of the present application Range determination submodule includes: an expectation focal length determination unit, for according to the depth distribution of the depth distribution sub-district, described First distance and the son between the focal length of the main lens of light-field camera, the main lens and the lenslet arrays are thoroughly Second distance between lens array and the imaging surface determines the expectation focal length of first sub-lens；One allows Focussing Range determination unit allows Focussing range for determine first sub-lens according to the expectation focal length.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the third Focussing Submodule includes: to allow phase range unit, and for allowing Focussing range to determine according to, incident light is worn respectively Cross after the first sub-lens different piece formed allow phase range；One outfield determination unit, for according to phase difference Mapping relations between outfield, it is determining that the corresponding outfield of phase difference is allowed with one allowed in phase range；One is burnt Away from adjustment unit, for changing the phase difference that incident light passes through the different piece of first sub-lens by the outfield, with Adjust the focal length of first sub-lens.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, first sub-lens are First liquid crystal sub-lens；Described to allow phase range unit include: that a first phase difference determines subelement, for according to Allow maximum allowable focal length, the radius of the first liquid crystal sub-lens and the wave of the incident light within the scope of Focussing It is long, determine that the incident light is each passed through the first phase difference formed after the different pieces of the first liquid crystal sub-lens respectively； One second phase difference determines subelement, for allowing the minimum within the scope of Focussing to allow focal length, described first according to The wavelength of the radius of liquid crystal sub-lens and the incident light determines that the incident light is each passed through the first liquid crystal respectively The second phase formed after the different piece of lens is poor；One allows phase range to determine subelement, for according to described first Phase difference and the second phase difference allow phase range described in determining.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, described device further include: one Sub-lens determining module influences the depth distribution sub-district Image Acquisition in the lenslet arrays for determining the light-field camera Sub-lens be first sub-lens.

In conjunction with any Image Acquisition control device provided by the embodiments of the present application, optionally, the sub-lens determine mould Block includes: that a sub-lens determine submodule, in the preview image of the scene for being obtained according to the light-field camera with institute The corresponding part of depth distribution sub-district is stated, determines that the sub-lens for influencing the depth distribution sub-district Image Acquisition are first son Lens.

The third aspect, the embodiment of the present application also provides another Image Acquisition control devices, comprising:

One processor, a communication interface, a memory and a communication bus；The processor, the communication interface with And the memory completes mutual communication by the communication bus；

The memory is for storing at least one instruction；Described instruction makes the processor execute following operation:

According to the depth distribution of the field depth of light-field camera and scene, at least depth distribution of the scene is determined Area, each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district；

Adjust the focal length of the first sub-lens, with reduce the object in the depth distribution sub-district on the first imaging region at The average blur circle of picture, wherein first sub-lens divide to influence the depth in the lenslet arrays of the light-field camera The sub-lens of cloth sub-district Image Acquisition, first imaging region are imaging area corresponding with first sub-lens in imaging surface Domain；

The light-field camera after adjusted carries out Image Acquisition to the scene.

The embodiment of the present application can be located at institute in the scene according to the field depth of light-field camera and the depth distribution of scene It states the region except field depth and determines that an at least depth distribution sub-district can make full use of for each depth distribution sub-district The characteristic of sub-lens focus adjustable, by adjusting the sub-lens (i.e. the first sub-lens) for influencing the depth distribution sub-district Image Acquisition Mode so that the imaging region corresponding with the sub-lens in the light-field camera of the object in the depth distribution sub-district The size for the average blur circle being imaged on (i.e. the first imaging region) is reduced, and pair in the depth distribution sub-district is thus improved The image quality of elephant；And the sub-lens for influencing field depth Image Acquisition can be controlled without Focussing, to avoid to scape The image quality of object in deep range has an impact.In this way, the light-field camera after corresponding sub-lens Focussing carries out figure As acquisition, by way of an optically detecting, does not influence the image quality that scene is located at the object of field depth not only, may be used also Improve the image quality that scene is located at the object in at least depth distribution sub-district except the field depth, to a certain extent It is equivalent on the basis of original field depth and increases obtained by optically detecting of light-field camera compared with high imaging quality Depth bounds improve the image quality of scene entirety.Further, since the embodiment of the present application makes full use of the material of the first sub-lens Matter characteristic realizes Focussing, and without the first sub-lens are moved or tilted in light-field camera, this is conducive to simplify System Computer Tool structure can meet but be not limited to the integrated application demand of the equipment such as light, thin, portable.

By the detailed description below in conjunction with attached drawing to the alternative embodiment of the application, the these and other of the application Advantage will be apparent from.

Detailed description of the invention

The application can be by reference to being better understood, wherein in institute below in association with description given by attached drawing Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated The alternative embodiment of application and the principle and advantage for explaining the application.In the accompanying drawings:

Fig. 1 is a kind of Image Acquisition control method flow chart provided by the embodiments of the present application；

Fig. 2 a is the alternative construction example of liquid crystal lens provided by the embodiments of the present application；

Fig. 2 b is the optional optical path example of liquid crystal lens provided by the embodiments of the present application；

Fig. 3 a is the alternative construction example of first planar lens (silicon stake lens) provided by the embodiments of the present application；

Fig. 3 b is the optional optical path example of the equivalent focusing of first planar lens provided by the embodiments of the present application；

Fig. 4 a is that the example of depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep It spends continuously distributed；

Fig. 4 b is that the example of depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep Spend discontinuous distribution；

Fig. 4 c is that the example of depth distribution sub-district provided by the embodiments of the present application and field depth depth distribution relationship is deep Spend the continuously distributed and discontinuous distribution of depth；

Fig. 5 is light-field camera topology example provided by the embodiments of the present application；

Fig. 6 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application；

Fig. 7 is the optional logic diagram of Focussing module provided by the embodiments of the present application；

Fig. 8 is the logic diagram of second of Image Acquisition control device provided by the embodiments of the present application；

Fig. 9 is the logic diagram of the third Image Acquisition control device provided by the embodiments of the present application.

It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear, And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with Just the understanding to the embodiment of the present application is helped to improve.

Specific embodiment

It is described in detail hereinafter in connection with exemplary embodiment of the attached drawing to the application.It rises for clarity and conciseness See, does not describe all features of actual implementation mode in the description.It should be understood, however, that developing any this reality Much decisions specific to embodiment must be made during embodiment, to realize the objectives of developer, example Such as, meet restrictive condition those of related to system and business, and these restrictive conditions may be with embodiment not It changes together.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from For those skilled in the art of present disclosure, this development is only routine task.

Here, also it should be noted is that, in order to avoid having obscured the application because of unnecessary details, in attached drawing and It is merely depicted in explanation with according to the closely related apparatus structure of the scheme of the application and/or processing step, and is omitted pair With the application relationship is little, expression and description of component known to persons of ordinary skill in the art and processing.

(identical label indicates identical element in several attached drawings) and embodiment with reference to the accompanying drawing, to the tool of the application Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.

It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous Suddenly, equipment or module etc., neither represent any particular technology meaning, also do not indicate the inevitable logical order between them.

Fig. 1 is a kind of flow chart of Image Acquisition control method provided by the embodiments of the present application.The embodiment of the present application provides The executing subject of Image Acquisition control method can be a certain Image Acquisition control device.Described image acquisition control device is set The standby form of expression is unrestricted, such as described image acquisition control device can be a certain independent component；Alternatively, described image is adopted Collection control device can be used as a certain functional module and be integrated in an imaging device, and the imaging device may include but be not limited to light field Camera includes the mobile phone of light-field camera, tablet computer etc., and the embodiment of the present application is not intended to limit this.It is specific as shown in Figure 1, A kind of Image Acquisition control method provided by the embodiments of the present application includes:

S101: according to the depth distribution of the field depth of light-field camera and scene, an at least depth for the scene is determined It is distributed sub-district, each depth distribution sub-district is located at except the field depth in an at least depth distribution sub-district.

S102: the focal length of the first sub-lens of adjustment, to reduce the object in the depth distribution sub-district in the first imaging area The average blur circle being imaged on domain, wherein first sub-lens is described in influences in the lenslet arrays of the light-field camera The sub-lens of depth distribution sub-district Image Acquisition, first imaging region are corresponding with first sub-lens in imaging surface Imaging region.

S103: the light-field camera after adjusted carries out Image Acquisition to the scene.

Object through such as light-field camera imaging device is imaged when, be ideally object plane and image planes be point with put one One is corresponding, but in actual application, due to the influence of the factors such as light wave property, aberration, the imaging of the point on object Beam generally can not converge at a bit, but the circular spread, ellipse or other similar rounds are formed on as plane Projection, referred to as blur circle (circle of confusion), alternatively referred to as figure of confusion, dispersion ring, circle of confusion, the circle of confusion, scattering Disk etc..If the size of blur circle is smaller, the imaging of the corresponding object of the usual blur circle is comparatively clear；Correspondingly, If the size of blur circle is more than certain permissible range, the imaging Relative Fuzzy of the corresponding object of the blur circle.

Light-field camera includes the main lens, lenslet arrays and imaging sensor set gradually along depth direction.The application In embodiment, at least one sub-lens is the lens of focus adjustable in the lenslet arrays, passes through the tune to the sub- focal length of lens Whole, changeable incident ray is successively imaged more on imaging region corresponding with the sub-lens after main lens and the sub-lens Circle is dissipated, the clarity that object is imaged on the imaging region is thus changed.

The lens of the focus adjustable have the characteristics that it is light, thin, convenient for being integrated into all kinds of mobile devices, be especially suitable for pair The more demanding wearable device such as thickness, weight (such as near-eye display device) is with a wide range of applications.The lens The phase of the light in lens can be changed by changing the characteristic of the material in lens, be achieved in adjust the lens etc. It imitates focal length (Focal Length).

Optionally, the lens of the focus adjustable can be liquid crystal lens, pass through the electric field or magnetic acted on liquid crystal lens The spatial distribution of liquid crystal molecule in liquid crystal lens can be changed in the outer field actions such as field, thus changes incident ray after liquid crystal lens Optical path, be equivalent to the adjustment of the focal length of lens.A kind of structure of optional liquid crystal lens is as shown in Figure 2 a and 2 b, comprising: on Under include a liquid crystal layer 205 between Liang Ge base (Substrates) 201 disposed in parallel, 202, Liang Ge base 201,202, often A base is respectively equipped with a control layer 203,204 close to the side of liquid crystal layer 205, by control layer 203,204 apply electric field and/ Or magnetic field, the electric field of application and/or magnetic field form the stable energy (Anchoring of non-uniform Distribution in liquid crystal layer 205 Energy), these energy may make the distribution of the polarization direction of the liquid crystal molecule of lens different piece to change, in this way, flat Row incident ray is emitted after lens different piece and forms different phase differences, is equivalent to the equivalent coke for having adjusted lens Away from.In actual application, non-homogeneous outfield can be applied by control layer, formed with the different piece in liquid crystal layer non-homogeneous The stable energy of distribution；Alternatively, can by control layer apply uniform external field (such as uniform electric field and/or magnetic field), then pass through but Be not limited to the stable energy that following at least one mode forms non-uniform Distribution in liquid crystal layer: control layer has non-uniform thickness The polarization layer of alignment layer (Alignment Layer) or the non-uniform thickness distribution of distribution；Optionally, the non-uniform thickness The alignment layer of distribution may include the material with light sensation characteristic, and the illumination of non-uniform Distribution can allow the different piece of alignment layer to connect Receive the stable energy intensity of non-uniform Distribution；Alternatively, optionally, the alignment layer can also be by polishing (Half-tone) Processing technique uses different materials in different regions, after applying outfield on alignment layer, can form differentiation distribution Stable energy；Etc..The non-uniform Distribution mode of the stable energy formed in lens is for example: stable energy is along lens centre portion Position is radioactive to be increased or reduced step by step to edge.Optionally, the lens of the focus adjustable can be first plane (metasurface) optical device.The member planar optical device is a kind of plane, ultra thin optical device, and target is to beat Dependence of the breaker front moulding (Wavefront shaping) to propagation effect, allows the phase (phase) of light wave, amplitude (amplitude) and/or polarization (polarization) characteristic is generated in very short distance and is mutated.The member planar optical device is logical It is often to be made of a series of miniature, anisotropy scatterers, the optic response of scatterer spatially forms otherness, for example, The member planar optical device can be but be not limited to silicon stake (silicon stump) lens, as shown in Figure 3a, the silicon stake lens Lens plane include honeycomb arrangement multiple pixels, each pixel is one nanometer of platform stake, and each nanometer of important actor include Pedestal (such as SiO₂Pedestal) and form amorphous crystal silicon (elliptical amorphous silicon on the base Post), the cross section of amorphous crystal silicon is generally elliptical.Each silicon stake is considered as optical waveguide structure, for same angle The incident light wave of degree, the different-diameter of the elliptic cross-section in silicon stake and towards bringing different effective refractive indexes, in general, As shown in Figure 3b, the angle angle of the direction of silicon stake and incident light wave is bigger, and the refraction for incident light wave is the change of phase It is bigger；For identical incident light wave, different refractive indexes, it is meant that different focal distances, such as: apart from silicon stake The light source of lens 600um, after the silicon stake for the different directions that diameter is 400um, model of the convergent point apart from silicon stake lens plane Enclosing (focusing distance) can be in 50um~500um.In practical application, single silicon stake or entire silicon stake lens are flat Face can change the phase of incident light wave by modes such as rotations, and rotate angle and preparatory to the corresponding relationship of the change of phase It is found that the phase difference of emergent light and incident light can accordingly therefore be changed by control silicon stake or the rotation angle of silicon stake lens, into And it is equivalent to the adjustment of the silicon stake focal length of lens.

It should be noted that the specific structure of the lens of the focus adjustable can be selected or be designed according to actual needs, it should Part is the prior art, and the above lens arrangement is only the alternative construction of sub-lens in light-field camera, be should not be construed as to the application The limitation of embodiment technical solution essence, that is to say, that those skilled in the art are optional on the basis of technical scheme Use the other lenses of focus adjustable as the sub-lens in lenslet arrays, the embodiment of the present application is not intended to limit this.

The embodiment of the present application is the depth of field model solved in light field image collection process using the adjustable characteristic of the focal length of lens The problem of enclosing extension, the specific structure of the adjustable lens of focusing are not intended to limit.

After the operations such as the adjustment of light-field camera aperture, focusing are completed, the field depth of the light-field camera is generally also therewith It determines, which is certain object distance range on depth direction with respect to light-field camera main lens.Pass through the one of light-field camera Secondary optically detecting, the blur circle size that the object imaging in field depth is located in scene is smaller, usually can blur-free imaging, and position Larger in the blur circle size of the object imaging outside field depth, imaging is typically more fuzzy.

According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens to formed by main lens As (such as real image or the virtual image) reimaging on the corresponding imaging region of the sub-lens, the pixel of different location on imaging region The field information that can store the object of different depth in scene, at least part corresponding to certain object in scene are saturating through a certain son The blur circle that mirror is imaged in certain pixel of imaging sensor are as follows:

In above formula: the equivalent diameter of c expression blur circle；F indicates the focal length of the sub-lens；V indicates at least office of the object Successively for imaging at a distance from the sub-lens center, which is equivalent to the sub-lens after main lens and the sub-lens in portion Image distance；v_nIndicate the distance between lenslet arrays plane and image sensor plane；N indicates f-number (f-number).Cause This, adjusts the focal length of sub-lens, can be changed incident ray through the sub-lens on imaging region corresponding with the sub-lens institute at Picture average blur circle, average blur circle after such as corresponding to sub-lens Focussing is less than the corresponding sub-lens Focussing The average blur circle of preceding focal length can improve the image quality of corresponding region as the condition of convergence of sub-lens Focussing.

As it can be seen that the embodiment of the present application can be according to the field depth of light-field camera and the depth distribution of scene, in the scene Region except the field depth determines that an at least depth distribution sub-district can fill for each depth distribution sub-district Divide the characteristic using sub-lens focus adjustable, by adjusting the sub-lens (i.e. first for influencing the depth distribution sub-district Image Acquisition Sub-lens) mode so that the object in the depth distribution sub-district in the light-field camera it is corresponding with the sub-lens at The size for the average blur circle being imaged on picture region (i.e. the first imaging region) is reduced, and the depth distribution sub-district is thus improved The image quality of interior object；And the sub-lens for influencing field depth Image Acquisition can be controlled without Focussing, to keep away Exempt to have an impact the image quality of the object in field depth.In this way, the light-field camera after corresponding sub-lens Focussing Carry out Image Acquisition, by way of an optically detecting, do not influence not only scene be located at field depth object at image quality Amount, can also improve the image quality of the object in at least depth distribution sub-district that scene is located at except the field depth, and one Determine to be equivalent in degree increased on the basis of original field depth obtained by optically detecting of light-field camera it is higher at The depth bounds of image quality amount improve the image quality of scene entirety.

Optionally, after the Focussing of first sub-lens, object in the depth distribution sub-district with it is described The average blur circle being imaged on corresponding first imaging region of first sub-lens is less than or equal to one and allows blur circle.If Blur circle allows blur circle (permissible circle of confusion) less than or equal to a certain, can be considered that object closes Coke imaging；Correspondingly, can be considered object imaging out of focus if blur circle, which is greater than this, allows blur circle.It is described to allow blur circle The factors such as size and object distance, enlargement ratio it is related, can predefine and allow blur circle size, such as described allow blur circle big Small is 1/30mm etc..The program is equivalent in sub-lens Focussing control process, will be flat after sub-lens Focussing Equal blur circle is less than or equal to the condition of convergence for allowing blur circle to control as the sub-lens Focussing, that is to say, that In sub-lens Focussing control process, if after sub-lens Focussing the average blur circle of corresponding imaging region be less than or Blur circle is allowed equal to described, then the Focussing control of the achievable sub-lens.As it can be seen that carrying out sub-lens using the program Focussing control, be equivalent to so that at least depth sub-district except the field depth of scene be adjusted to can blur-free imaging model It encloses, to a certain extent equivalent to increase the original field depth of light-field camera, improves the general image acquisition quality of scene, In some cases, or even be conducive to the Image Acquisition for carrying out panorama depth to scene, more preferably meet diversified practical application need It asks.

The method of determination and quantity of the depth distribution sub-district can determine according to actual needs, and implementation is very flexible. For example, at least partly depth areas in the scene in addition to field depth can be determined for institute according to the input information of user State an at least depth distribution sub-district；In another example in combination with light-field camera to the analysis of the preview image of the scene as a result, determining At least partly depth areas in the scene in addition to field depth is an at least depth distribution sub-district；For another example can Presupposed information in conjunction with light-field camera about depth distribution sub-district determines in the scene in addition to field depth at least partly Depth areas is an at least depth distribution sub-district；Etc..It is appreciated that at least partly depth areas determined is whole Body can be used as a depth distribution sub-district, alternatively, at least partly depth areas determined can also by certain condition into Row is divided to obtain multiple described depth distribution sub-districts, etc..The embodiment of the present application is not intended to limit above-mentioned specific implementation, Diversified practical application request can more preferably be met.

The depth bounds and quantity that the depth distribution sub-district includes can be in the depth except the field depth of the scene It is flexibly determined on direction, to meet diversified application demand.

Optionally, described at least at least one of depth distribution sub-district and the field depth depth consecutive variations, That is a boundary of at least one depth distribution sub-district in an at least depth distribution sub-district in the depth direction and One boundary of field depth be it is adjacent, as shown in Fig. 4 a or Fig. 4 b.The program is conducive to raising scene and is located at field depth The image quality of the object on periphery is equivalent to and is continuously extended in the depth direction to original field depth.Certain In application scenarios, microshot scene is carried out for example, by using large aperture, scene larger depth is help to obtain using the program and is connected The blur-free imaging of continuous range, in the case of scene depth narrow distribution, or even can realize the panorama depth Image Acquisition of large aperture.

Optionally, described at least at least one of depth distribution sub-district and the discontinuous variation of field depth depth, That is, each boundary of at least one depth distribution sub-district in an at least depth distribution sub-district in the depth direction and Each boundary of field depth be all it is non-conterminous, as shown in Fig. 4 b or Fig. 4 c.The program is conducive to raising scene and is located at depth of field model The image quality of at least partly object except enclosing is equivalent to adjusting again in the depth direction on the basis of original field depth The whole preferable depth sub-district of some image quality.In certain application scenarios, such as multiple objects are on the scene along depth direction distribution The different depth position (such as face) of scape, wherein certain an object is located in field depth, and other objects are located at field depth Except, be conducive to improve the image quality of multiple objects of different depth position in scene using the program.

In technical solution provided by the embodiments of the present application, incident light can be changed by outfield and pass through first sub-lens The phase difference of different piece, to adjust the focal length of first sub-lens.Wherein, the outfield can be according to the spy of the material of lens Property determine, such as the outfield may include but be not limited to electric field, magnetic field, light field.It, can when outer field action is on the first sub-lens The change for causing the material characteristic of the first sub-lens such as causes liquid crystal molecule polarization direction changes in distribution, the silicon of liquid crystal sub-lens The silicon stake of stake lens is towards change etc., so that incident light forms certain phase after the different piece of the first sub-lens Difference, since, there are certain corresponding relationship, the change of phase is equivalent to the adjustment of focal length between phase and focal length.As it can be seen that the party Case is without moving or tilting the first sub-lens in light-field camera, but it is burnt to make full use of the material characteristic of the first sub-lens to realize Away from adjustment, therefore be conducive to simplify system mechanics structure, can meet but be not limited to the integrated using need of the equipment such as light, thin, portable It asks.

Optionally, adjust the focal length of first sub-lens, comprising: according to the depth distribution of the depth distribution sub-district, First distance between the focal length of the main lens of the light-field camera, the main lens and the lenslet arrays and described Second distance between lenslet arrays and the imaging surface determines the expectation focal length of first sub-lens；According at least to institute The focal length of the first sub-lens described in desired Focussing is stated, to reduce the object in the depth distribution sub-district with described first The average blur circle being imaged on corresponding first imaging region of sub-lens.

The imaging formula of main lens is as follows:

In above formula (2): the object distance of U expression main lens；The image distance of V expression main lens；F indicates main lens focal length.

The imaging formula of first sub-lens:

In above formula (3): u indicates the object distance of the first sub-lens；V indicates the image distance of the first sub-lens；F indicates the first sub-lens Focal length.

The process for carrying out Image Acquisition through light-field camera includes Polaroid and object of the object through main lens through main saturating Secondary imaging of the mirror imaging through the first sub-lens re-imaging, therefore, the object distance of the image distance of main lens and the first sub-lens Between meet following formula:

V+u=L₁...........................................................(4)

In above formula (4): the image distance of V expression main lens；U indicates the object distance of the first sub-lens；L₁Indicate that main lens and son are saturating The distance between lens array (i.e. first distance) namely the distance between main lens and the first sub-lens.

When object is successively located at the first imaging region through main lens and the first sub-lens imaging, imaging it is clear Clear degree is high, i.e. the average blur circle of imaging is small, therefore, can be true by the distance between the first sub-lens and the first imaging region It is set to the image distance of first sub-lens:

V=L₂......................................................(5)

In above formula (5): v indicates the image distance of the first sub-lens；L₂Indicate between lenslet arrays and imaging sensor away from From (i.e. second distance) namely the distance between the first sub-lens and the first imaging region.

In conjunction with formula (2), (3), (4) and (5), the focal length f of the first sub-lens can be calculated, which is the first son The expectation focal length of lens.In actual application, the phase that light passes through the first sub-lens different piece can be changed by outer field action Position, so that equivalent focal length corresponding to phase difference with the first sub-lens different piece is as close possible to the even equal to described expectation Thus focal length reduces average blur circle of the object on first imaging region, improve first imaging region and acquired The clarity of the image arrived.

Wherein, according at least to the focal length of the first sub-lens described in the expectation Focussing can include: according at least to described It is expected that focal length determines that incident light is each passed through the phase difference formed after the first sub-lens different piece；According to phase difference and outside Mapping relations between determine outfield corresponding with the phase difference；Change incident light by the outfield and passes through described the The phase difference of the different piece of one sub-lens, to adjust the focal length of first sub-lens.The program is simply easily realized, is improved The control efficiency of first sub-lens Focussing.

It might as well illustrate to determine phase difference so that the first sub-lens is liquid crystal lens (hereinafter referred to as the first liquid crystal sub-lens) as an example Optional implementation.Optionally, described to determine that incident light is each passed through first son thoroughly according at least to the expectation focal length The phase difference formed after mirror different piece, comprising: according to the expectation focal length, the radius of the first liquid crystal sub-lens and institute The wavelength for stating incident light determines that the incident light is each passed through the phase formed after the different pieces of the first liquid crystal sub-lens Difference.The phase difference is determined using the program, scheme is simply easily realized.Optionally, it is following right to meet between focal length and phase difference It should be related to:

In above formula (6): f indicates the expectation focal length of the first liquid crystal sub-lens；R indicates the radius of the first liquid crystal sub-lens；Δ φ indicates that light passes through the phase difference of the first liquid crystal sub-lens different piece, as light is each passed through the central part of the first liquid crystal sub-lens Divide the phase difference with marginal portion；The wavelength of λ expression light.

After determining the corresponding phase difference of expectation focal length, due between phase difference and outfield there are certain corresponding relationship, Required outfield can be determined according to the corresponding relationship.Specifically, being directed to the structure of the first sub-lens, phase difference and electric field are (such as The voltage swing of uniform electric field, alternatively, the distribution etc. of inhomogeneous field) between mapping relations can obtain in advance, according to this Mapping relations, it may be determined that electric field corresponding to corresponding with the it is expected focal length phase difference in place passes through the electric field action the of determination later One sub-lens come change the first sub-lens material characteristic (as change the first sub-lens in liquid crystal molecule distribution, silicon stake lens Direction of interior silicon stake etc.) so that the phase difference that light passes through the first sub-lens different piece is true as close possible to even equal to institute Fixed phase difference, so that the equivalent focal length of the first sub-lens adjusted is burnt as close possible to the even equal to described expectation Away from.

Optionally, the focal length of first sub-lens is adjusted, comprising: determine first sub-lens allows Focussing Range；According at least to the focal length for allowing Focussing range to adjust first sub-lens, to reduce the depth distribution The average blur circle that object in sub-district is imaged on first imaging region corresponding with first sub-lens.Using this Scheme carries out the Focussing of first sub-lens, and the first sub-lens focal length adjusted, which is fallen into, described allows focal length tune Whole range.Wherein, it is described allow Focussing range that can be adjusted according to the focal length of lens after can bring accordingly averagely blur circle subtract It is flexibly determined under small requirement, the embodiment of the present application is not intended to limit this.The program is simply easily realized, the first sub-lens are improved The control efficiency of Focussing.

It is described to allow Focussing range that accordingly be averaged more according to that can bring after the first sub-lens Focussing It dissipates and is predefined under the reduced requirement of circle, determining method may include but be not limited to push away using laboratory facilities, analog simulation, formula It the modes such as leads to determine.Optionally it is determined that first sub-lens allow Focussing range, comprising: according to the depth point Between the focal length of the main lens of the depth distribution of cloth sub-district, the light-field camera, the main lens and the lenslet arrays Second distance between first distance and the lenslet arrays and the imaging surface determines the phase of first sub-lens Hope focal length；Focussing range is allowed according to what the expectation focal length determined first sub-lens.The expectation focal length is really The method of determining can refer to record above, special in combination with the material for considering the first sub-lens after the expectation focal length has been determined Property limitation, focus adjustment precision limitation, to object image quality require etc. factors, it would be desirable to focal length is in certain range of allowable error Interior angular range allows Focussing range described in being used as.Focussing range is allowed more using described in program determination Rationally, Focussing range is allowed to carry out the Focussings of the first sub-lens based on this, it is high-efficient and be easier to realize.

Optionally, described to be wrapped according at least to the focal length for allowing Focussing range to adjust first sub-lens It includes: allowing Focussing range to determine that incident light is each passed through the appearance formed after the first sub-lens different piece according to described Perhaps phase range；According to the mapping relations between phase difference and outfield, the determining and appearance allowed in phase range Perhaps the corresponding outfield of phase difference；Change the phase that incident light passes through the different piece of first sub-lens by the outfield Difference, to adjust the focal length of first sub-lens.The focal length allowed within the scope of Focussing is the focal length for allowing adjustment, when The first sub-lens focal length adjusted fall into it is described when allowing within the scope of Focussing, it is corresponding with first sub-lens The average blur circle of first imaging region institute acquired image is reduced, and the corresponding phase difference of each focal length, because This can determine it is described allow to allow phase range corresponding to Focussing range, determine this allow in phase range appoint Outfield corresponding to one phase difference, as the voltage input of the first sub-lens Focussing, thus to first sub-lens Focussing needed for realizing improves the convenience and flexibility of Focussing control.

It might as well illustrate to determine the appearance so that the first sub-lens is liquid crystal lens (hereinafter referred to as the first liquid crystal sub-lens) as an example Perhaps the optional implementation of phase range.Optionally, Focussing range is allowed to determine that incident light is each passed through according to described What is formed after the first sub-lens different piece allows phase range, comprising: is allowed within the scope of Focussing according to described Maximum allowable focal length, the radius of the first liquid crystal sub-lens and the wavelength of the incident light, determine the incidence respectively Light is each passed through the first phase difference formed after the different piece of the first liquid crystal sub-lens；Focussing is allowed according to described Minimum in range allows the wavelength of focal length, the radius of the first liquid crystal sub-lens and the incident light, determines institute respectively Stating incident light, to be each passed through the second phase formed after the different pieces of the first liquid crystal sub-lens poor；According to first phase Potential difference and the second phase difference allow phase range described in determining.It can get using the program and maximum described allow phase Poor range is conducive to the control efficiency and flexibility that improve Focussing.

Optionally, before the adjustment at least focal length of one first sub-lens, the method also includes: determine the light field The sub-lens that the depth distribution sub-district Image Acquisition is influenced in the lenslet arrays of camera are first sub-lens.Using this Scheme can be determined to influence the sub-lens conduct of the depth distribution sub-district Image Acquisition in the lenslet arrays of light-field camera First sub-lens, later by carrying out Focussing to first sub-lens, so that in the depth distribution sub-district The average blur circle that object is imaged on the first imaging region corresponding with first sub-lens in the image sensor is subtracted It is small, thus improve the image quality of the depth distribution sub-district.The image for influencing certain object in the depth distribution sub-district is adopted The sub-lens (i.e. described first sub-lens) of collection may be one or more, can carry out respectively to each of determining first sub-lens Focussing, and being averaged on the imaging area corresponding to corresponding first sub-lens by the object in the depth distribution sub-district Blur circle is reduced the condition of convergence as the control of sub-lens Focussing, thus improves the whole image quality of the object.

Still optionally further, determining influences the depth distribution sub-district image in the lenslet arrays of the light-field camera adopts The sub-lens of collection be first sub-lens, comprising: according to the light-field camera obtain the scene preview image in The corresponding part of the depth distribution sub-district determines that the sub-lens for influencing the depth distribution sub-district Image Acquisition are described first Sub-lens.A kind of optional implementation, in the light-field camera, as shown in figure 5, can be by Focussing, so that the son Each sub-lens that lens array includes keep identical focal length, and by the adjustment of depth direction so that imaging sensor with it is described The distance of lenslet arrays is equal to the focal length of sub-lens；In this way, the image based on the light-field camera acquisition a certain visual angle of scene is (such as The preview image) spatial resolution it is corresponding with the distribution of the sub-lens of the lenslet arrays, described in each sub-lens are corresponding The a certain imaging region of imaging sensor, each imaging region include the multiple pixels of array distribution, are recorded by the imaging region The sub-lens are to the light informations of the different directions in certain portion from the scene, that is, in the light-field camera, the preview graph There are corresponding relationships between the pixel distribution of picture and the distribution of the sub-lens of the lenslet arrays, therefore, can be according to the light Part corresponding with the depth distribution sub-district in the preview image for the scene that field camera obtains, determining influences the depth The sub-lens of sub-district Image Acquisition are distributed, determining sub-lens are first sub-lens.Being determined using the program influences institute The sub-lens of depth distribution sub-district Image Acquisition are stated, method is simply easily realized.

It will be understood by those skilled in the art that in any of the above-described method of the application specific embodiment, each step Serial number size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, and Any restriction should not be constituted to the implementation process of the application specific embodiment.

Fig. 6 is the logic diagram of the first Image Acquisition control device provided by the embodiments of the present application.As shown in fig. 6, this The first the Image Acquisition control device for applying for that embodiment provides includes: a depth distribution sub-district determining module 61, a focal length tune Mould preparation block 62 and an image capture module 63.

Depth distribution sub-district determining module 61 is used to be determined according to the field depth of light-field camera and the depth distribution of scene An at least depth distribution sub-district for the scene, each depth distribution sub-district is located at described in an at least depth distribution sub-district Except field depth.

Focussing module 62 is used to adjust the focal length of the first sub-lens, to reduce the object in the depth distribution sub-district The average blur circle being imaged on the first imaging region, wherein first sub-lens are the sub-lens battle array of the light-field camera Influence the sub-lens of the depth distribution sub-district Image Acquisition in column, first imaging region is in imaging surface with described first The corresponding imaging region of sub-lens.

Image capture module 63 carries out Image Acquisition to the scene for the light-field camera after adjusted.

The embodiment of the present application can be located at institute in the scene according to the field depth of light-field camera and the depth distribution of scene It states the region except field depth and determines that an at least depth distribution sub-district can make full use of for each depth distribution sub-district The characteristic of sub-lens focus adjustable, by adjusting the sub-lens (i.e. the first sub-lens) for influencing the depth distribution sub-district Image Acquisition Mode so that the imaging region corresponding with the sub-lens in the light-field camera of the object in the depth distribution sub-district The size for the average blur circle being imaged on (i.e. the first imaging region) is reduced, and pair in the depth distribution sub-district is thus improved The image quality of elephant；And the sub-lens for influencing field depth Image Acquisition can be controlled without Focussing, to avoid to scape The image quality of object in deep range has an impact.In this way, the light-field camera after corresponding sub-lens Focussing carries out figure As acquisition, by way of an optically detecting, does not influence the image quality that scene is located at the object of field depth not only, may be used also Improve the image quality that scene is located at the object in at least depth distribution sub-district except the field depth, to a certain extent It is equivalent on the basis of original field depth and increases obtained by optically detecting of light-field camera compared with high imaging quality Depth bounds improve the image quality of scene entirety.Further, since the embodiment of the present application makes full use of the material of the first sub-lens Matter characteristic realizes Focussing, and without the first sub-lens are moved or tilted in light-field camera, this is conducive to simplify System Computer Tool structure can meet but be not limited to the integrated application demand of the equipment such as light, thin, portable.

Optionally, after the Focussing of first sub-lens, object in the depth distribution sub-district with it is described The average blur circle being imaged on corresponding first imaging region of first sub-lens is less than or equal to one and allows blur circle.Using The program carries out the Focussing control of sub-lens, is equivalent at least depth sub-district tune so that except the field depth of scene It is whole for can the range of blur-free imaging improve scene to a certain extent equivalent to increase the original field depth of light-field camera General image acquisition quality, in some cases, or even be conducive to the Image Acquisition that panorama depth is carried out to scene, more preferable satisfaction Diversified practical application request.

Optionally, described at least at least one of depth distribution sub-district and the field depth depth consecutive variations.It adopts The blur-free imaging of scene larger depth successive range is help to obtain with the program, in the case of scene depth narrow distribution, It can even realize the panorama depth Image Acquisition of large aperture.

Optionally, described at least at least one of depth distribution sub-district and the discontinuous variation of field depth depth. Be conducive to improve the image quality of multiple objects of different depth position in scene using the program.

Optionally, as shown in fig. 7, the Focussing module 62 includes: one first Focussing submodule 621.First Focussing submodule 621 is used to change by outfield the phase difference that incident light passes through the different piece of first sub-lens, To adjust the focal length of first sub-lens.The program is filled without moving or tilting the first sub-lens in light-field camera Point Focussing is realized using the material characteristic of the first sub-lens, therefore be conducive to simplify system mechanics structure, can meet but not It is limited to the integrated application demand of the equipment such as light, thin, portable.

Optionally, the Focussing module 62 includes: that an expectation focal length determines submodule 622 and one second Focussing Submodule 623.It is expected that focal length determines submodule 622 for depth distribution, the light field phase according to the depth distribution sub-district First distance and the lenslet arrays between the focal length of the main lens of machine, the main lens and the lenslet arrays With the second distance between the imaging surface, the expectation focal length of first sub-lens is determined；Second Focussing submodule 623 For the focal length according at least to the first sub-lens described in the expectation Focussing, to reduce pair in the depth distribution sub-district As the average blur circle being imaged on first imaging region corresponding with first sub-lens.In actual application, The phase that light passes through the first sub-lens different piece can be changed by outer field action, so that the phase with the first sub-lens different piece Thus equivalent focal length corresponding to potential difference reduces object in first imaging as close possible to the even equal to described expectation focal length Average blur circle on region improves the clarity of the first imaging region institute acquired image.

Optionally, the second Focussing submodule 623 includes: a phase difference determination unit 6231, outfield determination Unit 6232 and a Focussing unit 6233.Phase difference determination unit 6231 is used to determine according at least to the expectation focal length It penetrates light and is each passed through the phase difference formed after the first sub-lens different piece；Outfield determination unit 6232 is used for according to phase Mapping relations between difference and outfield determine outfield corresponding with the phase difference；Focussing unit 6233 is for passing through institute It states outfield and changes the phase difference that incident light passes through the different piece of first sub-lens, to adjust the coke of first sub-lens Away from.The program is simply easily realized, the control efficiency of the first sub-lens Focussing is improved.

Optionally, first sub-lens are the first liquid crystal sub-lens；The phase difference determination unit 6231 includes: a phase Potential difference determines subelement 62311.Phase difference determines subelement 62311 for according to the expectation focal length, first liquid crystal The wavelength of the radius of lens and the incident light determines that the incident light is each passed through the difference of the first liquid crystal sub-lens The phase difference formed behind part.The phase difference is determined using the program, scheme is simply easily realized.

Optionally, the Focussing module 62 includes: to allow Focussing range determination submodule 624 and a third Focussing submodule 625.Focussing range determination submodule 624 is allowed to allow coke for determine first sub-lens Away from adjusting range；Third Focussing submodule 625 is used to allow Focussing range to adjust described first according at least to described The focal length of sub-lens, to reduce the object in the depth distribution sub-district corresponding the first one-tenth described with first sub-lens As the average blur circle being imaged on region.It is described allow Focussing range that can be adjusted according to the focal length of lens after can bring it is corresponding It is flexibly determined under the requirement that average blur circle reduces, the embodiment of the present application is not intended to limit this.The program is simply easily realized, is improved The control efficiency of first sub-lens Focussing.

It is optionally, described that allow Focussing range determination submodule 624 include: 6241 He of an expectation focal length determination unit One allows Focussing range determination unit 6242.It is expected that focal length determination unit 6241 is used for according to the depth distribution sub-district First distance between the focal length of the main lens of depth distribution, the light-field camera, the main lens and the lenslet arrays, And the second distance between the lenslet arrays and the imaging surface, determine the expectation focal length of first sub-lens；Hold Perhaps Focussing range determination unit 6242 is used to allow focal length tune according to what the expectation focal length determined first sub-lens Whole range.The program improves the accuracy that the expectation focal length determines.

Optionally, the third Focussing submodule 625 includes: to allow phase range unit 6251, an outfield Determination unit 6252 and a Focussing unit 6253.Allow phase range unit 6251 for allowing focal length tune according to Whole range determines that is formed after incident light is each passed through the first sub-lens different piece allows phase range；Outfield determines Unit 6252 is used for according to the mapping relations between phase difference and outfield, and determination is allowed with one allowed in phase range The corresponding outfield of phase difference；Focussing unit 6253, which is used to change incident light by the outfield, passes through first sub-lens Different piece phase difference, to adjust the focal length of first sub-lens.Focal length tune is allowed using described in program determination Whole range is relatively reasonable, allows Focussing range to carry out the Focussings of the first sub-lens based on this, high-efficient and be easier to reality It is existing.

Optionally, first sub-lens are the first liquid crystal sub-lens；It is described to allow the phase range unit 6251 to include: One first phase difference determines that subelement 62511, a second phase difference determine that subelement 62512 and one allows phase range to determine Subelement 62513.First phase difference determines that subelement 62511 is maximum allowable within the scope of Focussing for allowing according to The wavelength of focal length, the radius of the first liquid crystal sub-lens and the incident light determines that the incident light is each passed through respectively The first phase difference formed after the different piece of the first liquid crystal sub-lens；Second phase difference determines that subelement 62512 is used for Focal length, the radius of the first liquid crystal sub-lens and the incidence are allowed according to the minimum allowed within the scope of Focussing The wavelength of light determines that the incident light is each passed through the second phase formed after the different pieces of the first liquid crystal sub-lens respectively Potential difference；Phase range is allowed to determine subelement 62513 for being determined according to the first phase difference and the second phase difference It is described to allow phase range.Using the program can get it is maximum it is described allow phase range, be conducive to improve focal length tune Whole control efficiency and flexibility.

Optionally, as shown in figure 8, described device further include: a sub-lens determining module 64.Sub-lens determining module 64 is used The sub-lens that the depth distribution sub-district Image Acquisition is influenced in the lenslet arrays for determining the light-field camera are described the One sub-lens.It can determine that influencing the depth distribution sub-district image adopts in the lenslet arrays of light-field camera using the program The sub-lens of collection are as first sub-lens, later by carrying out Focussing to first sub-lens, so that the depth Object in degree distribution sub-district is imaged on the first imaging region corresponding with first sub-lens flat in the image sensor Equal blur circle is reduced, and the image quality of the depth distribution sub-district is thus improved.

Optionally, the sub-lens determining module 64 includes: that a sub-lens determine submodule 641.Sub-lens determine submodule Portion corresponding with the depth distribution sub-district in the preview image for the scene that block 641 is used to be obtained according to the light-field camera Point, determine that the sub-lens for influencing the depth distribution sub-district Image Acquisition are first sub-lens.Shadow is determined using the program The sub-lens of the depth distribution sub-district Image Acquisition are rung, method is simply easily realized.

Fig. 9 is the structural schematic diagram of the third Image Acquisition control device provided by the embodiments of the present application, and the application is specific Embodiment does not limit the specific implementation of Image Acquisition control device 900.As shown in figure 9, Image Acquisition control dress Setting 900 may include:

Processor (Processor) 910,920, memory communication interface (Communications Interface) (Memory) 930 and communication bus 940.Wherein:

Processor 910, communication interface 920 and memory 930 complete mutual communication by communication bus 940.

Communication interface 920, for being communicated with such as deformable imaging sensor etc..

Processor 910 can specifically execute the correlation step in any of the above-described embodiment of the method for executing program 932.

For example, program 932 may include program code, said program code includes computer operation instruction.

Processor 910 may be a central processing unit (Central Processing Unit, abbreviation CPU), either Specific integrated circuit (Application Specific Integrated Circuit, abbreviation ASIC), or be arranged to Implement one or more integrated circuits of the embodiment of the present application.

Memory 930, for storing program 932.Memory 930 may include random access memory (Random Access Memory, abbreviation RAM), it is also possible to it further include nonvolatile memory (Non-volatile memory), such as extremely A few magnetic disk storage.

For example, in an optional implementation manner, following steps can be performed by executing program 932 in processor 910: root According to the field depth of light-field camera and the depth distribution of scene, determine an at least depth distribution sub-district for the scene, it is described extremely Each depth distribution sub-district is located at except the field depth in a few depth distribution sub-district；The focal length of the first sub-lens is adjusted, To reduce the average blur circle that the object in the depth distribution sub-district is imaged on the first imaging region, wherein described first Sub-lens be the light-field camera lenslet arrays in influence the sub-lens of the depth distribution sub-district Image Acquisition, described the One imaging region is imaging region corresponding with first sub-lens in imaging surface；The light-field camera after adjusted is to institute It states scene and carries out Image Acquisition.In other optional implementations, processor 910 can also carry out by executing program 932 The step of other any embodiments refer to is stated, details are not described herein.

In program 932 specific implementation of each step may refer to corresponding steps in above-described embodiment, module, submodule, Corresponding description in unit, details are not described herein.It is apparent to those skilled in the art that for the convenience of description With it is succinct, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment Description, details are not described herein.

In the application the various embodiments described above, the serial number and/or sequencing of embodiment are merely convenient of description, do not represent reality Apply the superiority and inferiority of example.It all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to it The associated description of his embodiment.The associated description of implementation principle or process in relation to device, equipment or system embodiment, reference can be made to The record of correlation method embodiment, details are not described herein.

Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.

It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps. And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), arbitrary access The various media that can store program code such as memory (Random Access Memory, abbreviation RAM), magnetic or disk.

In the embodiments such as the device of the application, method, system, it is clear that each component (system, subsystem, module, submodule Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or again Combination nova should be regarded as the equivalent scheme of the application.Meanwhile in the description above to the application specific embodiment, for a kind of reality The feature that the mode of applying is described and/or shown can be made in one or more other embodiments in a manner of same or similar With, be combined with the feature in other embodiment, or substitution other embodiment in feature.

It should be emphasized that term "comprises/comprising" refers to the presence of feature, element, step or component when using herein, but simultaneously It is not excluded for the presence or additional of one or more other features, element, step or component.

Finally, it should be noted that embodiment of above is merely to illustrate the application, and it is not the limitation to the application, it is related The those of ordinary skill of technical field can also make a variety of changes in the case where not departing from spirit and scope And modification, therefore all equivalent technical solutions also belong to the scope of the application, the scope of patent protection of the application should be wanted by right Ask restriction.