patents.google.com

CN111866388B - Multiple exposure shooting method, equipment and computer readable storage medium - Google Patents

️Tue Jul 12 2022

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and a fixed terminal such as a Digital TV, a desktop computer, and the like.

The following description will be given by way of example of a mobile terminal, and it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal, in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, the

mobile terminal

100 may include: RF (Radio Frequency)

unit

101,

WiFi module

102,

audio output unit

103, a/V (audio/video)

input unit

104,

sensor

105,

display unit

106,

user input unit

107,

interface unit

108,

memory

109,

processor

110, and

power supply

111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile terminal in detail with reference to fig. 1:

the

radio frequency unit

101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the

processor

110; in addition, uplink data is transmitted to the base station. Typically,

radio frequency unit

101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the

radio frequency unit

101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the

WiFi module

102, and provides wireless broadband internet access for the user. Although fig. 1 shows the

WiFi module

102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The

audio output unit

103 may convert audio data received by the

radio frequency unit

101 or the

WiFi module

102 or stored in the

memory

109 into an audio signal and output as sound when the

mobile terminal

100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the

audio output unit

103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The

audio output unit

103 may include a speaker, a buzzer, and the like.

The a/

V input unit

104 is for receiving an audio or video signal. The a/

V input Unit

104 may include a Graphics Processing Unit (GPU) 1041 and a

microphone

1042, the

Graphics processor

1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the

display unit

106. The image frames processed by the

graphic processor

1041 may be stored in the memory 109 (or other storage medium) or transmitted via the

radio frequency unit

101 or the

WiFi module

102. The

microphone

1042 may receive sounds (audio data) via the

microphone

1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the

radio frequency unit

101 in case of a phone call mode. The

microphone

1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The

mobile terminal

100 also includes at least one

sensor

105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the

display panel

1061 according to the brightness of ambient light, and a proximity sensor that can turn off the

display panel

1061 and/or a backlight when the

mobile terminal

100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing gestures of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometers and taps), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, the description is omitted here.

The

display unit

106 is used to display information input by a user or information provided to the user. The

Display unit

106 may include a

Display panel

1061, and the

Display panel

1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The

user input unit

107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the

user input unit

107 may include a

touch panel

1071 and

other input devices

1072. The

touch panel

1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the

touch panel

1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The

touch panel

1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the

processor

110, and can receive and execute commands sent by the

processor

110. In addition, the

touch panel

1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the

touch panel

1071, the

user input unit

107 may include

other input devices

1072. In particular,

other input devices

1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

Further, the

touch panel

1071 may cover the

display panel

1061, and when the

touch panel

1071 detects a touch operation thereon or nearby, the

touch panel

1071 transmits the touch operation to the

processor

110 to determine the type of the touch event, and then the

processor

110 provides a corresponding visual output on the

display panel

1061 according to the type of the touch event. Although the

touch panel

1071 and the

display panel

1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the

touch panel

1071 and the

display panel

1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.

The

interface unit

108 serves as an interface through which at least one external device is connected to the

mobile terminal

100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The

interface unit

108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the

mobile terminal

100 or may be used to transmit data between the

mobile terminal

100 and external devices.

The

memory

109 may be used to store software programs as well as various data. The

memory

109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further,

memory

109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The

processor

110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the

memory

109 and calling data stored in the

memory

109, thereby performing overall monitoring of the mobile terminal.

Processor

110 may include one or more processing units; preferably, the

processor

110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the

processor

110.

The

mobile terminal

100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the

power supply

111 may be logically connected to the

processor

110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown in fig. 1, the

mobile terminal

100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an

IP service

204 of an operator, which are in communication connection in sequence.

Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and

other eNodeBs

2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the

EPC

203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032,

other MMEs

2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and Charging Rules Function) 2036, and the like. The MME2031 is a control node for processing signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

IP services

204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the hardware structure of the mobile terminal and the communication network system, the embodiments of the method of the invention are provided.

Example one

FIG. 3 is a flowchart illustrating a multi-exposure photographing method according to a first embodiment of the present invention. A multiple exposure shooting method, the method comprising:

s1, monitoring the background image and the main body image in the shooting preview image in real time;

s2, determining a first shooting component according to the first displacement and the first display state of the background image, and determining a second shooting component according to the second displacement and the second display state of the main body image;

s3, acquiring a background template to be synthesized through the first shooting component and/or the second shooting component, and acquiring a subject target to be synthesized through the first shooting component and/or the second shooting component;

and S4, fusing the main body target to the background template to generate a multiple exposure image.

In this embodiment, first, a background image and a subject image in a captured preview image are monitored in real time; then, determining a first shooting component according to the first displacement and the first display state of the background image, and determining a second shooting component according to the second displacement and the second display state of the main body image; then, a background template to be synthesized is obtained through the first shooting assembly and/or the second shooting assembly, and a subject target to be synthesized is obtained through the first shooting assembly and/or the second shooting assembly; and finally, fusing the main body target to the background template to generate a multiple exposure image.

Specifically, in this embodiment, first, the background image and the subject image in the captured preview image are monitored in real time, that is, the background image and the subject image to be fused in multiple exposures are determined, optionally, the multiple exposures may include one or more background images, and likewise, may also include one or more subject images. Optionally, in this embodiment, the number of the background images and/or the number of the subject images are determined according to the number of the shooting components of the terminal device, optionally, the shooting components of the background images and the shooting components of the subject images are determined according to the position area where the shooting components of the terminal device are located, and optionally, the shooting components and the number of the subject images and the shooting components and the number of the background images are determined according to the position area where the shooting components of the terminal device are located and the number of each position area.

Specifically, in this embodiment, a first photographing component is determined according to a first displacement and a first display state of the background image, and a second photographing component is determined according to a second displacement and a second display state of the subject image. The displacement determination of the background image takes the overall displacement of the background (i.e., the rectangular area of the background) as a reference, and the displacement determination of the subject image takes the displacement of the geometric center of the subject as a reference. Optionally, in this embodiment, the first display state of the background image includes a shooting preview display state of the background image, and the second display state of the subject image includes a shooting preview display state of the subject image, where in this embodiment, the shooting preview display state refers to a reference image acquired by a preset shooting component, and is used as a switching reference of a subsequent shooting component.

Specifically, in this embodiment, the background template to be synthesized is acquired by the first photographing component and/or the second photographing component, and the subject target to be synthesized is acquired by the first photographing component and/or the second photographing component. The method comprises the steps of acquiring a reference image through a preset shooting assembly, determining a first shooting assembly matched with a background image as a switching reference of a subsequent shooting assembly, and determining a second shooting assembly matched with a main body image. Optionally, the background template to be synthesized is acquired by the first photographing assembly and/or the second photographing assembly step by step or synchronously, and the subject target to be synthesized is acquired by the first photographing assembly and/or the second photographing assembly. Wherein one or more background templates are obtained, and likewise, one or more subject targets, optionally associating one or more of the plurality of background templates with one or more subject targets.

Specifically, in this embodiment, the subject target is fused to the background template to generate a multiple exposure image. Similarly, as described in the above example, one or more background templates are obtained, and similarly, one or more subject targets are obtained, and optionally, one or more of the plurality of background templates are fused with one or more subject targets according to the association relationship, so as to obtain a multiple exposure image.

The method has the advantages that the background image and the main body image in the preview image are shot through real-time monitoring; then, determining a first shooting assembly according to the first displacement and the first display state of the background image, and determining a second shooting assembly according to the second displacement and the second display state of the main body image; then, acquiring a background template to be synthesized through the first shooting component and/or the second shooting component, and acquiring a subject target to be synthesized through the first shooting component and/or the second shooting component; and finally, fusing the main body target to the background template to generate a multiple exposure image. The humanized multiple exposure shooting scheme is realized, the user setting step and the post processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

Example two

Fig. 4 is a flowchart of a second embodiment of the multiple exposure shooting method according to the present invention, based on the above embodiment, the real-time monitoring shooting of the background image and the subject image in the preview image includes:

s11, recognizing the background image and the subject image in the shooting preview image;

and S12, determining a first initial image and a first termination image of the background image and determining a second initial image and a second termination image of the subject image in a shooting period.

In the present embodiment, first, the background image and the subject image are recognized in the photographic preview image; then, in one shooting period, a first initial image and a first end image of the background image are determined, and simultaneously, a second initial image and a second end image of the subject image are determined.

Alternatively, one photographing period of the present embodiment may be regarded as a detection period of photographing a preview, in which the corresponding amount of displacement is determined by the image difference value of the initial image and the final image.

The present embodiment has an advantageous effect in that the background image and the subject image are recognized in the photographed preview image; then, in one shooting period, a first initial image and a first end image of the background image are determined, and simultaneously, a second initial image and a second end image of the subject image are determined. The humanized multiple exposure shooting scheme is realized, a shooting basis and an image basis are provided for the image fusion of subsequent multiple exposure, the user setting step and the post-processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

EXAMPLE III

Fig. 5 is a flowchart of a multiple exposure shooting method according to a third embodiment of the present invention, and based on the above embodiment, the determining a first shooting component according to a first displacement and a first display state of the background image, and determining a second shooting component according to a second displacement and a second display state of the subject image, includes:

s21, determining the first displacement and the first display state according to the first initial image and the first termination image;

s22, determining the second displacement and the second display state according to the second initial image and the second termination image.

In the present embodiment, first, the first displacement and the first display state are determined from the first initial image and the first termination image; then, the second displacement and the second display state are determined from the second initial image and the second termination image.

Optionally, determining a corresponding displacement amount according to an image difference value of the initial image and the termination image, and determining a corresponding background displacement and a corresponding main body displacement according to the displacement amount;

optionally, the second displacement and the second display state are determined according to the second initial image and the second termination image, and the second displacement and the second display state are determined according to the second initial image and the second termination image, where the display state refers to a reference image acquired by a preset shooting component and is used as a switching reference of a subsequent shooting component, that is, reference images corresponding to a background and a subject are acquired respectively, so as to provide a determination basis for selecting a camera of the subsequent background and the subject.

The present embodiment has the beneficial effects that the first displacement and the first display state are determined by the first initial image and the first termination image; then, the second displacement and the second display state are determined from the second initial image and the second end image. The humanized multiple exposure shooting scheme is realized, a shooting basis and an image basis are provided for the image fusion of subsequent multiple exposure, the user setting step and the post-processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

Example four

Fig. 6 is a flowchart of a fourth embodiment of a multiple exposure shooting method according to the present invention, based on the above embodiment, where the determining a first shooting component according to a first displacement and a first display state of the background image and the determining a second shooting component according to a second displacement and a second display state of the subject image further includes:

s23, analyzing the first display state to obtain a first shooting parameter of the background, determining whether the current shooting component meets the shooting requirement or not according to the first shooting parameter, and if not, switching to a first shooting component matched with the shooting requirement to carry out background shooting;

and S24, analyzing the second display state to obtain a second shooting parameter of the main body, determining whether the current shooting component meets the shooting requirement according to the second shooting parameter, and if not, switching to a second shooting component matched with the shooting requirement to shoot the main body.

In this embodiment, first, the first display state is analyzed to obtain a first shooting parameter of the background, and whether a current shooting component meets shooting requirements is determined according to the first shooting parameter, and if not, the current shooting component is switched to a first shooting component adapted to the shooting requirements to shoot the background; and then, analyzing the second display state to obtain a second shooting parameter of the main body, determining whether the current shooting component meets the shooting requirement according to the second shooting parameter, and if not, switching to a second shooting component matched with the shooting requirement to shoot the main body.

Optionally, determining a camera type and a camera position related to a background according to the first shooting parameter, specifically, first, determining the camera type related to the background according to the first shooting parameter, then, determining whether the camera of the type is provided in the current shooting orientation, if not, switching the shooting orientation, and meanwhile, prompting a user to adjust a holding posture of the terminal device; similarly, for the second shooting parameter, the camera type and the camera position related to the main body are determined, specifically, the camera type related to the main body is determined according to the second shooting parameter, then, whether the camera of the type is provided in the current shooting direction is determined, if not, the shooting direction is switched, and meanwhile, the user is reminded to adjust the holding posture of the terminal device.

The method has the advantages that the first shooting parameter of the background is obtained by analyzing the first display state, whether the current shooting component meets the shooting requirement or not is determined according to the first shooting parameter, and if not, the current shooting component is switched to the first shooting component matched with the shooting requirement to shoot the background; and then, analyzing the second display state to obtain a second shooting parameter of the main body, determining whether the current shooting component meets the shooting requirement according to the second shooting parameter, and if not, switching to a second shooting component matched with the shooting requirement to shoot the main body. The humanized multiple exposure shooting scheme is realized, a shooting basis and an image basis are provided for the image fusion of subsequent multiple exposure, the user setting step and the post-processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

EXAMPLE five

Fig. 7 is a flowchart of a fifth embodiment of the multiple exposure shooting method according to the present invention, and based on the above embodiment, the acquiring a background template to be synthesized by the first shooting component and/or the second shooting component, and acquiring a subject target to be synthesized by the first shooting component and/or the second shooting component, includes:

s31, determining a switching mechanism of the first shooting assembly and/or the second shooting assembly, and determining the corresponding shooting quantity of the background template and the shooting quantity of the subject target according to the switching mechanism;

and S32, acquiring one or more images to be synthesized of the background template and the target body according to the transition special effect corresponding to the switching mechanism.

In this embodiment, first, a switching mechanism of the first shooting component and/or the second shooting component is determined, and a corresponding background template shooting number and a corresponding subject target shooting number are determined according to the switching mechanism; and then, acquiring one or more background templates and images to be synthesized of the target main body according to the transition special effect corresponding to the switching mechanism.

Optionally, in a basic embodiment, the front and rear cameras of the terminal device take pictures simultaneously, the two pictures are taken at a time, and then the two pictures are overlapped to synthesize a multiple exposure picture, wherein the picture taken by the front camera is set to be transparent at 50% and is overlapped on the picture taken by the rear camera; or, the cutout superposition is adopted, namely, the front portrait is cutout and superposed on the post-shot picture; or, the silhouette superposition is adopted, namely, the front portrait is extracted, the opaque pixel value is set to be black (# FF000000), and then the silhouette superposition is superposed on the picture shot in the back photography. In another basic embodiment, two or more shots of a front shot and a back shot are taken simultaneously, and finally a multiple exposure picture is synthesized, for example, the first shot, the front shot and the back shot are taken simultaneously to obtain two pictures, the second shot, the front shot and the back shot are taken simultaneously to obtain two pictures, the two pictures are also obtained, then the pictures taken by the back shot are overlapped according to 50% transparency, and the two pictures taken by the front shot are scratched and then overlapped. Similarly, as described in the above example, a plurality of silhouettes may be superimposed.

The method has the advantages that the corresponding background template shooting quantity and the corresponding main body target shooting quantity are determined according to the switching mechanism by determining the switching mechanism of the first shooting assembly and/or the second shooting assembly; and then, acquiring one or more background templates and images to be synthesized of the target main body according to the transition special effect corresponding to the switching mechanism. The humanized multiple exposure shooting scheme is realized, the user setting step and the post processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

Example six

Based on the above embodiment, the present invention further provides a multiple exposure shooting apparatus, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the computer program, when executed by the processor, implements:

monitoring a background image and a main image in the shot preview image in real time;

determining a first shooting component according to the first displacement and the first display state of the background image, and determining a second shooting component according to the second displacement and the second display state of the main body image;

acquiring a background template to be synthesized through the first shooting assembly and/or the second shooting assembly, and acquiring a subject target to be synthesized through the first shooting assembly and/or the second shooting assembly;

and fusing the main body target to the background template to generate a multiple exposure image.

In the present embodiment, first, the background image and the subject image in the captured preview image are monitored in real time; then, determining a first shooting component according to the first displacement and the first display state of the background image, and determining a second shooting component according to the second displacement and the second display state of the main body image; then, acquiring a background template to be synthesized through the first shooting component and/or the second shooting component, and acquiring a subject target to be synthesized through the first shooting component and/or the second shooting component; and finally, fusing the main body target to the background template to generate a multiple exposure image.

Specifically, in this embodiment, first, the background image and the subject image in the captured preview image are monitored in real time, that is, the background image and the subject image to be fused in multiple exposures are determined, and optionally, the multiple exposures may include one or more background images and, similarly, may also include one or more subject images. Optionally, in this embodiment, the number of the background images and/or the number of the subject images are determined according to the number of the shooting components of the terminal device, optionally, the shooting components of the background images and the shooting components of the subject images are determined according to the location areas where the shooting components of the terminal device are located, and optionally, the shooting components and the number of the subject images and the shooting components and the number of the background images are determined according to the location areas where the shooting components of the terminal device are located and the number of the location areas.

Specifically, in this embodiment, a first photographing component is determined according to a first displacement and a first display state of the background image, and a second photographing component is determined according to a second displacement and a second display state of the subject image. The displacement of the background image is determined by taking the overall displacement of the background (i.e., the rectangular area of the background) as a reference, and the displacement of the subject image is determined by taking the displacement of the geometric center of the subject as a reference. Optionally, in this embodiment, the first display state of the background image includes a shooting preview display state of the background image, and the second display state of the subject image includes a shooting preview display state of the subject image, where in this embodiment, the shooting preview display state refers to a reference image acquired by a preset shooting component, and is used as a switching reference of a subsequent shooting component.

The method has the advantages that the background image and the main body image in the preview image are shot through real-time monitoring; then, determining a first shooting component according to the first displacement and the first display state of the background image, and determining a second shooting component according to the second displacement and the second display state of the main body image; then, acquiring a background template to be synthesized through the first shooting component and/or the second shooting component, and acquiring a subject target to be synthesized through the first shooting component and/or the second shooting component; and finally, fusing the main body target to the background template to generate a multiple exposure image. The humanized multiple exposure shooting scheme is realized, the user setting step and the post processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

EXAMPLE seven

Based on the above embodiments, the computer program when executed by the processor implements:

identifying the background image and the subject image in the photographed preview image;

in one shooting cycle, a first initial image and a first termination image of the background image are determined, and simultaneously, a second initial image and a second termination image of the subject image are determined.

Alternatively, one photographing period of the present embodiment may be regarded as a detection period for photographing a preview, in which the corresponding amount of displacement is determined by the image difference value of the initial image and the final image.

The embodiment has the advantages that the background image and the main body image are identified in the shooting preview image; then, in one shooting period, a first initial image and a first end image of the background image are determined, and simultaneously, a second initial image and a second end image of the subject image are determined. The humanized multiple exposure shooting scheme is realized, a shooting basis and an image basis are provided for the image fusion of subsequent multiple exposure, the user setting step and the post-processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

Example eight

Based on the above embodiments, the computer program when executed by the processor implements:

determining the first displacement and the first display state from the first initial image and the first termination image;

determining the second displacement and the second display state from the second initial image and a second end image.

Optionally, determining a corresponding displacement amount according to an image difference value of the initial image and the termination image, and determining a corresponding background displacement and a corresponding body displacement according to the displacement amount;

Example nine

Based on the above embodiments, the computer program when executed by the processor implements:

analyzing the first display state to obtain a first shooting parameter of the background, determining whether a current shooting component meets shooting requirements or not according to the first shooting parameter, and if not, switching to a first shooting component matched with the shooting requirements to carry out background shooting;

analyzing the second display state to obtain a second shooting parameter of the main body, determining whether the current shooting component meets the shooting requirement or not according to the second shooting parameter, and if not, switching to a second shooting component matched with the shooting requirement to shoot the main body;

determining a switching mechanism of the first shooting assembly and/or the second shooting assembly, and determining the corresponding shooting quantity of the background template and the shooting quantity of the subject target according to the switching mechanism;

and acquiring one or more images to be synthesized of the background template and the target main body according to a transition special effect corresponding to the switching mechanism.

In this embodiment, first, the first display state is analyzed to obtain a first shooting parameter of the background, whether a current shooting component meets shooting requirements is determined according to the first shooting parameter, and if not, the current shooting component is switched to a first shooting component matched with the shooting requirements to perform background shooting; and then, analyzing the second display state to obtain a second shooting parameter of the main body, determining whether the current shooting component meets the shooting requirement according to the second shooting parameter, and if not, switching to a second shooting component matched with the shooting requirement to shoot the main body.

Optionally, determining a camera type and a camera position related to a background according to the first shooting parameter, specifically, first, determining the camera type related to the background according to the first shooting parameter, then, determining whether the camera of the type is provided in the current shooting orientation, if not, switching the shooting orientation, and meanwhile, prompting a user to adjust a holding posture of the terminal device; similarly, for the second shooting parameter, the camera type and the camera position related to the main body are determined, specifically, the camera type related to the main body is determined according to the second shooting parameter, then, whether the camera of the type is provided in the shooting direction in the current state is determined, if not, the shooting direction is switched, and meanwhile, the user is reminded to adjust the holding posture of the terminal device.

In another optional embodiment, first, a switching mechanism of the first shooting component and/or the second shooting component is determined, and the corresponding background template shooting number and the corresponding subject target shooting number are determined according to the switching mechanism; and then, acquiring one or more background templates and images to be synthesized of the target main body according to the transition special effect corresponding to the switching mechanism.

Example ten

Based on the above embodiment, the present invention also provides a computer readable storage medium, which stores thereon a multiple exposure shooting program, the multiple exposure shooting program, when executed by a processor, implementing the steps of the multiple exposure shooting method as described in any one of the above.

The multiple exposure shooting method, the equipment and the computer readable storage medium of the invention are implemented by monitoring the background image and the main image in the shooting preview image in real time; then, determining a first shooting component according to the first displacement and the first display state of the background image, and determining a second shooting component according to the second displacement and the second display state of the main body image; then, acquiring a background template to be synthesized through the first shooting component and/or the second shooting component, and acquiring a subject target to be synthesized through the first shooting component and/or the second shooting component; and finally, fusing the main body target to the background template to generate a multiple exposure image. The humanized multiple exposure shooting scheme is realized, the user setting step and the post processing step are simplified, the utilization rate of multiple cameras is improved, the multiple exposure shooting effect is enriched, and the user experience is enhanced.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.