CN111585865A - Data processing method, data processing device, computer readable storage medium and computer equipment - Google Patents

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

In one embodiment, as shown in FIG. 2, a data processing method is provided. The embodiment is mainly illustrated by applying the method to the terminal 110 in fig. 1. Referring to fig. 2, the data processing method specifically includes the following steps:

Wherein a session is an interactive process between at least one session object and other session objects. The session may be a two-party session or a multi-party session such as a group session. The session may be a real-time communication session or an instant communication session. In the real-time communication session, both session objects are kept connected, and may be, for example, a real-time video chat session or a real-time voice chat session. In the instant messaging session, the two parties of the session object do not keep connection, and for example, a session or the like for transmitting voice information or text information to the two parties of the session object may be used.

The conversation interface is an interface for displaying conversation messages, the conversation messages are information of a conversation object collected during conversation, and the conversation information may include at least one of text information, voice information and video information sent by the conversation object. The session object may be any session object in the session process.

Multimedia files include, but are not limited to, video, audio, movies, images, and the like. The terminal can run the session communication application, and receive and display the multimedia file through a session interface corresponding to the session communication application. And the presentation request is a request for requesting presentation of the target multimedia file. In the session process, the two parties of the session object send at least one multimedia file in the session interface, and a target multimedia file can be selected from the at least one multimedia file. The method for selecting the target multimedia file from the at least one multimedia file can be customized, and the customization can be that the multimedia file of interest is used as the target multimedia file from the at least one multimedia file, or the unread video is used as the target multimedia file from the at least one multimedia file, and the like. Further, after a target multimedia file is determined in at least one multimedia file displayed on the session interface, the target multimedia file is clicked to trigger and generate a display request. Or, performing voice control operation on the target multimedia file to trigger generation of a display request and the like. Or a related multimedia file playing button is arranged in the session interface, and a display request is generated by triggering the multimedia file playing button arranged on the session interface.

As shown in fig. 2A, fig. 2A illustrates an interface schematic diagram of a session interface in one embodiment, where the session interface illustrated in fig. 2A is a session interface corresponding to an instant messaging session, and in the session interface, both parties of a session object send text information, a plurality of multimedia files, and the like. The terminal user can select a target multimedia file from the multiple multimedia files displayed on the session interface, and click operation is performed on the target multimedia file to trigger generation of a display request. Or, the terminal user can display a multimedia file playing button below the session interface to perform click operation to trigger generation of the display request.

And step 204, playing the target multimedia file as the background of the session according to the display request.

The session refers to an interactive process between at least one session object and other session objects. The session may be a two-party session or a multi-party session such as a group session. The session may be a real-time communication session or an instant communication session. In order to improve the interest and experience of the end user, the background of the session, that is, the session background of the session interface, can be set.

The background refers to an element which sets off a main object, the background which takes the target multimedia file as the session refers to other contents which are filled in the session interface by the target multimedia file so as to set off the display of the session interface, and the filling of the target multimedia file in the session interface does not need to additionally open other windows, wherein the other contents comprise session messages, red packets, videos and the like which are displayed on the session interface. For example, a first multimedia file message and a first text message sent by a session object to a terminal user are displayed on a session interface, the terminal user generates a display request by operating and triggering the first multimedia file message, once the display request is generated by triggering, the session interface is filled with multimedia content corresponding to the played first multimedia file message as a foreground, and the first text message is displayed on a playing interface of the multimedia file.

Specifically, after receiving a display request for a target multimedia file in a session interface, the target multimedia file is played according to the display request, and the played target multimedia file is set as a background of the session. In one embodiment, in the session communication application, a message processing layer, a video playing layer and a background processing layer are preset, the message processing layer is used for receiving and displaying session messages corresponding to a session, the background processing layer is used for displaying a default session background corresponding to the session, and the video playing layer is used for playing and displaying a target multimedia file. Once a display request for the target multimedia file is received in the session interface, the target multimedia file is played and displayed through a video playing layer between the message processing layer and the background processing layer, and the display session message is received and displayed through the message processing layer. In this way, the session message can be displayed on the playing interface of the played target multimedia file, that is, the target multimedia file being played is displayed as the background of the session message.

As shown in FIG. 2B, FIG. 2B is an interface diagram illustrating a session interface background setup step in one embodiment. The video displayed in fig. 2B is a target multimedia file, and specifically, the target multimedia file is played according to the presentation request, and then the played target multimedia file is used as the background of the session. Namely, the played target multimedia file is used as a session background in the session interface, and the session message corresponding to the session is displayed on the played target multimedia file.

The session message refers to information of a session object collected during a session, for example, the session information may include at least one of voice information and video information sent by the session object. The session object may be any session object in the session process. Specifically, the terminal can send the display request to the server while playing the target multimedia file according to the display request, the server can obtain the corresponding session message according to the session identifier in the display request and return the session message to the terminal, and after receiving the session message corresponding to the session, the terminal displays the obtained session message corresponding to the session on a playing interface where the target multimedia file is being played. Wherein the session messages of the session include, but are not limited to, text information, voice information, and video information.

And step 208, displaying the session message on the playing interface of the target multimedia file.

Specifically, after the terminal acquires the session message corresponding to the session, since the target multimedia file is already played according to the display request and then the played target multimedia file is set as the background of the session, the acquired session message is displayed on the playing interface of the target multimedia file after the terminal acquires the session message corresponding to the session. Specifically, as shown in fig. 2B, the interface displayed in fig. 2B is an interface in which the target multimedia file is playing, and the session message displayed on the playing interface of the target multimedia file is a session message, which includes session messages sent by all session objects in the session, such as text messages, video messages, and voice messages.

The data processing method comprises the steps of receiving a display request for a target multimedia file in a session interface through a terminal; and playing the target multimedia file as the background of the session according to the display request, so that the multimedia file can be played for the target multimedia file through the display request, the target multimedia file is used as the background of the session, and meanwhile, in the process of playing the target multimedia file, the session message corresponding to the session is acquired, and the session message is displayed on the playing interface of the target multimedia file. The method and the device can not only quickly browse the content of the played multimedia file, but also browse the chat session message, synchronously realize the watching and the session communication of the multimedia file, and improve the convenience of the session communication.

In one embodiment, as shown in fig. 3, before receiving a presentation request for a target multimedia file in a session interface, the method further includes:

The session object herein means that other session objects except the local terminal user are session objects in the session process, for example, in an instant messaging application, the terminal user may interact with at least one session object through the instant messaging application, and in the session process, other session users except the terminal user may be session objects.

The first multimedia file refers to multimedia, including but not limited to images, videos, audios, videos, and the like, which is sent by the session object to the end user during the session. In particular, at least one session object is conversing with an end user through a session communication application, wherein the session communication application includes, but is not limited to, an instant communication session application or a real-time communication session application. The session object can send the first multimedia file to the terminal user through the session communication application, and the terminal user receives the first multimedia file sent by the session object in the session interface and displays the multimedia file thumbnail corresponding to the first multimedia file in the session interface. The multimedia file thumbnail refers to a small image processed by a compressed mode of video in a session interface.

As shown in fig. 3A, fig. 3A illustrates an interface schematic diagram of a session interface in an embodiment, where the interface illustrated in fig. 3A is a session interface, objects in a session include a terminal user and a session object, and the session interface displays session messages, such as text messages, voice messages, video messages, and the like, between the terminal user and the session object. The session object sends a first multimedia file to the terminal user, and the terminal receives the first multimedia file sent by the session object and displays a multimedia file thumbnail corresponding to the first multimedia file in the session interface, for example, displays the multimedia file thumbnail corresponding to the first multimedia file sent by the session object on the left side of the session interface in fig. 3A.

And step 304, acquiring a multimedia file sending instruction, sending the second multimedia file to the session object according to the multimedia file sending instruction, and displaying a multimedia file thumbnail corresponding to the second multimedia file in the session interface.

The second multimedia file is multimedia data sent by the terminal user to the session object, and may be a certain multimedia file selected by the terminal user from the local multimedia files as the second multimedia file, or a multimedia file collected by the terminal user in real time through a shooting device of the session interface as the second multimedia file, and the like.

Specifically, the terminal acquires the second multimedia file from the local or acquires the second multimedia file in real time through a shooting device, and then generates a multimedia file sending instruction through triggering a related sending control arranged on a session interface or generates a multimedia file sending instruction through voice control operation triggering, once the multimedia file sending instruction is generated through triggering, the acquired second multimedia file is sent to the session object according to the multimedia file sending instruction, and meanwhile, a multimedia file thumbnail corresponding to the second multimedia file is displayed in the session interface.

As shown in fig. 3A, the left side of the session interface shown in fig. 3A is a multimedia file thumbnail corresponding to a first multimedia file sent by the session object to the end user, and the right side displays a multimedia file thumbnail corresponding to a second multimedia file sent by the end user to the session object. Further, the terminal user can trigger the generation of the display request by clicking the multimedia file thumbnail corresponding to the first multimedia file and the multimedia file thumbnail corresponding to the second multimedia file on the session interface.

In one embodiment, in the embodiment shown in fig. 3, receiving a presentation request for a target multimedia file in a session interface includes: a presentation request for the first multimedia file and/or the second multimedia file is received in the session interface.

Specifically, in the embodiment shown in fig. 3, a multimedia file thumbnail corresponding to a first multimedia file and a multimedia file thumbnail corresponding to a second multimedia file are displayed on the session interface, and a display request may be generated by operating and triggering the first multimedia file and/or the second multimedia file. Specifically, the display request may be generated by performing a click operation on a multimedia file thumbnail corresponding to the first multimedia file and/or a multimedia file thumbnail corresponding to the second multimedia file, or may be generated by performing a voice control operation on the first multimedia file and/or the second multimedia file. Or the generation of the presentation request can be triggered by a related multimedia file playing button arranged on the session interface. As shown in fig. 3A, a click operation on a multimedia file play button in an operation bar below the session interface shown in fig. 3A may trigger generation of a presentation request for the first multimedia file and/or the second multimedia file. Or, a multimedia file thumbnail corresponding to the first multimedia file or a multimedia file thumbnail corresponding to the second multimedia file in the session interface of fig. 3A is clicked to trigger generation of a display request.

In an embodiment, as shown in fig. 4, in the process of playing the target multimedia file, acquiring a session message corresponding to the session, and displaying the session message on the playing interface of the target multimedia file includes:

The session information refers to information of a session object collected during a session, and for example, the session information may include at least one of text information, voice information, and video information sent by the session object. The first session message refers to a session message sent by the session object to the end user, and may be text information, voice information, video information, or the like. Specifically, since the played target multimedia file is already used as the background of the session, during the playing of the target multimedia file, the server may send the first session message sent by the session object to the terminal, and the terminal displays the first session message sent by the session object in the session interface. As shown in fig. 3A, the session interface shown in fig. 3A includes a first session message sent by the session object, and is specifically displayed on the left side of the session interface of fig. 3A, that is, the thumbnail of the multimedia file, the text message, and the voice message displayed on the left side of the session interface of fig. 3A are all the first session messages sent by the session object to the end user.

The message sending instruction is an instruction for sending a session message, where the message sending instruction is an instruction for sending a second session message to a session object by an end user. The specific terminal user can trigger a related sending control set on the session interface to generate a message sending instruction, or the terminal user triggers the generation of the message sending instruction through voice control operation on the session interface, and the like. Once the terminal user triggers and generates a message sending instruction on the session interface, the terminal sends a second session message to the session object according to the message sending instruction after obtaining the message sending instruction. The second session message is a session message sent by the end user to the session object, and may be a text message, a voice message, a video message, and the like. The second session message may specifically be the session editing instruction obtained by the terminal, and the second session message is obtained according to the session editing instruction, or may also be the session forwarding instruction obtained by the terminal, and the second session message is obtained according to the session forwarding instruction, where the session forwarding instruction is an instruction for forwarding the session message, for example, a terminal user may forward the session message sent by the session object, and the session message is used as the second session message.

And 406, displaying the first session message and/or the second session message on a playing interface of the target multimedia file.

In particular, during playing of the target multimedia file, the played target multimedia file is already in the background of the session, i.e. the session is displayed on the played target multimedia file, wherein the session comprises the first session message and/or the second session message. That is, in the session interface, the played target multimedia file serves as a background of the session interface, and the first session message and/or the second session message are displayed on the played target multimedia file. As shown in fig. 3A, the background of the session interface shown in fig. 3A is the played target multimedia file, that is, during the playing process of the target multimedia file, the background is the session interface, and the first session message sent by the session object to the end user is displayed on the left side of the playing interface of the target multimedia file, and the second session message sent by the end user to the session object is displayed on the right side of the playing interface of the target multimedia file.

In one embodiment, as shown in fig. 5, receiving a presentation request for a target multimedia file in a session interface, and playing a target video as a background of the session according to the presentation request includes:

The video refers to the video messages being displayed by the session interface, and includes all the video messages of the session, and all the video messages of the session include the video messages sent by the session object to the end user and the video messages sent by the end user to the session object. Specifically, in the session interface, the play interface of the target video serves as the background of the session interface, and all videos of the session are displayed in the play interface of the target video, including the video message sent by the session object to the end user and the video message sent by the end user to the session object.

As shown in fig. 5A, fig. 5A shows an interface schematic diagram of a session interface displaying multiple videos in an embodiment, a background of the session interface shown in fig. 5A is a play interface of a target video, and all video messages in a session are displayed on the play interface of the target video, for example, a video message sent by a session object to an end user is displayed on the left side of the play interface, and a video message sent by the end user to the session object is displayed on the right side of the play interface, where it is described herein that a display position of each video on the session interface is not limited, and can be set or adjusted according to a service requirement or an actual application scene.

Specifically, after the session interface displays the videos included in the session, the end user may generate a presentation request by acting on the first video trigger. The first video refers to that the terminal user selects a target video from the videos and operates and triggers the target video to generate a display request, the target video is used as the first video, or a video which is not read by the terminal user is used as the first video. The terminal user can perform click operation on the first video in each video to trigger generation of a display request, or can perform voice control operation on each video to trigger generation of a display request and the like, or can trigger generation of a display request and the like through a related video playing control on a session interface.

As shown in FIG. 5B, the session interface of FIG. 5B displays a plurality of videos, including video messages sent by the session object to the end user and video messages sent by the end user to the session object. The terminal user can select a certain video from the videos displayed on the session interface as a first video and click the first video. The terminal acquires a display request generated by triggering of the operation of the terminal user on the first video.

Specifically, after acquiring a display request acting on a first video, the terminal takes the first video as an initial playing video, and sequentially plays each video with a sending time after the first video according to the sending time of each video and the sending time of the first video. That is, on the session interface, once the display request acting on the first video is obtained, the first video is played according to the display request, and the playing interface of the first video is used as the background of the session interface. And after the first video is played, directly playing the next video with the sending time after the first video, taking the playing interface of the next video as the background of the session interface, obtaining the default session background until all videos with the sending time after the first video are played in sequence, and taking the default session background as the background of the session interface for display.

As shown in fig. 5C, fig. 5C is a schematic diagram illustrating a play interface in which a background of a session interface is a first video in one embodiment, and after the first video in fig. 5C is played, a play interface of a next video with a sending time after the first video is automatically used as the background of the session interface, as shown in fig. 5D. And sequentially playing until all videos with the sending time after the first video are played, namely, the background of the session interface sequentially plays the first video and all videos with the sending time after the first video.

In one embodiment, as shown in fig. 6, receiving a presentation request for a target multimedia file in a session interface, and playing the target multimedia file as a background of the session according to the presentation request includes:

The video refers to the video messages being displayed by the session interface, and includes all the video messages of the session, and all the video messages of the session include the video messages sent by the session object to the end user and the video messages sent by the end user to the session object. Specifically, in the session interface, the play interface of the target video serves as the background of the session interface, and all videos of the session are displayed in the play interface of the target video, including the video message sent by the session object to the end user and the video message sent by the end user to the session object.

As shown in fig. 5A, fig. 5A shows an interface schematic diagram of a session interface displaying multiple videos in an embodiment, a background of the session interface shown in fig. 5A is a play interface of a target video, and all video messages in a session are displayed on the play interface of the target video, for example, a video message sent by a session object to an end user is displayed on the left side of the play interface, and a video message sent by the end user to the session object is displayed on the right side of the play interface, where it is described herein that a display position of each video on the session interface is not limited, and can be set or adjusted according to a service requirement or an actual application scene.

The display request is a request for requesting to play an unread video, and specifically, the display request may be generated by triggering a relevant video play button set in the session interface, or may also be generated by a voice control operation in the session interface.

As shown in fig. 5A, a video playing control is disposed below the session interface shown in fig. 5A, and a display request can be generated by performing a click operation or a voice operation on the video playing control.

And step 606, taking the unread video as an initial playing video according to the display request, and sequentially playing each unread video with the sending time after the initial playing video.

Specifically, after receiving the display request, determining an unread video from each video according to the display request, specifically, detecting whether the video is played, or detecting whether the video is clicked or operated by voice to determine the unread video, or determining the unread video according to a reading identifier of each video, where the reading identifier includes an unread identifier and a read identifier. Such as a video detected not to be clicked or operated by voice as an unread video.

Further, after the unread videos are determined from the videos, the unread videos are used as the initial playing videos according to the display request, the initial playing videos are played, the playing interfaces of the unread videos are used as the background of the session interface, then the unread videos with the sending time after the initial playing time are played in sequence according to the sending time of the unread videos and the sending time of the unread videos, when the unread videos with the sending time after the initial playing time are played in sequence, the playing interfaces of the unread videos are used as the background of the session interface, and once the session interface finishes playing the previous video, the session interface can automatically continue to play the next unread video. In one embodiment, receiving a presentation request at a session interface includes: acquiring the operation of a video playing control which is set to act on a session interface; generating a display request according to operation triggering; according to the display request, the unread video is used as an initial playing video, and each video with the sending time after the initial playing video is played in sequence, wherein the method comprises the following steps: acquiring a video with an unread video reading identifier in a session interface; and selecting an initial playing video from the unread videos according to the sending time, and sequentially playing each unread video with the sending time after the initial playing video.

Specifically, a video playing control is arranged on the session interface, and the video playing control is used for controlling video playing in the session. The terminal user can trigger and generate a display request by operating a video playing control set on the session interface. The operation of the video playing control set through the session interface may be, but is not limited to, a click operation or a voice operation. Further, video reading identifiers corresponding to the videos in the session are obtained according to the display request, and the video reading identifiers are used for identifying whether the videos are read or not, and include but are not limited to video read identifiers and video unread identifiers. And screening the videos with the unread video reading identifications, taking the unread video with the earliest sending time as an initial playing video according to the sending time of the screened unread video, and sequentially playing the unread videos with the sending time after the initial playing video.

For example, the session message includes video a, video B, video C, video D, and video E, the video B being in a read state and the video a, video C, video D, and video E being in an unread state, the transmission time of the video a precedes the transmission time of the video B, and the transmission time of the video C, video D, and video E follows the transmission time of the video B and is transmitted in order. Therefore, the unread video A, the unread video C, the unread video D and the unread video E are obtained according to the display request, the unread video A is used as the initial playing video according to the sending time of the unread video A, the unread video C, the unread video D and the unread video E, and the unread video C, the unread video D and the unread video E are played in sequence after the sending time of the unread video A, the unread video C, the unread.

In an embodiment, the step of taking the unread video as the initial playing video according to the display request may be to obtain all the unread videos in a preset time period according to the display request, the preset time period may be customized, the customization may be set according to an actual scene or a service requirement, and the customization may be to determine the preset time period according to a time point of the read video, for example, to determine a time after the read video as the preset time period. Further acquiring all unread videos in a preset time period, taking the unread video with the earliest sending time in the preset time period as an initial playing video according to the sending time of all the unread videos in the preset time period, and sequentially playing all the unread videos with the sending time after the initial playing video.

For example, the session message includes video a, video B, video C, video D, and video E, the video B being in a read state and the video a, video C, video D, and video E being in an unread state, the transmission time of the video a precedes the transmission time of the video B, and the transmission time of the video C, video D, and video E follows the transmission time of the video B and is transmitted in chronological order. Accordingly, video C, video D, and video E can be acquired according to the presentation request, while the transmission time of video a precedes that of video B. Since the preset time period can be determined as the time after the video B according to the time point of the read video B, the video a is filtered. Further, according to the sending time of the video C, the video D and the video E, the video C is used as an initial playing video, and the video D and the video E with the sending time after the video C are played in sequence.

In one embodiment, as shown in fig. 7, the data processing method further includes:

The multimedia file reply instruction is an instruction for requesting to collect the multimedia file. Specifically, a multimedia file reply instruction can be generated by performing click operation on a multimedia file reply control arranged on the session interface, or a multimedia file reply instruction can also be generated by performing voice control operation on the session interface. Specifically, once the terminal acquires the multimedia file reply instruction, the terminal acquires the multimedia file according to the multimedia file reply instruction and forms the multimedia file into a reply multimedia file. Specifically, the shooting device can be started to collect the multimedia file in real time according to the multimedia file reply instruction, and the multimedia file collected in real time is formed into a reply multimedia file, or the corresponding multimedia file can be locally obtained according to the multimedia file reply instruction, and the locally obtained multimedia file is formed into a reply multimedia file. The reply multimedia file refers to a multimedia file message sent by the terminal user to the session object.

Furthermore, after the multimedia file is collected according to the multimedia file reply instruction, the collected multimedia file can be edited, specifically, a multimedia file editing instruction is obtained, and the collected multimedia file is edited according to the multimedia file editing instruction to obtain an edited multimedia file. And finally, forming a reply multimedia file according to the edited multimedia file.

As shown in fig. 7A, fig. 7A illustrates an interface schematic diagram of a session interface in an embodiment, where the session interface illustrated in fig. 7A is provided with a multimedia file reply control, and a multimedia file reply instruction is generated by performing click/voice operation on the multimedia file reply control. Once the multimedia file reply instruction is obtained, the multimedia file collection interface is entered, as shown in fig. 7B, fig. 7B shows an interface schematic diagram of multimedia file collection in one embodiment, and after the collected multimedia file, the collected multimedia file can be edited, and a reply multimedia file is formed according to the edited multimedia file.

Specifically, after the collected multimedia files are formed into reply multimedia files, the reply multimedia files are sent to session objects corresponding to the session interface, specifically, a multimedia file sending control set on the multimedia file collection interface can be triggered to send the reply multimedia files to the session objects corresponding to the session interface, and once the multimedia file sending control is triggered, the reply multimedia files formed by the collected multimedia files are played on the session interface as the background of the session.

As shown in fig. 7B, fig. 7B shows a multimedia file collection interface, a multimedia file sending control is disposed on the multimedia file collection interface, a multimedia file can be collected by a photographing device, after collection is completed, a reply multimedia file is formed according to the collected multimedia file, the reply multimedia file is sent to a session object corresponding to the session interface by triggering the multimedia file sending control on the multimedia file collection interface, and the reply multimedia file is played in the session interface as a background of the session, as shown in fig. 7C, the session interface shown in fig. 7C is a playing interface of the reply multimedia file, and a thumbnail, a text message, and the like corresponding to the reply multimedia file sent to the session object by a terminal user are displayed on the playing interface of the reply multimedia file.

In one embodiment, as shown in fig. 8, the data processing method further includes:

The multimedia file closing request is used for closing the multimedia file playing request. The multimedia file closing request may specifically be a multimedia file playing button generation that triggers the setting of the session interface, for example, in the playing process of the target multimedia file, the multimedia file playing button of the session interface may be triggered again to generate a multimedia file closing request. Or the multimedia file closing request can also be that all multimedia files in the session are played completely, or the multimedia file closing request can be generated by triggering, for example, all multimedia files of the session are automatically and sequentially played, and the multimedia file closing request is generated by triggering when all multimedia files of the session are played completely.

And step 804, ending the playing of the multimedia file in the session interface according to the multimedia file closing request.

Specifically, once a multimedia file closing request is received in the session interface, the terminal closes the multimedia file being played in the session interface according to the multimedia file closing request, and when the multimedia file being played in the session interface is closed, the session interface recovers a default session background, that is, the default session background is displayed as a session background, and the default session background may be a picture or the like stored in the local terminal. Specifically, the terminal acquires a default session background, and displays the default session background as a session background, that is, the terminal displays session content of the session on the default session background, including a text message, a voice message, or a video message sent by the terminal user to the session object, or a text message, a voice message, or a video message sent by the session object to the terminal user.

In one embodiment, as shown in fig. 9, a data processing method includes:

The conversation interface is an interface for displaying conversation messages, the conversation messages are information of a conversation object collected during conversation, and the conversation information may include at least one of text information, voice information and video information sent by the conversation object. The session object may be any session object in the session process.

Wherein the presentation request is a request for requesting to play a target multimedia file. In the session process, the two parties of the session object send at least one multimedia file in the session interface, and a target multimedia file can be selected from the at least one multimedia file. The method for selecting the target multimedia file from the at least one multimedia file can be customized, and the customization can be to use the multimedia file of interest as the target multimedia file from the at least one multimedia file, or to use an unread multimedia file as the target multimedia file from the at least one multimedia file, and the like. Further, after a target multimedia file is determined in at least one multimedia file displayed on the session interface, the target multimedia file is clicked to trigger and generate a display request. Or, performing voice control operation on the target multimedia file to trigger generation of a display request and the like. Or a related multimedia file playing button is arranged in the session interface, and a display request is generated by triggering the multimedia file playing button arranged on the session interface.

The session communication application presets a message processing layer, a background processing layer and a video playing layer, wherein the message processing layer is used for receiving and displaying session messages, the background processing layer is used for receiving and displaying default session backgrounds, and the video playing layer is used for playing target multimedia files. And the video playing layer positioned between the message processing layer and the background processing layer plays the target multimedia file only when the session interface receives a display request for the target multimedia file. And when the target multimedia file is played or the multimedia file in the session is played, the video playing layer positioned between the message processing layer and the background processing layer is hidden. In the process of playing the target video by the video playing layer, the video playing layer is located below the message processing layer and above the background processing layer, as shown in fig. 9A, fig. 9A shows a product structure diagram of the data processing method in one embodiment.

Step 908 displays the conversation message through the message handling layer.

Specifically, in the process of playing the target multimedia file, the session message is received through the message processing layer, where the session message includes a text message, a voice message, or a video message sent by the terminal user to the session object, and the text message, the voice message, or the video message sent by the session object to the terminal user. And the application session communication application in the terminal receives the session message through the message processing layer and displays the session message through the message processing layer. Meanwhile, the video playing layer positioned below the message processing layer displays the target multimedia file, and the target multimedia file is played through the video playing layer. As shown in fig. 9A, when a presentation request for a target multimedia file is received in a session interface, a video playing layer located below a message processing layer displays the target multimedia file, and the message processing layer receives a session message and displays the session message through the message processing layer.

In one embodiment, as shown in fig. 10, the data processing method shown in fig. 9 further includes:

Specifically, when the target multimedia file is played or stopped, a multimedia file closing request is triggered to be generated, and a video playing layer located between the message processing layer and the background processing layer is hidden according to the multimedia file closing request, wherein the background processing layer is located below the message processing layer, that is, there is no video playing layer between the background processing layer and the message processing layer. And once the target multimedia file stops playing, hiding a video playing layer between the background processing layer and the message processing layer, acquiring a default conversation background, displaying the default conversation background through the background processing layer, and receiving and displaying a conversation message through the message processing layer. That is, the background of the session interface is a default session background, and session messages, including session messages sent by the end user to the session object and session messages sent by the session object to the end user, including text messages, voice messages, video messages, and the like, are displayed on the default session background. As shown in fig. 10A, fig. 10A is an interface schematic diagram illustrating a session interface background in an embodiment as a default session background, where the session interface in fig. 10A is an acquired default session background, the default session background is a locally stored static picture, the default session background is displayed through a background processing layer, and a session message is displayed in the default session background, and specifically, the session message may be acquired and displayed through a message processing layer above the background processing layer.

In one embodiment, receiving a presentation request for a target multimedia file in a session interface includes: when the conversation interface comprises a plurality of pictures, acquiring a display request acting on a first picture; playing the target multimedia file as the background of the session according to the display request, comprising: and taking the first picture as an initial playing picture, and sequentially playing the pictures with the sending time after the first picture.

The pictures refer to picture messages displayed on the session interface and include all picture messages of the session, and all picture messages of the session include picture messages sent by the session object to the terminal user and picture messages sent by the terminal user to the session object. Specifically, in the session interface, the play interface of the target picture is used as a background of the session interface, and all pictures of the session are displayed in the play interface of the target picture, including a picture message sent by the session object to the end user and a picture message sent by the end user to the session object.

Further, after each picture included in the session is displayed on the session interface, the terminal user can trigger generation of a display request by acting on the first picture. The first picture here refers to that the terminal user selects a target picture from all pictures and operates and triggers the target picture to generate a display request, the target picture is used as the first picture, or a picture which is not read by the terminal user can be used as the first picture. The terminal user can click the first picture in each picture to trigger generation of the display request, or can trigger generation of the display request and the like through voice control operation on each picture, or can trigger generation of the display request and the like through a related picture playing control on a conversation interface.

And finally, after acquiring the display request acting on the first picture, the terminal takes the first picture as an initial playing picture and sequentially plays the pictures with the sending time after the first picture according to the sending time of each picture and the sending time of the first picture. That is, on the session interface, once the display request acting on the first picture is acquired, the first picture is played according to the display request, and the playing interface of the first picture is used as the background of the session interface. And after the first picture is played, directly playing the next picture with the sending time after the first picture, taking the playing interface of the next picture as the background of the session interface, obtaining the default session background until all pictures with the sending time after the first picture are played in sequence, and taking the default session background as the background of the session interface for display.

In one embodiment, receiving a presentation request for a target multimedia file in a session interface includes: when the conversation interface comprises a plurality of pictures, receiving a display request through the conversation interface; playing the target multimedia file as the background of the session according to the display request, comprising: and taking the unread pictures as initial playing pictures according to the display request, and sequentially playing the unread pictures after the initial playing pictures are sent.

The pictures refer to picture messages displayed on the session interface and include all picture messages of the session, and all picture messages of the session include picture messages sent by the session object to the terminal user and picture messages sent by the terminal user to the session object. Specifically, in the session interface, the play interface of the target picture is used as a background of the session interface, and all pictures of the session are displayed in the play interface of the target picture, including a picture message sent by the session object to the end user and a picture message sent by the end user to the session object.

Further, after each picture included in the session is displayed on the session interface, the terminal user can trigger generation of a display request by acting on the first picture. The first picture here refers to that the terminal user selects a target picture from all pictures and operates and triggers the target picture to generate a display request, the target picture is used as the first picture, or a picture which is not read by the terminal user can be used as the first picture. The terminal user can click the first picture in each picture to trigger generation of the display request, or can trigger generation of the display request and the like through voice control operation on each picture, or can trigger generation of the display request and the like through a related picture playing control on a conversation interface.

Once the display request is received, the unread pictures are confirmed from the pictures according to the display request, and whether the pictures are played or not can be detected, whether the pictures are clicked or operated by voice is detected to confirm the unread pictures, or the unread pictures are confirmed according to the reading identifiers of the pictures, wherein the reading identifiers comprise unread identifiers and read identifiers. For example, the picture detected to have no click operation or voice operation is regarded as an unread picture.

And finally, after the unread pictures are determined from all the pictures, the unread pictures are taken as initial playing pictures according to the display request, the initial playing pictures are played, the playing interfaces of the unread pictures are taken as the background of the session interface, then all the unread pictures with the sending time after the initial playing time are played in sequence according to the sending time of the unread pictures and the sending time of all the unread pictures, when all the unread pictures with the sending time after the initial playing time are played in sequence, the playing interfaces of all the unread pictures are taken as the background of the session interface, and once the session interface plays the previous picture, the session interface can automatically continue to play the next unread picture.

In an instant messaging chat application scenario, as shown in fig. 11, fig. 11 is a schematic diagram illustrating a principle that a background is replaced by a playing video in an instant messaging chat in one embodiment, after a terminal user enters an instant messaging chat interface, the terminal user can chat with a session object through an instant messaging application, and corresponding chat information is displayed in the instant messaging chat interface, where the chat information includes a session message sent by the terminal user to the session object, a session message sent by the session object to the terminal user, and the like, and the session message includes a text message, a video message, and a voice message. At this time, once the terminal recognizes the click operation of the terminal user on the video message, the video playing layer between the message processing layer and the background processing layer is displayed, and at this time, the video playing layer is located below the message processing layer and above the background processing layer. Meanwhile, the video information clicked by the terminal user is played through the video playing layer, the chat background of the instant messaging starts to play from the video clicked by the terminal user, and the next video is automatically played after the video playing is finished. At this time, the chat background of the instant messaging is a playing interface for playing the video, and the chat content of the terminal user and the session object is displayed on the playing interface for playing the video. After all video messages are played, or a terminal user clicks a video pause playing button, a video playing layer between a message processing layer and a background processing layer is hidden, the background processing layer is positioned below the message processing layer, and the chat background of instant messaging immediately jumps to a default background.

In another instant messaging chat application scenario, after a terminal user enters an instant messaging chat interface, a video reply button is arranged on the instant messaging chat interface, the terminal user can enter a shooting mode by clicking the video reply button, at the moment, the instant messaging chat interface enters a video shooting interface, and video editing can be performed or no video editing is performed after video shooting is finished. And after the video is edited, quickly sending the successfully edited video to the session object, wherein once the video is successfully sent, the background of the instant messaging chat is a playing interface of the successfully edited video.

In yet another instant messaging chat application scenario, an end user opens a chat session box for instant messaging chat, where the chat context is also the default context. When a terminal user clicks a video thumbnail in a chat, the video starts to be played, and the chat background is replaced by the video content being played. If the user wants to turn off the video playback, he needs to click the video pause button on the chat interface. Once the end user clicks the video pause button, the video playback is turned off, at which point the chat interface returns to the default background.

It should be understood that, although the steps in the above-described flowcharts are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in the above-described flowcharts may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or the stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least a portion of the sub-steps or stages of other steps.

In one embodiment, as shown in fig. 12, there is provided a data processing apparatus 1200, comprising:

FIG. 13 is a diagram illustrating an internal structure of a computer device in one embodiment. The computer device may specifically be the terminal 110 in fig. 1. As shown in fig. 13, the computer apparatus includes a processor, a memory, a network interface, an input device, and a display screen connected through a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program which, when executed by the processor, causes the processor to implement the data processing method. The internal memory may also have stored therein a computer program that, when executed by the processor, causes the processor to perform a data processing method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

Those skilled in the art will appreciate that the architecture shown in fig. 13 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, the data processing apparatus provided herein may be implemented in the form of a computer program that is executable on a computer device such as that shown in fig. 13. The memory of the computer device may store various program modules constituting the data processing apparatus, such as a presentation request receiving module, a target video playing module, a session message acquiring module, and a session message displaying module shown in fig. 12. The computer program constituted by the respective program modules causes the processor to execute the steps in the data processing method of the respective embodiments of the present application described in the present specification.

In an embodiment, a computer device is provided, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the data processing method described above. The steps of the data processing method herein may be steps in the data processing methods of the various embodiments described above.

In one embodiment, a computer-readable storage medium is provided, in which a computer program is stored which, when being executed by a processor, causes the processor to carry out the steps of the above-mentioned data processing method. The steps of the data processing method herein may be steps in the data processing methods of the various embodiments described above.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.