CN115278324B - Display device, bluetooth device and BIS audio transmission method - Google Patents

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure.

The Bluetooth-based low-power-consumption Audio (LE Audio) technology of the display equipment provided by the disclosure has the following functions and characteristics:

(1) Support stereo in connected and disconnected states (broadcast states);

(2) The use of a complexity communication codec (LC 3) provides better sound quality, providing high quality audio even in a low code rate transmission environment;

(3) Having multiple streaming characteristics, supporting transmission of multiple independent, synchronized audio streams between an audio source device and one or more audio sink devices;

(4) The system has the function of broadcasting audio, can break through the point-to-point transmission function of Bluetooth, enables audio source equipment to send one or more audio streams to countless audio receiving equipment, and can realize personal-based, position-based and even scene-based use experience.

The present disclosure is a case of stereo sound established in an LE Audio supporting non-connected state (broadcast state), which is a broadcast isochronous stream (Broadcast Isochronous Stream, BIS) that allows one Audio source device to broadcast an Audio stream to a plurality of Audio sink devices. BIS data packets of fixed or variable size are supported, with or without frames of data or multiple data packets being used on each BIS event. The BIS does not need to confirm the unidirectional data stream from the audio source device to the audio sink device. The BIS data packet can be retransmitted by increasing the number of sub-events in each BIS event to improve the reliability of transmission. An audio receiving apparatus within a broadcast audio allowable range can join an audio stream being broadcast using two broadcasting methods, one being open broadcasting, meaning that a receiving apparatus within any range can start receiving broadcast audio; the other is a closed broadcast, meaning that any in-range receiving device requires an input key to participate in the audio stream of the audio source device.

The display device and the BIS Audio transmission method provided by the embodiments of the present disclosure are described above, and are based on bluetooth low energy Audio (LE Audio) technology, and realize data transmission of the display device and other bluetooth devices in the BIS mode.

In recent years, with the rapid development of the internet and the popularization of the AI technology, the smart television gradually enters the daily life of people, and particularly in a multi-person interaction scene, the large screen advantage of the smart television can be embodied. In order to meet the diversified demands of users, the intelligent television is utilized to carry out multi-channel screen projection, so that the intelligent television can be well adapted to meeting and entertainment scenes of users, meetings and the like. The multi-channel screen projection can be understood as synchronously displaying and outputting pictures and sounds of a plurality of small-screen terminal devices such as mobile phones and the like on a large-screen television. Because the multipath screen is a mirror image screen, the network environment is required to be higher, delay exists, and the problems of picture blocking, blurring picture quality, poor tone quality and the like can be possibly encountered in the experience process of a user.

For example, for users who play games together while enjoying a family meeting, this feature can satisfy the need for all game players to view the games together. In general, a conventional screen is limited to one device to screen a television, so that when playing a game, in order to watch the fight situation of other game players, the line of sight needs to be transferred to another device, and the game experience of a user is affected. Based on the multi-channel screen projection technology, the television can simultaneously play real-time game pictures of a plurality of devices, so that all game players can observe the fight conditions of other players in real time.

As shown in fig. 1, fig. 1 is a schematic view of a scene in which a display device performs multi-path screen projection, and fig. 1 includes at least one bluetooth device: in the aforementioned scenario of playing a game together by a plurality of users using a television screen-casting function, the bluetooth device 101, the bluetooth device 102, the bluetooth device 103, the bluetooth device 104 send a game screen and a game audio being displayed to the display device, so that the display device synchronously displays the game screen of each bluetooth device on the display screen, and plays the game audio.

However, when the display device displays the pictures and the sounds of a plurality of devices by using the multi-channel screen projection technology, the screen projection picture data sent by other bluetooth devices are received through the WiFi communication assembly so as to synchronously play the screen projection picture data, and the audio data sent by other bluetooth devices are received through the bluetooth communication assembly so as to synchronously output the audio data, and in general, the delay time of transmitting the screen projection picture data by using the WiFi is 40ms, and the delay time of transmitting the audio data by using the bluetooth is about 50ms, so that the audio and the video on the display device are asynchronous.

In order to solve the problem of asynchronous audio and video of the display equipment, the first scheme mainly realizes Bluetooth connection through a classical Bluetooth technology, realizes encoding and decoding through a sub-band encoding (SubBand Coding, SBC) mode, optimizes an encoder, and reduces the delay of Bluetooth transmission of audio data, but the performance optimization of the encoder has an upper limit, and can not completely solve the problem of asynchronous audio and video of the display equipment.

In order to solve the problem of the asynchronous Audio and video of the display equipment, the second scheme can adopt an LE Audio technology to reduce the delay of Bluetooth transmission of Audio data so as to realize the synchronous Audio and video of the display equipment. Because the LE Audio technology in the second scheme is implemented based on the bluetooth low energy (Bluetooth Low Energy, BLE) protocol, compared with the implementation of bluetooth connection by using the classical bluetooth technology in the first scheme, the bluetooth transmission strategy is changed, and the second scheme is also improved with respect to the coding mode, and the SBC mode is improved to the low-complexity communication codec (LC 3) mode to implement codec, thus effectively reducing the delay of bluetooth transmission of Audio data.

However, when the television receives and transmits broadcast information in the BIS in the Bluetooth-based low-power-consumption Audio (LE Audio) technology, the television cannot know which channel other Bluetooth devices can transmit Audio data from, so that all channels need to be monitored at all times to receive the Audio data, and the problems of high power consumption and high bandwidth resource occupancy rate exist.

Fig. 2 is a schematic diagram of the working principle of BIS in the prior art, as shown in fig. 2. The figure includes an audio source device 211 and an audio sink device 212. The working principle of BIS is: the audio source device 211 first transmits a first broadcast packet including audio data type information and first guidance information through any one of the main broadcast channels of bluetooth. Wherein the first guidance information is used to instruct the audio source device to transmit a next broadcast packet (second broadcast packet) through the first auxiliary broadcast channel. Then, the audio source device transmits a second broadcast packet through the first auxiliary broadcast channel, wherein the second broadcast packet comprises the audio data identifier and the second guide information. Wherein the second guiding information is used for indicating the audio source device to send a third broadcast packet through the second auxiliary broadcast channel. Further, the audio source device sends a third broadcast packet through the second auxiliary broadcast channel, wherein the third broadcast packet comprises code stream data and third guide information. Wherein the third guide information is used to instruct the audio source device to transmit audio data through the third auxiliary broadcast channel.

It should be noted that bluetooth works in the 2.4GHz band, the frequency range is 2402MHz-2480MHz, one channel is every 2MHz, 40 channels are total, wherein 3 main broadcast channels are used, and the remaining 37 auxiliary broadcast channels are used. Generally, since there are fewer primary broadcast channels and resources are relatively tense, initial pilot information (such as the first pilot information described above) is sent first through the primary broadcast channel to indicate that subsequent broadcast packets are subsequently sent in other secondary broadcast channels, so that other secondary broadcast channels are adopted in the subsequent transmission process, and resources of the primary broadcast channel are not occupied.

As can be seen, it is initially necessary to continuously monitor all broadcast channels on the audio receiving apparatus 212 side to receive the first broadcast packet, which results in high power consumption of the audio receiving apparatus, and the continuous monitoring occupies a relatively large bandwidth resource; in addition, based on the working principle schematic diagram of BIS shown in fig. 2, four broadcast channels need to be monitored successively to obtain real audio data, the process is tedious, the time delay is large, and in the scene of multi-channel screen projection of display equipment, the sound and the picture are asynchronous, so that the user experience is affected.

In order to solve the technical problem, the display device provided by the disclosure firstly receives the wheat-grabbing occurrence time sent by at least one bluetooth device through the WiFi communication component, then determines the target bluetooth device with the earliest wheat-grabbing occurrence time from the at least one bluetooth device through the controller, then receives the BIS channel identification sent by the target bluetooth device after sending the wheat-grabbing success indication to the target bluetooth device through the WiFi communication component, further monitors the target BIS channel indicated by the BIS channel identification through the bluetooth communication component to receive target BIS audio, and then controls the audio playing component to play the target BIS audio through the controller. The display device interacts with at least one Bluetooth device through the WiFi communication component, determines the target Bluetooth device from the Bluetooth device, receives the BIS channel identification sent by the target Bluetooth device, monitors only the target BIS channel corresponding to the target Bluetooth device, reduces bandwidth resources consumed by monitoring when the mobile phone audio data are acquired through the Bluetooth broadcasting interaction mode, receives the audio data through more bandwidth resources, improves the speed and quality of receiving the audio data, and further improves the playing tone quality of the display device.

Fig. 3 is a schematic view of a scenario in some embodiments provided by embodiments of the present disclosure. As shown in fig. 3, fig. 3 includes a control apparatus 100, a display device 200, a smart device 300, a server 400, and at least one bluetooth device 500. The user may operate the display device 200 through the smart device 300 or the control apparatus 100, and play the audio/video resource on the display device 200.

As shown in fig. 3, taking an example in which a user operates the display device 200 through the control apparatus 100, the user turns on the WiFi communication module and the bluetooth communication module related functions configured in the display device 200 through the control apparatus 100. The method comprises the steps of firstly receiving the wheat-rushing occurrence time sent by at least one Bluetooth device 500 through a WiFi communication assembly, then determining a target Bluetooth device with the earliest wheat-rushing occurrence time from the at least one Bluetooth device through a controller, then receiving a BIS channel identifier sent by the target Bluetooth device after sending a wheat-rushing success indication to the target Bluetooth device through the WiFi communication assembly, further monitoring a target BIS channel indicated by the BIS channel identifier through the Bluetooth communication assembly to receive target BIS audio, and then controlling an audio playing assembly to play the target BIS audio through the controller. The display device interacts with at least one Bluetooth device through the WiFi communication component, determines the target Bluetooth device from the Bluetooth device, receives the BIS channel identification sent by the target Bluetooth device, monitors only the target BIS channel corresponding to the target Bluetooth device, reduces bandwidth resources consumed by monitoring when the mobile phone audio data are acquired through the Bluetooth broadcasting interaction mode, receives the audio data through more bandwidth resources, improves the speed and quality of receiving the audio data, and further improves the playing tone quality of the display device.

In some embodiments, the control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, bluetooth protocol communication, and wireless or other wired manner to control the display device 200. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the display device 200.

In some embodiments, at least one bluetooth device 500 may install a software application with the display device 200 to enable connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. The audio/video content displayed on at least one bluetooth device 500 may also be transmitted to the display device 200, so that the display device 200 may also perform data communication with the server 400 through various communication manners. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The display device 200 may additionally provide an intelligent network television function of a computer support function in addition to the broadcast receiving television function.

Fig. 4 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 4, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200. The communication interface 130 is configured to communicate with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, keys, or an alternative module.

Fig. 5 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment. The display device 200 as shown in fig. 5 includes: a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, power supplies, and the like. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), and first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio and video signals, such as electronic program guide (ELECTRICAL PROGRAM GUIDE, EPG) data signals, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box.

In some embodiments, the display device is a terminal device having a display function, such as a television, a mobile phone, a computer, a learning machine, and the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

An output interface (display 260, and/or audio output interface 270) configured to output user interaction information;

The communicator 220 is used for communicating with the server 400 or other devices.

In an embodiment of the present disclosure, there is provided a display apparatus including:

An audio playing component configured to: playing audio;

A WiFi communication component configured to: receiving the wheat-rushing occurrence time sent by at least one Bluetooth device;

a controller configured to: determining a target Bluetooth device with earliest wheat-rushing occurrence time from at least one Bluetooth device;

a WiFi communication component further configured to: sending a wheat-grabbing success indication to the target Bluetooth equipment, and receiving a synchronous broadcast streaming BIS channel identifier sent by the target Bluetooth equipment after the wheat-grabbing success indication is sent;

A bluetooth communication assembly further configured to: monitoring a target BIS channel indicated by the BIS channel identification to receive target BIS audio;

the controller 250 is further configured to: and controlling the audio playing component to play the target BIS audio.

It should be noted that, the above-mentioned audio playing component can implement the same or similar functions as the audio output interface 270 shown in fig. 4; the WiFi communication component can implement the same or similar functionality as the WiFi module in communicator 220 shown in fig. 4; the bluetooth communication assembly can perform the same or similar functions as the bluetooth module in the communicator 220 shown in fig. 4, and this disclosure is not repeated here.

The display device interacts with at least one Bluetooth device through the WiFi communication component, determines the target Bluetooth device from the Bluetooth communication component, receives the BIS channel identification sent by the target Bluetooth device, monitors only the target BIS channel corresponding to the target Bluetooth device, reduces bandwidth resources consumed by monitoring when the mobile phone audio data are acquired through the Bluetooth broadcasting interaction mode, receives the audio data through more bandwidth resources, improves the speed and quality of the received audio data, and further improves the playing tone quality of the display device.

In some embodiments, the display device further comprises: a display configured to: displaying a video picture;

A WiFi communication component further configured to: receiving screen projection picture data sent by a plurality of Bluetooth devices so as to receive multi-path screen projection picture data;

The controller 250 is further configured to: controlling the display to split the screen to display multi-path screen projection picture data;

The WiFi communication assembly is specifically configured to: and receiving the wheat-rushing occurrence time sent by at least one Bluetooth device in the plurality of Bluetooth devices.

In some embodiments, the WiFi communication component is further configured to: after sending the wheat-robbing success indication, receiving code stream data sent by target Bluetooth equipment;

The bluetooth communication module is specifically configured to: monitor the target BIS channel indicated by the BIS channel identifier and receive the target BIS audio according to the code stream data.

In some embodiments, the WiFi communication component is further configured to: after sending the wheat-robbing success indication, receiving decoding information sent by target Bluetooth equipment;

the bluetooth communication module is specifically configured to: monitoring a target BIS channel indicated by the BIS channel identifier to receive the first BIS audio, and decrypting the first BIS audio to obtain decrypted target BIS audio.

In some embodiments, the WiFi communication component is further configured to: after sending a wheat-robbing success indication, receiving a BIG offset time unit and a BIG offset unit number of a synchronous broadcast group sent by target Bluetooth equipment;

The controller 250 is further configured to: determining an anchor point position for receiving a first BIS audio data packet in the target BIS audio according to the BIG offset time unit and the BIG offset unit number;

The bluetooth communication module is specifically configured to: and monitoring a target BIS channel indicated by the BIS channel identification, and receiving target BIS audio according to the anchor point position.

In some embodiments, the controller 250 is specifically configured to: determining BIG offset time according to the BIG offset time unit and the BIG offset unit number, and determining that the anchor point position of the first BIS audio data packet in the receiving target BIS audio is behind the BIG offset time;

Or alternatively, the first and second heat exchangers may be,

The controller 250 is specifically configured to: determining BIG offset time according to the BIG offset time unit and the BIG offset unit number, and determining that the anchor point position of the first BIS audio data packet in the received target BIS audio is within the preset offset time after the BIG offset time according to the BIG offset time and the preset offset time.

In some embodiments, the WiFi communication component is further configured to: after sending the wheat-robbing success indication, receiving BIS quantity and BIS index sent by the target Bluetooth equipment;

A controller, further configured to: determining the position of the target BIS audio in the BIG according to the BIS number and the BIS index;

a bluetooth communication assembly further configured to: and monitoring a target BIS channel indicated by the BIS channel identification, and receiving target BIS audio according to the position of the target BIS audio in the BIG.

As shown in fig. 6, fig. 6 is a schematic view of a software configuration in the display device 200 according to one or more embodiments of the present disclosure, and as shown in fig. 6, the system is divided into four layers, an application layer (application layer) from top to bottom, an application framework layer (Application Framework layer (frame layer), a An Zhuoyun line layer (Android runtime) and a system library layer (system runtime layer), and a kernel layer. The kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc. The video data transmission method provided by the embodiment of the disclosure may be implemented based on the display device, and specifically may be implemented by a player in the display device.

The present disclosure provides a bluetooth device, the bluetooth device comprising:

a WiFi communication component configured to: sending the wheat-rushing occurrence time to a display device; after sending the time of wheat rushing, if receiving a wheat rushing success indication sent by the display equipment, sending a BIS channel identifier to the display equipment;

A bluetooth communication assembly configured to: the target BIS audio is transmitted to the display device through the target BIS channel indicated by the BIS channel identification, so that the display device receives the target BIS audio by monitoring the target BIS channel indicated by the BIS channel identification.

The Bluetooth device performs data interaction with the display device through the WiFi communication assembly and the Bluetooth communication assembly, so that audio and video data displayed and output on the Bluetooth device are transmitted to the display device of the large screen to be synchronously played, the Bluetooth device is suitable for a scene of playing games together by multiple users, and the interestingness of multi-path screen throwing is improved by setting a wheat rushing mechanism; the BIS channel identification is sent to the display equipment, so that the display equipment is prevented from continuously monitoring all channels, the monitored power consumption and the bandwidth resources occupied by monitoring are reduced, the BIS audio transmission rate and the BIS audio transmission quality between the Bluetooth equipment and the display equipment are improved, the synchronization of the audio and the video of the display equipment when the display equipment is used for projecting the picture of the Bluetooth equipment and outputting sound is realized, and the user experience is improved.

For more detailed description of the present solution, the following description will be given by way of example with reference to fig. 7, and it will be understood that the steps involved in fig. 7 may include more steps or fewer steps when actually implemented, and the order of these steps may also be different, so as to enable the BIS audio transmission method provided in the embodiments of the present disclosure.

As shown in fig. 7, fig. 7 is a flowchart of a BIS data transmission method according to an embodiment of the present disclosure, and the method includes steps S701 to S705:

S701, receiving the wheat-cutting occurrence time sent by at least one Bluetooth device;

The time of the wheat-rushing occurrence refers to the time when at least one Bluetooth device receives the click of the wheat-rushing control by the user on the respective device, and the at least one Bluetooth device packages and sends the time when the click of the wheat-rushing control by the user is determined to the display device. In a scenario that a plurality of users play a game together by utilizing a plurality of bluetooth devices, the time of occurrence of the wheat-rushing is the time when a certain user clicks a 'wheat rushing' control on the bluetooth device, and the user clicks the 'wheat rushing' control, so that the display device is expected to output audio data such as game sound effects or voice of the bluetooth device.

Fig. 8 is a schematic diagram of a user interface of at least one bluetooth device according to an embodiment of the present disclosure, as shown in fig. 8. The "rob wheat" control 801 is shown in a corresponding position in the user interface. And when the user clicks the wheat-rushing control 801, triggering to send the wheat rushing occurrence time to the display equipment. It should be noted that fig. 8 is merely an exemplary illustration, and the present disclosure is not limited in particular to the specific location of the "robber control.

In some embodiments, before the display device receives the time of occurrence of the wheat rushing sent by at least one bluetooth device, in order to meet diversified audiovisual requirements of users, the disclosure provides an implementation manner based on a multi-channel screen projection technology, where the display device first receives screen projection screen image data sent by a plurality of bluetooth devices through a WiFi communication component to receive the multi-channel screen projection screen image data; and then the display equipment controls the display to split the screen to display the multi-path screen-throwing picture data.

As shown in fig. 9, fig. 9 is a schematic diagram of a multi-path screen provided in an embodiment of the disclosure, and fig. 9 includes a plurality of bluetooth devices: bluetooth device 901, bluetooth device 902, bluetooth device 903, bluetooth device 904, and display device 200, the display device receives the screen data 911 that bluetooth device 901 sent, screen data 912 that bluetooth device 902 sent, screen data 913 that bluetooth device 903 sent, screen data 914 that bluetooth device 904 sent, then the display device controls the display to split the screen to display the multiple paths of screen data: the screen data 911 is displayed in the area C1, the screen data 912 is displayed in the area C2, the screen data 913 is displayed in the area C3, and the screen data 914 is displayed in the area C4. It should be noted that fig. 9 is only an exemplary illustration, and the present disclosure does not specifically limit the display position of the screen data corresponding to each bluetooth device.

It is emphasized that the display device controls the display to display the multi-channel screen-throwing picture data in a split mode, and it can be understood that the display device only displays the screen-throwing picture data of the plurality of bluetooth devices, each screen-throwing picture data is silent, because the audio data sent by the plurality of bluetooth devices are not received, in order to meet the requirement of users for outputting the audio data, after the multi-channel screen-throwing picture data is displayed, the urgent wheat generation time sent by at least one bluetooth device in the plurality of bluetooth devices is received through the WiFi communication assembly, so that the screen-throwing surface-changing data of the plurality of bluetooth devices are displayed on the display device, and the urgent wheat generation time sent by at least one bluetooth device is received, so that the target bluetooth device is determined, the interestingness of the multi-channel screen-throwing is enhanced, and the user experience is improved.

According to the embodiment, the screen projection picture data sent by a plurality of Bluetooth devices are received through the display device, so that the multi-channel screen projection of the display device is realized, and the entertainment requirement of a user in a multi-person gathering process is met; the method comprises the steps of receiving the wheat-grabbing occurrence time sent by at least one Bluetooth device in a plurality of Bluetooth devices, improving the interactivity and the interestingness of a multi-channel head screen, determining a target Bluetooth device in the at least one Bluetooth device, meeting the speaking requirements of users corresponding to the target Bluetooth device, adapting to multi-user interaction scenes and improving user experience.

S702, determining the target Bluetooth device with earliest wheat-rushing occurrence time from at least one Bluetooth device.

In some embodiments, the display device compares the occurrence time of the wheat-snatching sent by at least one bluetooth device, and determines the bluetooth device with the earliest occurrence time of the wheat-snatching as the target bluetooth device.

Using the example in fig. 9, bluetooth device 901, bluetooth device 902, bluetooth device 903, bluetooth device 904 each send respective robbery occurrence times to display device 200; the time of the occurrence of the wheat of the bluetooth device 901 is 13:47:02, the time of the occurrence of the wheat of the bluetooth device 902 is 13:47:29, the time of the occurrence of the wheat of the bluetooth device 903 is 13:48:33, and the time of the occurrence of the wheat of the bluetooth device 904 is 13:48:57. Comparing the occurrence time of the wheat rushing corresponding to the Bluetooth device, determining that the earliest occurrence time of the wheat rushing is 13:47:02, and taking the corresponding Bluetooth device 901 as the target Bluetooth device.

In some embodiments, in a case that the number of target bluetooth devices with earliest rush hour is determined to be a plurality from at least one bluetooth device, determining any one of the target bluetooth devices as a final target bluetooth device; or determining the final target Bluetooth device with the highest priority according to the priorities of the target Bluetooth devices. For example, taking the example in fig. 9, the time of the malting of bluetooth device 901 is 13:47:02, the time of the malting of bluetooth device 902 is 13:47:02, the time of the malting of bluetooth device 903 is 13:48:33, the time of the malting of bluetooth device 904 is 13:48:57, and the earliest time of the malting is 13:47:02, which corresponds to two bluetooth devices: bluetooth device 901 and bluetooth device 902. Further comparing the priority of bluetooth device 901 with that of bluetooth device 902, and in the case where the priority of bluetooth device 901 is higher than that of bluetooth device 902, determining bluetooth device 901 as the target bluetooth device.

The method comprises the steps of comparing the occurrence time of the wheat-rushing sent by at least one Bluetooth device, determining the Bluetooth device with the earliest occurrence time of the wheat rushing as the target Bluetooth device, enhancing the interestingness of multi-channel screen throwing, and meeting the requirement of outputting audio data after the success of the wheat rushing of the target Bluetooth device.

S703, sending a wheat-grabbing success indication to the target Bluetooth device, and receiving a synchronous broadcast streaming BIS channel identifier sent by the target Bluetooth device after sending the wheat-grabbing success indication.

The synchronous broadcast stream BIS channel identifier is used for identifying a broadcast channel to be monitored by the display device.

And S704, monitoring a target BIS channel indicated by the BIS channel identification to receive target BIS audio.

In some embodiments, after determining the target bluetooth device with the earliest time of occurrence of the wheat-rush-harvesting from the at least one bluetooth device, the display device sends a wheat-rush-harvesting success indication to the target bluetooth device, and further receives the BIS channel identifier sent by the target bluetooth device, so as to accurately monitor the BIS channel identifier, thereby receiving the audio data sent by the target bluetooth device.

As described above, based on BIS, in the prior art, the display device cannot know which broadcast channel is from which to acquire the audio data sent by the bluetooth device, so that it is required to monitor all 40 broadcast channels, which has greater power consumption and greater bandwidth resources occupied by monitoring. However, the above embodiment can accurately monitor the channel identifier indicated by the BIS channel identifier by acquiring the BIS channel identifier transmitted by the target bluetooth device.

In some embodiments, after sending the robber success indication, the code stream data sent by the target bluetooth device is also received. The code stream data comprises at least one of the following: sample rate, frame interval, amount of data contained in each frame, data rate. The code stream data is used to instruct the display device to receive and process the BIS audio transmitted by the subsequent target terminal device. After receiving the code stream data and the BIS channel identification sent by the target Bluetooth device, monitoring a target BIS channel indicated by the BIS channel identification, and receiving target BIS audio according to the code stream data.

In some embodiments, after sending the robber success indication, the decoding information sent by the target bluetooth device is also received. Wherein, the decoding information is used for decoding BIS audio sent by the target Bluetooth device. After receiving the decoding information and the BIS channel identifier sent by the target Bluetooth device, monitoring a target channel indicated by the BIS channel identifier to receive first BIS audio sent by the target Bluetooth device, wherein the first BIS audio is encrypted to ensure the safety of data transmission between the display device and the target Bluetooth device, so that the display device decrypts the first BIS audio according to the decoding information sent by the target Bluetooth device to obtain decrypted target BIS audio.

In some embodiments, after sending the robber success indication, a synchronized broadcast group (Broadcast Isochronous Group, BIG) offset time unit and a BIG offset unit number sent by the target bluetooth device are also received. In order to support broadcasting one or more Audio streams, LE Audio introduces a BIG and BIS, and one synchronous broadcasting group BIG may include a plurality of BIS.

As shown in fig. 10A, fig. 10A is a schematic diagram of a BIG in an embodiment of the present disclosure, and the BIG shown in fig. 10A includes a plurality of BIS, which are respectively identified as BIS1, BIS2, BIS3, and BIS4 in fig. 10A. For example, if a mobile phone plays music through bluetooth broadcasting, the left and right ears of the bluetooth headset of each of a plurality of users who need to listen to the music must also receive synchronized data streams, and the data of the left and right ears must belong to the same BIG.

The BIG offset time unit and the BIG offset unit number are used for indicating the display device to offset after receiving the BIS channel identifier, and the offset duration is N times the BIG offset time unit Δt, which can be understood as receiving the target BIS audio sent by the target display device after the period of time of N Δt.

The anchor point position is used to indicate the moment when the BIG of the target BIS audio reaches the display device, i.e. the starting moment of receiving the BIG. Specifically, the anchor point position may be determined according to the time when the display device receives the BIS channel identifier, the number of BIG offset time units and BIG offset units, and a preset offset duration.

As shown in fig. 10B, fig. 10B is a schematic time axis diagram of the anchor point shown in the embodiment of the disclosure, where (a) in fig. 10B includes a time T1 at which the display device receives the BIS channel identifier, a BIG offset time unit Δt, and a BIG offset unit number N, and the offset duration t2=n×Δt. From T1, T2, the anchor point position t3=t1+t2 can be determined.

Or (B) as in fig. 10B includes: when the display device receives the BIS channel identifier at the time T1, the BIG offset time unit Δt, the BIG offset unit number N, the offset duration t2=n×Δt, and the preset offset duration T4, the anchor point is located in the time range where [ T5, T6] is located, as shown in fig. 10B (B), where t5=t1+t2, t6=t5+t4.

In the above embodiment, the display device may be capable of synchronously receiving the target BIS audio sent by the target bluetooth device, where the target bluetooth device further needs to send a BIG offset time unit and a BIG offset unit number to the display device, so that after the display device receives the BIG offset time unit and the BIG offset unit number, determining a BIG offset duration according to the BIG offset time unit and the BIG offset unit number, and determining that the anchor point position of the first BIS audio packet in the received target audio is after the BIG offset duration, as shown in (a) in fig. 10B at time T3.

The display device can synchronously receive the target BIS audio sent by the target bluetooth device, and can also determine a BIG offset duration according to the BIG offset time unit and the BIG offset unit after the display device receives the BIG offset time unit and the BIG offset unit, and determine that the anchor point position of the first BIS audio packet in the received target audio is within the BIG offset duration according to the BIG offset duration and the preset offset duration, as in the time range [ T5, T6] in (B) of fig. 10B.

It can be understood that the target bluetooth device informs the display device to receive the target audio after receiving the BIS channel identifier after a period of time, where the period of time may be after the BIG offset period or within a preset offset period after the BIG offset period, so as to improve the fault tolerance of receiving and transmitting the target BIS audio, and ensure that the display device receives the complete and accurate target BIS audio.

In some embodiments, the target BIS audio is one of the BIS, after sending the robber indication, the display device receives the BIS number and the BIS index sent by the target bluetooth device, first compares the BIS number with a value corresponding to the BIS index, and determines that the received BIS index is correct if the value corresponding to the BIS index is less than or equal to the value corresponding to the BIS number, and further determines the location of the target BIS audio in the BIS. After receiving the BIS channel identification, monitoring a target BIS channel indicated by the BIS channel identification, and accurately receiving target BIS audio according to the position of the target BIS audio in the BIG.

For example, as shown in fig. 10C, fig. 10C is a schematic diagram of determining target BIS audio in the embodiment of the present disclosure, and the BIS shown in fig. 10C includes a plurality of BIS, and is respectively identified as BIS1, BIS2, BIS3, and BIS4 in fig. 10C. The number of BIS received by the display device is4, the number of BIS indexes is1, the number of BIS indexes is smaller than the number of BIS indexes, so that the BIS indexes can be determined to be correct, and the position of the target BIS audio in the BIG can be determined according to the BIS indexes. The target BIS audio is BIS2, i.e., the location of the second BIS in the BIG.

In other embodiments, to increase the rate of determining the target BIS audio, the display device may first receive the BIS index (e.g., 0, 1,2, 3) sent by the target Bluetooth device, and then determine the location of the target BIS audio in the BIG based on the BIS index (e.g., determine BIS2, i.e., the location of the second BIS in the BIG based on index 1).

Fig. 11 is a second flow chart of a BIS data transmission method according to an embodiment of the disclosure. The present embodiment is further extended and optimized based on the above embodiment, where one possible implementation of S703 is as follows:

s703a, sending a wheat-robbing success indication to the target Bluetooth device.

S703b, receiving BIS channel identification, code stream data, decoding information, BIG offset units and BIG offset unit numbers, BIS number and BIS index sent by the target Bluetooth device.

The BIS channel identifier is used for identifying a broadcast channel which the display device needs to monitor.

The code stream data comprises at least one of the following: sampling rate, frame interval, amount of data contained in each frame, data rate; the code stream data is used to instruct the display device to receive and process the BIS audio transmitted by the subsequent target terminal device.

The decoding information is used to decode BIS audio transmitted by the target Bluetooth device.

The BIG offset time unit and the BIG offset unit number are used for indicating the display device to offset after receiving the BIS channel identifier, and the offset duration is the BIG offset unit number N.

The BIS number and BIS index are used to indicate the location in BIG of the BIS audio transmitted by the target bluetooth device.

S703c, determining an anchor point position of the first BIS audio data packet received in the target BIS audio according to the BIG offset time unit and the BIG offset unit number; the position of the target BIS audio in the BIG is determined based on the BIS number and the BIS index.

The anchor point position is used for indicating the moment when the display device receives the target BIS audio, and is determined according to the moment when the display device receives the BIS channel identifier, the BIG offset time unit and the BIG offset unit number, and also can be determined according to the moment when the display device receives the BIS channel identifier, the BIG offset time unit and the BIG offset unit number, and the preset offset duration.

One possible implementation of S704 is as follows:

And S704a, monitoring a target BIS channel indicated by the BIS channel identification.

S704b, receiving first BIS audio sent by the target Bluetooth device through a target BIS channel;

Wherein the first BIS audio is encrypted.

S704c, decrypting the first BIS audio according to the decoding information to obtain decrypted target BIS audio;

s704d receives the target BIS audio according to the stream data, the anchor point position, and the position of the target BIS audio in the BIG.

Determining a mode of receiving the target BIS audio according to the code stream data, determining the moment of receiving the target BIS audio according to the anchor point position, and determining to accurately receive the target BIS from the BIG according to the position of the target BIS audio in the BIG.

The specific implementation of the above steps may refer to the foregoing embodiments, and are not described herein.

In the above embodiment, only the target BIS channel indicated by the BIS channel identifier needs to be monitored, so that the power consumption is reduced, and the bandwidth resources occupied by monitoring are reduced, so that more bandwidth resources are reserved for receiving the target BIS audio; in addition, the display device does not need to guide and monitor a plurality of channels, directly monitors the target BIS channels to acquire code stream data, decodes information, BIG offset units, BIS number and BIS index, thereby rapidly determining the time, position and receiving mode of receiving the target BIS audio, being beneficial to improving the receiving rate and improving the quality of the received target BIS audio, leading the display device to realize sound-picture synchronization and outputting audio with higher tone quality.

And S705, controlling the audio playing component to play the target BIS audio.

After the display equipment receives the target BIS audio sent by the target Bluetooth equipment, the audio playing component is controlled to play the target BIS audio, so that the requirement that a user corresponding to the target Bluetooth equipment expects the display equipment to output the target BIS audio is met, and the user experience is improved.

For example, along the schematic diagram of multi-path screen projection shown in fig. 9, the target bluetooth device is bluetooth device 901, and the multi-path screen projection data is displayed on the display screen in a split manner: screen shot data 911, screen shot data 912, screen shot data 913, and screen shot data 914. Further, the schematic diagram of multi-path screen projection shown in fig. 9 is further taken to fig. 12, and as shown in fig. 12, a second schematic diagram of multi-path screen projection provided in the embodiment of the present disclosure, the display device plays the target BIS audio sent by the bluetooth device 901, which is represented by that only the screen projection area C1 corresponding to the bluetooth device 901 has a picture output, and the target BIS audio corresponding to the picture displayed by the screen projection area C1 is output, and the screen projection areas C2, C3, and C4 corresponding to other bluetooth devices also output pictures, but no audio corresponding to the picture is output, and the display device is in a mute state.

In summary, according to the BIS audio transmission method provided by the present disclosure, first, the time of occurrence of wheat rescue sent by at least one bluetooth device is received, then, the target bluetooth device with the earliest time of occurrence of wheat rescue is determined from the at least one bluetooth device, after a successful wheat rescue instruction is sent to the target bluetooth device, the BIS channel identifier sent by the target bluetooth device is received, and the target BIS channel indicated by the BIS channel identifier is further monitored, so as to receive the target BIS audio, and then, the controller controls the audio playing component to play the target BIS audio. The display device interacts with at least one Bluetooth device, determines a target Bluetooth device from the interaction, receives BIS channel identifiers sent by the target Bluetooth device, monitors only target BIS channels corresponding to the target Bluetooth device, reduces bandwidth resources consumed by monitoring when acquiring mobile phone audio data through an interaction mode of Bluetooth broadcasting, receives the audio data through more remaining bandwidth resources, improves the rate and quality of receiving the audio data, and further improves the playing tone quality of the display device.

As shown in fig. 13, fig. 13 is a flowchart of another BIS data transmission method according to an embodiment of the present disclosure, where the method is applied to a display device, and the method includes steps S1301 to S1303:

s1301, sending the wheat-rushing occurrence time to the display equipment.

In some embodiments, referring to fig. 8, the bluetooth device triggers the sending of the time of the malting occurrence to the display device according to the operation of the user touching the "malting" control 801.

S1302, if a wheat-robbing success instruction sent by the display device is received, sending a BIS channel identifier to the display device.

In some embodiments, after receiving the indication of success of the wheat-cutting sent by the display device, the BIS channel identification, the code stream data, the decoding information, the bit offset units and the bit offset unit numbers, and the BIS number and the BIS index are sent to the display device.

And S1303, transmitting target BIS audio to the display device through the target BIS channel indicated by the BIS channel identification, so that the display device receives the target BIS audio by monitoring the target BIS channel indicated by the BIS channel identification.

The embodiments of the present disclosure provide a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements each process executed by the above BIS data transmission method, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.

The computer readable storage medium may be a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk.

The present disclosure provides a computer program product comprising a computer program which, when run on a computer, causes the computer to implement the above-mentioned BIS data transmission method.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The above discussion in some examples is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.