CN111541878A - Audio and video transmission method and device, computer equipment and storage medium - Google Patents

The application relates to an audio and video transmission method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring original data, wherein the original data comprises audio data of an audio acquisition device and/or video data of a video acquisition device; performing coding compression on the original data to generate coded data; and packaging the coded data by using a real-time streaming protocol, and pushing the packaged coded data to a network. According to the audio and video transmission method, the collected original audio and video data are compressed and coded, and the coded data are packaged by using a real-time stream transmission protocol and then are pushed to a network, so that not only is the real-time transmission of the audio and video data realized, but also the remote transmission is realized, and the application is convenient.

Audio and video transmission method and device, computer equipment and storage medium

Technical Field

The present invention relates to the field of audio and video transmission, and in particular, to an audio and video transmission method and apparatus, a computer device, and a storage medium.

Background

In recent years, with the development of display control technology, audio and video are applied to military commands, such as battle commands, training exercises, and monitoring of places of battle. The existing audio and video data acquisition and transmission mode is mainly local storage, or the data of an audio and video acquisition end is transmitted to a data processing platform in real time through a corresponding interface and a transmission line.

On one hand, the existing local storage mode cannot carry out real-time transmission, so that the timeliness is poor; on the other hand, the transmission line mode is adopted, although the purpose of real-time transmission can be achieved, the transmission distance is greatly limited by the data transmission line, and the flexibility is poor; therefore, there is a need for improvement of the existing audio-video transmission method.

Disclosure of Invention

In view of the foregoing, it is desirable to provide an audio/video transmission method, an apparatus, a computer device, and a storage medium, which are flexible and have good real-time performance.

According to an aspect of the present invention, there is provided an audio and video transmission method, the method including:

acquiring original data, wherein the original data comprises audio data of an audio acquisition device and/or video data of a video acquisition device;

performing coding compression on the original data to generate coded data;

and packaging the coded data by using a real-time streaming protocol, and pushing the packaged coded data to a network.

In one embodiment, the method further comprises:

judging whether the video data rotates or not;

and responding to the video data rotation, and performing forward reduction on the video direction of the rotated video data.

In one embodiment, the step of determining whether the video data is rotated includes:

acquiring a level signal of a display screen end of the video acquisition equipment and a processor connecting port;

and comparing the level signal with a preset level signal, and determining whether the video data rotates according to the comparison result.

In one embodiment, the step of performing encoding compression on the original data to generate encoded data includes:

code compressing the audio data according to the H.264 compression standard to generate coded audio data, and/or code compressing the video data according to the H.264 compression standard to generate coded video data;

and taking the encoded audio data and the encoded video data as the encoded data.

In one embodiment, the method further comprises:

acquiring temperature information and voltage information of current audio and video transmission;

and pushing the temperature information and the voltage information to a network.

According to another aspect of the present invention, there is provided an audio-video transmission apparatus, the apparatus including:

the hardware acquisition interface input processing module is used for connecting with audio and video acquisition equipment to acquire original audio and video data;

the audio and video coding module is used for coding and compressing the original audio and video data to generate coded data;

and the network interface output processing module is used for packaging the coded data by using a real-time stream transmission protocol and pushing the packaged coded data to a network.

In one embodiment, the apparatus further comprises:

the judging module is used for judging whether the video data rotate or not;

and the forward reduction module is used for performing forward reduction on the video direction of the rotating video data.

In one embodiment, the judging module includes a comparing module, and the comparing module is configured to compare a level signal of a display screen end of the video capture device and a connection port of the processor with a preset level signal, and determine whether the video data is rotated according to a comparison result.

According to an aspect of the present invention, there is provided a computer device comprising a memory storing a computer program and a processor implementing the steps of the method described above when the processor executes the computer program.

According to an aspect of the invention, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method described above.

According to the audio and video transmission method, the device, the computer equipment and the storage medium, the collected original audio and video data are compressed and coded, and then the coded data are packaged by using a real-time stream transmission protocol and then are pushed to a network, so that not only is the real-time transmission of the audio and video data realized, but also the remote transmission is realized, and the application is convenient.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.

Fig. 1 is a schematic flow chart of an audio and video transmission method in one embodiment;

fig. 2 is a schematic diagram of a hardware structure of audio-video transmission in another embodiment;

fig. 3 is a frame diagram of an audio-video transmission device in a further embodiment;

FIG. 4 is a diagram illustrating an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.

According to the concept of the present invention, in an embodiment, please refer to fig. 1, which provides an audio and video transmission method, specifically, the method includes the following steps:

s200, acquiring original data, wherein the original data comprises audio data of an audio acquisition device and/or video data of a video acquisition device.

The audio data and video capture device of the audio capture device may be an existing audio video device of VGA interface, BNC interface and MIC interface, for example, a data source captured in a 4K manner as original audio/video data.

S400, encoding and compressing the original data to generate encoded data;

s600, the coded data are packaged by utilizing a real-time stream transmission protocol, and the packaged coded data are pushed to a network.

The encapsulated coded data is encapsulated by a real-time stream transmission protocol Rtsp and then converted into a Serdes network signal. The network comprises an Ethernet or a local area network and the like, and then the user can recover and obtain the original audio and video data only by downloading corresponding data from the network and decoding.

According to the audio and video transmission method, the collected original audio and video data are compressed and coded, and then the coded data are packaged by using a real-time stream transmission protocol and then are pushed to a network, so that not only is the real-time transmission of the audio and video data realized, but also the remote transmission is realized, and the application is convenient.

In one embodiment, please refer to fig. 2, this embodiment uses an FPGA as a processor, for example, an audio signal and a video signal are input into the FPGA, an IP core of the FPGA sequentially performs encoding compression and Rtsp encapsulation on the audio signal and the video signal, and then transmits the audio signal and the video signal to a network in the form of a Serdes network signal, wherein before the step of encoding compression, the method further includes the following steps:

s310, judging whether the video data rotate or not;

specifically, the step of judging whether the audio/video rotates includes:

s311, acquiring a level signal of a display screen end of the video acquisition equipment and a connection port of the processor;

the level signal is compared with a preset level signal, and whether the video data is rotated or not is determined according to the comparison result.

Referring to fig. 2, in the implementation process, as an example, an FPGA is used as a processor, the FPGA reserves a GPIO interface to connect with a display screen of the video acquisition device, and identifies whether a signal image input on the current display screen rotates according to high and low levels of GPIO; assuming that the current image is rotated by 180 degrees, the level signal led by the current GPIO is at a high level, and at this time, the preset level signal is at a high level, so that it is determined that the current input at the display screen end is reversed.

And S320, responding to the rotation of the video data, and performing forward reduction on the video direction of the rotated video data.

According to the audio and video transmission method, whether the signal of the display screen section is turned over or not is detected before coding compression, the rotating video can be decoded forward and then coded, compressed and output, accuracy and integrity of video data transmitted to a network are guaranteed, and remote equipment can conveniently check and use the video data.

In another embodiment, the step S400 specifically includes the following steps:

s410, carrying out coding compression on the audio data according to the H.264 compression standard to generate coded audio data; and/or

And S420, carrying out coding compression on the video data according to the H.264 compression standard to generate coded video data.

In the specific implementation process, taking the FPGA as the processor as an example, the IP core of the FPGA can implement coding compression of data, specifically taking the FPGA with two HDMI video inputs as an example, the IP core configures and selects an interface of an input signal, and the IP core supports coding of the two HDMI video inputs. Similarly, the FPAG can also compress the encoding of the audio data. It should be noted that the audio data is not limited to be accessed in the form of HDMI, but may be input through other interfaces such as VGA interface, SEP interface, ricid, etc., and HDMI is only used for illustration. In addition, it is understood that the number of paths of the audio data and the video data is only used for illustration, and the implementer can properly adjust the number of paths according to the requirement in the implementation process.

S430, the encoded audio data and the encoded video data are treated as encoded data.

The audio and video transmission method is suitable for signal sources with different interface forms by respectively compressing and encoding the audio data and the video data, adopts the H.264 compression standard for encoding and compressing, and is convenient to transmit.

In yet another embodiment, the method of the present invention further comprises the steps of:

and S710, acquiring temperature information and voltage information of current audio and video transmission.

Referring to fig. 2, in order to ensure the completeness of the environment during the audio/video transmission process, an implementer may use a temperature acquisition device and a voltage acquisition device to connect to a Micro Control Unit (MCU),

and S720, pushing the temperature information and the voltage information to a network.

According to the audio and video transmission method, the micro-processing unit is configured to monitor the real temperature and voltage, and meanwhile, the network interface of the MCU is used for reporting the temperature and voltage information to the network, so that the remote monitoring of an operator is facilitated.

Referring to fig. 3, the present invention further provides an audio/video transmission device 90, and the audio transmission device specifically includes:

In another embodiment, the audio-video transmission device 90 further includes:

the judging module is used for judging whether the video data rotate or not;

specifically, the judging module comprises a comparing module, and the comparing module is used for comparing a level signal of a display screen end of the video acquisition device and a connection port of the processor with a preset level signal and determining whether the video data rotates or not according to a comparison result.

And the forward reduction module is used for performing forward reduction on the video direction of the rotating video data.

the audio coding module is used for coding and compressing the audio data according to the H.264 compression standard;

and the video coding module is used for coding and compressing the video data according to the H.264 compression standard.

In another embodiment, the audio-video transmission device further includes:

and the monitoring module is used for acquiring the temperature information and the voltage information of the current audio and video transmission and pushing the temperature information and the voltage information to a network.

According to another aspect of the present invention, a computer device is provided, and the computer device may be a server, and its internal structure is shown in fig. 4. The computer device includes a processor, a memory, a network interface, and a graphics database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a graphics database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The graphic database of the computer device is used for storing data. The network interface of the computer device is used for communicating with an external terminal through a network connection. Which computer program, when being executed by a processor, realizes the above-mentioned audio-video transmission method.

According to a further aspect of the present invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the audio-video transmission method described above.

It is to be understood that all embodiments, features and advantages set forth above with respect to the audio-visual transmission method according to the invention apply equally, without conflict with one another, to the computer device and to the storage medium according to the invention. That is, all embodiments of the audio-video transmission method described above and variations thereof may be directly transferred to and applied to the computer device and the storage medium according to the present invention, and directly incorporated therein. For the sake of brevity of the present disclosure, no repeated explanation is provided herein.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, a graphics database, or other media used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.