CN103095813A - Voice interaction system, mobile terminal device and voice communication method - Google Patents

A voice interaction system, a mobile terminal device and a voice communication method are provided. The mobile terminal device is suitable for communicating with a cloud server and comprises a voice system, a communication module and a processing unit, wherein the processing unit is coupled with the communication module and the voice system. The communication module transmits the first voice signal to the cloud server, and the cloud server analyzes a communication target and a communication instruction according to the first voice signal. The processing unit receives the communication target and searches an address book located in the mobile terminal device according to the communication target to obtain a selection list conforming to the communication target. When the voice system receives the second voice signal, the communication module simultaneously transmits the second voice signal and the selection list to the cloud server to generate a selection target. The processing unit receives and executes the communication instruction and the selected target.

The method of voice interactive system, mobile terminal apparatus and voice communication

Technical field

The present invention relates to a kind of technology of speech control, and be particularly related to a kind of method of voice interactive system, mobile terminal apparatus and voice communication.

Background technology

Along with the development of science and technology, the mobile terminal apparatus with voice system is day by day universal.Above-mentioned voice system is by the speech understanding technology, allows user and mobile terminal apparatus link up.For instance, the user is as long as tell a certain requirement to above-mentioned mobile terminal apparatus, and such as wanting to look into train number, look into weather or want to call etc., system just can according to user's voice signal, take corresponding action.Above-mentioned action may be answer user's problem or move according to the system that user's instruction goes to order about mobile terminal apparatus with voice mode.

Yet, in the technical development process of voice system, but face some problems and need to be resolved hurrily.Such as: voice are in conjunction with the Information Security of cloud server, the problems such as convenience that voice system starts.

With the Information Security of voice in conjunction with cloud server, be with the concept of voice interactive system in conjunction with the high in the clouds technology at present, with complicated and need the speech processes process of powerful operational capability support to transfer to cloud server to carry out.Mode although it is so can significantly reduce the cost of the required configure hardware of mobile terminal apparatus.But, converse, pass the action such as news in brief for needs by address list, due to need by upload address list to the cloud server looking for conversation or to pass the object of news in brief, so maintaining secrecy of address list will be an important subject under discussion.Although cloud server can adopt the encryption line, and the mode of taking instant biography, not preserving, be difficult to eliminate the user to the worry of the above-mentioned practice.

On the other hand, with the convenience that voice system starts, be mostly at present that its shown application program of screen of triggering mobile terminals device starts, perhaps start by the set physical button of mobile terminal apparatus.Above-mentioned design all must start by mobile terminal apparatus itself, but in some occasion, above-mentioned design is but suitable inconvenience.Such as: during the road, and mobile terminal apparatus is placed in pocket or handbag, when perhaps cooking in the kitchen, need to dial the mobile phone that is positioned at the parlor, can't touch immediately mobile terminal apparatus with users such as inquiry friend recipe details, but the situation that voice system is opened.

In addition, the sound amplification function in mobile terminal apparatus equally also has similar problem.Although the user can pass through the finger manipulation mobile phone at present, or hold mobile phone mobile phone is pressed close to ear to start sound amplification function with one hand.But when the user can't touch mobile terminal apparatus immediately, but need make sound amplification function the time, the design that needs at present start by mobile terminal apparatus itself will cause user's inconvenience.

Therefore, how to improve these above-mentioned shortcomings, become the subject under discussion that needs to be resolved hurrily.

Summary of the invention

The invention provides a kind of method of voice interactive system, mobile terminal apparatus and voice communication, voice service can be provided more quickly.

The present invention proposes a kind of voice interactive system, and this voice interactive system comprises a mobile terminal apparatus and a cloud server.Above-mentioned mobile terminal apparatus comprises a voice system, a communication module and a processing unit.Above-mentioned voice system receives respectively the first voice signal and the second voice signal.Above-mentioned communication module transmits respectively the first voice signal and the second voice signal.Above-mentioned processing unit couples communication module and voice system.Communication module transmits the first voice signal to cloud server, and cloud server parses communication target and communication instruction according to the first voice signal.Processing unit received communication target, and be positioned at an address list of mobile terminal apparatus according to the communication target search, to obtain to meet a selective listing of communication target.When voice system receives the second voice signal, by communication module transmit simultaneously the second voice signal and selective listing to cloud server to produce a select target.Processing unit receives and executive communication instruction and select target.

A kind of mobile terminal apparatus of the another proposition of the present invention, a suitable and cloud server is linked up, and this mobile terminal apparatus comprises a voice system, a communication module and a processing unit, and above-mentioned processing unit couples communication module and voice system.Communication module transmits the first voice signal to cloud server, and cloud server parses communication target and communication instruction according to the first voice signal.Processing unit received communication target, and be positioned at an address list of mobile terminal apparatus according to the communication target search, to obtain to meet a selective listing of communication target.When voice system receives the second voice signal, by communication module transmit simultaneously the second voice signal and selective listing to cloud server to produce a select target.Processing unit receives and executive communication instruction and select target.

The present invention proposes a kind of method of voice communication, is used for a mobile terminal apparatus.The method system first receives one first voice signal, and transmits this first voice signal to a cloud server.Then, receive from cloud server a communication target that parses from the first voice signal.Then, according to the address list in communication target search mobile terminal apparatus, to obtain to meet a selective listing of communication target.Afterwards, receive one second voice signal, transmit simultaneously the second voice signal and selective listing to cloud server.Receive and carry out a communication instruction and a select target from cloud server.。

Based on above-mentioned, the present invention improves the quality of voice service by simultaneously selective listing and corresponding selection being sent to the mode of cloud server.

For above-mentioned feature and advantage of the present invention can be become apparent, embodiment cited below particularly, and coordinate accompanying drawing to be described in detail below.

Description of drawings

Fig. 1 is the calcspar of the speech control system that illustrates according to one embodiment of the invention.

Fig. 2 is the calcspar of the speech control system that illustrates according to another embodiment of the present invention.

Fig. 3 is the flow chart of the speech control method that illustrates according to one embodiment of the invention.

Fig. 4 is the calcspar according to the voice interactive system of one embodiment of the invention.

Fig. 5 is the schematic diagram according to the voice communication flow process that is used for voice interactive system of one embodiment of the invention.

Fig. 6 is the system schematic according to the mobile terminal apparatus of one embodiment of the invention.

Fig. 7 is the flow chart according to the automatic starting method of the conversation sound amplification function of the mobile terminal apparatus of one embodiment of the invention.

[main element symbol description]

100,200: speech control system

110: auxiliary actuating apparatus

112,122: wireless transport module

114: trigger module

116: wireless charging battery

1162: battery unit

1164: wireless charging module

120,220,420: mobile terminal apparatus

121,426: voice system

124,610: the speech sample module

126: voice synthetic module

127: the voice output interface

128,424: communication module

130,410:(high in the clouds) server

132: the speech understanding module

1322: voice identification module

1324: speech processing module

400: voice interactive system

412,422,660: processing unit

414: communication module

428: memory cell

429: address list

330: display unit

620: input unit

630: pull and connect the unit

640: receiver

650: public address equipment

670: earphone

S302 ~ S312, S501 ~ S519, S710 ~ S770: step

DRC: conversation receive data

DTC: conversation transmits data

SAI: input audio signal

SAO: output audio signal

SIO: input operation signal

Embodiment

Although mobile terminal apparatus now can provide voice system, link up with mobile terminal apparatus to allow the user send voice, the user still must start by mobile terminal apparatus itself when starting this voice system.Therefore can't touch immediately mobile terminal apparatus the user, but the situation that voice system is opened often can't satisfy user's demand immediately.For this reason, the present invention proposes device and the corresponding method thereof that a kind of assistant voice system opens, and allows user opening voice system more easily.In order to make content of the present invention more clear, below the example that really can implement according to this as the present invention especially exemplified by embodiment.

In addition, the body of above-mentioned auxiliary actuating apparatus 110 can be the articles for use that the user can reach conveniently, ornaments such as ring, wrist-watch, earrings, necklace, glasses, be various Portable article, or installation component, for example for being disposed at the driving accessory on steering wheel, be not limited to above-mentioned.That is to say, auxiliary actuating apparatus 110 is the device of " life-stylize ", by the setting of built-in system, allows the user can touch easily trigger module 114, with the opening voice system.For instance, when the body of auxiliary actuating apparatus 110 was ring, user's moveable finger trigger module 114 of pressing ring easily was triggered it.On the other hand, the body when auxiliary actuating apparatus 110 is that when being disposed at the device of driving accessory, the user also can trigger the trigger module 114 of driving accessory device during the road easily.In addition, compared to the discomfort of wearing earphone/and listening/converse, use the application's auxiliary actuating apparatus 110 voice system in mobile terminal apparatus 120 can be opened, even and then open sound amplification function (then will describe in detail), make the user need not wear earphone/, still can directly listen/converse by mobile terminal apparatus 120.In addition, for the user, the article of auxiliary actuating apparatus 110 for originally wearing or use of these " life-stylizes " therefore do not have in the use the uncomfortable or problem of discomfort, namely do not need the adaptation of taking time.For instance, when the user cooks in the kitchen, in the time of need to dialing the mobile phone that is positioned over the parlor, suppose its wear have ring, the auxiliary actuating apparatus of the present invention 110 of necklace or wrist-watch body, just can touch ring, necklace or wrist-watch with the opening voice system with inquiry friend recipe details.Also can reach above-mentioned purpose although partly have at present the earphone/of start-up performance, but in the process of at every turn cooking, be not all to need to call to consult the friend at every turn, therefore for the user, wear at any time earphone/and cook, can say suitable inconvenience in order to controlling mobile terminal apparatus at any time.

The method that the above-mentioned speech control system 100 plain language sounds of below namely arranging in pairs or groups are controlled.Fig. 3 is the flow chart of the speech control method that illustrates according to one embodiment of the invention.Please be simultaneously with reference to Fig. 1 and Fig. 3, in step 302, auxiliary actuating apparatus 110 sends wireless signal transmission to mobile terminal apparatus 120.Detailed explanation is that when the first wireless transport module 112 of auxiliary actuating apparatus 110 was triggered because receiving a triggering signal, this auxiliary actuating apparatus 110 can send wireless signal transmission to mobile terminal apparatus 120.Particularly, when the trigger module 114 in auxiliary actuating apparatus 110 is pressed by the user, this moment, trigger module 114 meetings be triggered because of triggering signal, and make the first wireless transport module 112 send wireless signal transmission to the second wireless transport module 122 of mobile terminal apparatus 120, use making the first wireless transport module 112 link by wireless communication protocol and the second wireless transport module 122.Above-mentioned auxiliary actuating apparatus 110 only is used for opening the voice system of mobile terminal apparatus 120, does not have the function of listening/conversing, therefore inner circuit design can be simplified, cost is also lower.In other words, for the additional hands-free headsets/microphone of general mobile terminal apparatus 120, auxiliary actuating apparatus 110 is another devices, and namely the user may possess earphone/and the application's of hand-free auxiliary actuating apparatus 110 simultaneously.

The above-mentioned Fig. 4 that below namely arranges in pairs or groups is illustrated in the exchange of speech flow process of voice interactive system.

For instance, shown in table 1, search the contact information that meets communication target " Lao Wang " in address list under selective listing for example.In this example, suppose the contact information that finds 4 to meet, and with the coordinator's title in contact information, namely " Wang Congming ", " king five ", " Wang Anshi " and " Wang Wei ", write in selective listing.

Table 1

After mobile terminal apparatus 420 received communication instruction and select target, in step S519, mobile terminal apparatus 420 was by 422 pairs of select targets of its processing unit, the communication operation that the executive communication instruction is corresponding.Above-mentioned communication instruction is such as needing to use the instruction of this address list content for dialing instruction or citation instruction etc., and communication instruction is to be obtained based on the first voice signal by cloud server 410.For example, the content of supposing the first voice signal is " phoning Lao Wang ", and cloud server 410 is judged communication instruction and is the dialing instruction by " making a phone call ".Again for example, suppose that the content of the first voice signal is " passing news in brief to Lao Wang ", cloud server 410 is judged communication instruction for summoning instruction by " biography news in brief ".In addition, above-mentioned select target is based on the second voice signal and selective listing and obtain by cloud server 410.Take the selective listing shown in above-mentioned table 1 as example, the content of supposing the second voice signal is " the 3rd ", and cloud server 410 just can be judged select target and is " Wang Anshi ".For example, call to select target, or start a citation interface, to transmit news in brief to select target.

In sum, the application's utilization is uploaded simultaneously mode to the cloud server with powerful operational capability of selective listing that the first voice produce, select target that the second voice signal produces and is carried out speech understanding program, and this selective listing only comprises the address list of part.Therefore, the application's speech control system can be possessed higher treatment efficiency and better fail safe simultaneously.

On the other hand, although it should be noted that above-mentioned auxiliary actuating apparatus has solved the user and can't touch immediately mobile terminal apparatus, need to use the problem of voice system, make the user can pass through the speech understanding technology, allow user and mobile terminal apparatus carry out question and answer.Yet, for the situation that needs public address system to open, need be still to start expansion by mobile terminal apparatus itself at present, therefore can't satisfy user's demand immediately.For this reason, the present invention proposes a kind of method and corresponding device thereof of opening public address system, allows the user can open more easily public address system.In order to make content of the present invention more clear, below the example that really can implement according to this as the present invention especially exemplified by embodiment.

On the other hand, although it should be noted that above-mentioned auxiliary actuating apparatus has solved the user and can't touch immediately mobile terminal apparatus, need to use the voice system problem, make the user can pass through the speech understanding technology, allow user and mobile terminal apparatus carry out question and answer.Yet, for the situation that needs sound amplification function to open, still need at present to start sound amplification function by mobile terminal apparatus itself, when the user can't touch mobile terminal apparatus immediately, but in the time of need making sound amplification function, the design that needs at present to start by mobile terminal apparatus itself will cause user's inconvenience.For this reason, the present invention proposes a kind of method and corresponding device thereof of opening sound amplification function, allows the user can open more easily sound amplification function.In order to make content of the present invention more clear, below the example that really can implement according to this as the present invention especially exemplified by embodiment.

Fig. 6 is the system schematic according to the mobile terminal apparatus of one embodiment of the invention.Please refer to Fig. 6, in the present embodiment, mobile terminal apparatus 600 comprises voice system, input unit 620, pulls and connects unit 630, receiver 640, public address equipment 650 and processing unit 660.In another embodiment of the present invention, mobile terminal apparatus 600 also can comprise earphone 670.Mobile terminal apparatus 600 can be mobile phone or other similar electronic installations, and it is similar to the mobile terminal apparatus 120 of Fig. 1, and its detailed content can with reference to aforementioned content, not repeat them here.Processing unit 660 couples speech sample module 610, input unit 620, pulls and connects unit 630, receiver 640, public address equipment 650, earphone 670.Voice system comprises speech sample module 610, and this speech sample module 610 is converted to input speech signal SAI with sound, and above-mentioned speech sample module 610 can be microphone or similar electronic component.In other words, speech sample module 610 can be considered the part of voice system, and this described voice system is similar to the voice system 121 of Fig. 1, and its detailed content can with reference to aforementioned content, not repeat them here.Input unit 620 corresponding users' operation provides input operation signal SIO, and input unit 620 can be keyboard, contact panel or similar electronic component.Pull and connect unit 630 and pull and connect function in order to be controlled by processing unit 660 execution.Receiver 640, public address equipment 650, earphone 670 are converted to sound in order to the output voice signal SAO that processing unit 660 is provided, therefore can be considered the voice output interface.Above-mentioned public address equipment 650 is such as being loud speaker etc.Above-mentioned earphone 670 can be wired earphone and wireless headset at least one of them.

As from the foregoing, the physical button that the unlatching of phonetic function can be by pressing mobile communications device, control screen or utilize auxiliary actuating apparatus of the present invention.In the situation that the hypothesis phonetic function is opened, when the user talks facing to mobile terminal apparatus 600, sound can be converted to input speech signal SAI by speech sample module 610, processing unit 660 can be according to input speech signal SAI, when carrying out content matching for information such as the coordinator's title in address list or telephone numbers, when the information in address list conforms to input speech signal SAI, 660 of processing units can open pull and connect unit 630 pull and connect function and public address equipment 650, so that after connecting, the user can with coordinator's conversation.Detailed explanation is that processing unit 660 can be converted to input speech signal SAI one input word string, and will input the information such as a plurality of coordinator's titles in word string and address list, a plurality of telephone numbers relatively.When the input word string met one of them of the information such as these coordinator's titles, these telephone numbers, processing unit 660 was opened the function of pulling and connecting of pulling and connecting unit 630.On the contrary, when the input word string did not meet these coordinator's titles and these telephone numbers, processing unit 660 was not opened the function of pulling and connecting of pulling and connecting unit 630.

It is worth mentioning that, in the mode of present startup sound amplification function, be still and adopt the mode that starts by mobile terminal apparatus itself to carry out, can't touch immediately mobile terminal apparatus but work as the user, in the time of but need using sound amplification function, present design will cause user's inconvenience.So in the present embodiment, in the situation that voice system opens, sound amplification function is further opened in the action that can pull and connect by voice, is user-friendly for conversation.

For instance, when the user says " phoning Lao Wang " facing to mobile terminal apparatus, after speech sample module 610 receives these sound at this moment, it is changed into input speech signal SAI, and this input speech signal SAI is by the parsing of speech understanding module, (for example: Lao Wang), and and then (for example: Wang Anshi) obtain select target obtain communication instruction (for example: make a phone call) and communication target.Owing to being the communication instruction of resolving from " voice ", therefore processing unit 660 automatic liftings are opened public address equipment 650 for enabling signal, in order to the follow-up conversation that amplifies.That is to say, when pull and connect the unit complete pull and connect after, the user can utilize public address equipment directly to talk with Lao Wang.Perhaps, in another example, when the user says facing to mobile terminal apparatus " answer the call ", after speech sample module 610 receives these sound at this moment, it is changed into input speech signal SAI, and this input speech signal SAI obtains communication instruction (as: answering the call) by the parsing of speech understanding module.Owing to being the communication instruction of resolving from " voice ", therefore processing unit 660 automatic liftings are opened public address equipment 650 for enabling signal, can utilize public address equipment directly and the Lao Wang dialogue in order to the user.Embodiment about configuration mode and the correlative detail of above-mentioned speech understanding module has been described in the front does not repeat them here.In addition, about communication target and last resulting select target, its execution mode can be taked aforementioned method or other the similar methods of utilizing cloud server, does not repeat them here.Certainly, as mentioned above, in public address equipment 650 and earphone 670 and the situation of depositing, processing unit 660 can be according to user's setting, and making earphone 670 conversations is the first preferential talking mode, and public address equipment 650 is the second preferential talking mode.

Then, in step S720, judge whether processing unit 660 receives the input speech signal SAI that pulls and connects function in order to unlatching.When processing unit 660 receive from speech sample module 610 pull and connect the input speech signal SAI of function in order to unlatching the time, that is step S720 judgment result is that "Yes", can Check processing unit 660 whether be connected (step S730) with earphone 670.When processing unit 660 is connected with earphone 670, that is step S730 judgment result is that "Yes", processing unit 660 automatic liftings for enabling signals starting earphone, and output audio signal SAO is to earphone 670(step S740); Otherwise, when processing unit 660 is not connected with earphone 670, that is step S730 judgment result is that "No", processing unit 660 automatic liftings supply enabling signal to start public address equipment 650, and output voice signal SAO is to the public address equipment 650 of mobile terminal apparatus 600, to open the conversation sound amplification function (step S750) of mobile terminal apparatus 600.It is worth mentioning that, when processing unit 660 receives when pulling and connecting the input speech signal of function in order to unlatching, above-mentioned step 730 ~ step 750 is in the situation that the user is set as preferential voice output interface (suppose all lines of public address equipment 650 and earphone 670) with earphone 670 carries out.In other embodiments, the user also can be set as public address equipment 650 preferential voice output interface.Certainly, when earphone 670 and public address equipment 650 only have one of them line, can set equipment on line as preferential voice output interface.Above-mentioned implementation step is to know the operator can do corresponding change according to its demand.

On the other hand, when processing unit 660 do not receive from speech sample module 610 pull and connect the input speech signal SAI of function in order to unlatching the time, that is step S720 judgment result is that "No", can follow Check processing unit 660 and whether be connected (step S760) with earphone 670.Specifically, processing unit 660 does not receive the input speech signal SAI from speech sample module 610, but processing unit is pulled and connected function with unlatching again, and expression processing unit 660 receives the input operation signal SIO from input unit 620, and this input operation signal SIO and pull and connect move relevant.When processing unit 660 is connected with earphone 670, that is step S760 judgment result is that "Yes", processing unit 660 can automatic liftings for enabling signals starting earphone 670, and output voice signal SAO is to earphone 670(step S740).Otherwise, when processing unit 660 is not connected with earphone 670, that is step S760 judgment result is that "No", processing unit 660 provides output voice signal SAO one of them (step S770) to public address equipment and receiver according to preset values.Wherein, the order of above-mentioned steps is the use as explanation, and the embodiment of the present invention is not as limit.It is worth mentioning that, when step 760 is judged as " be ", will provide output audio signal SAO to earphone 670, above-mentioned condition is set as earphone 670 situation of preferential voice output interface (supposing all lines of receiver 640, public address equipment 650, earphone 670) for the user.In other embodiments, the user also can be set as preferential voice output interface with receiver 640 or public address equipment 650.Certainly, at receiver 640, public address equipment 650, when earphone 670 equipment only have one of them line, can set equipment on line as preferential voice output interface.Above-mentioned implementation step is to know the operator can do corresponding change according to its demand.

In sum, the automatic starting method of the mobile terminal apparatus of the embodiment of the present invention and conversation sound amplification function thereof, when the processing unit reception is pulled and connected the input speech signal of function in order to unlatching, pull and connect function except opening, more can automatically open sound amplification function, will export voice signal to public address equipment.Thus, when the user can't touch mobile terminal apparatus immediately, but sound amplification function need be made the time, can start sound amplification function by voice system, to improve the ease of use of mobile terminal.

Although the present invention with embodiment openly as above; so it is not to limit the present invention; those skilled in the art when doing a little change and retouching, are as the criterion therefore protection scope of the present invention ought be looked the appended claims confining spectrum without departing from the spirit and scope of the present invention.