CN105126355A - Child companion robot and child companioning system - Google Patents

The invention provides a child companion robot and a child companioning system. The child companion robot comprises a speech input module, a touch input module, a voice output module and a display module. The speech input module extracts speech information of a user from surrounding voices of the child companion robot; the touch input module receives touch operations of the user through an interactive interface; the voice output module outputs response speeches responding to the speech information or feedback voices responding to the touch operations; the display module outputs the interactive interface or expression images matched with the speech information and the response speeches. The child companion robot and the child companioning system have the advantages that various operations of the user can be responded intelligently to provide good user experience, a companioning function of the child companion robot is achieved, and energy and time of patients for companioning children are saved.

Children accompany robot and children to accompany system

Technical field

The present invention relates to smart machine, particularly relate to a kind of children and accompany robot and children to accompany system.

Background technology

Preschool children are still incomplete due to intelligence and physical development, need adult to accompany for a long time and keep an eye on.And the sensitive periods that the ability development such as children still move in the stage, language is the fastest, its importance is self-evident.This just needs the head of a family to pay a large amount of energy and cost.But morning of the prior art teaching system, function singleness, mainly possesses the playing function of audio frequency, video, some early teaching system can be undertaken simple mutual by the mode of voice or touch-control, the requirement of company can not be reached far away.

Summary of the invention

An object of the present invention is to provide a kind of children to accompany robot and children to accompany system.

The present invention's further object to provide natural and tripping man-machine interaction experience.

Another further object of the present invention to be convenient to the study motion state that the head of a family understands children in time.

According to an aspect of the present invention, the invention provides a kind of children and accompany robot.These children accompany robot to comprise: phonetic entry assembly, are configured to accompany from children the voice messaging extracting user the sound of robot; Touch-control input module, is configured to the touch control operation being received user by interactive interface; Voice output assembly, is configured to export the reply voice of voice responsive information or the feedback sound of response touch control operation; And display module, be configured to export interactive interface or export the facial expression image mated with voice messaging and reply voice.

Alternatively, above-mentioned children accompany robot also to comprise: computation module, be connected respectively with phonetic entry assembly and touch-control input module, and be configured to: voice messaging or touch control operation are identified, to generate the first response signal of voice responsive information or touch control operation, export corresponding content for voice output assembly and display module according to the first response signal; And/or communications component, be connected respectively with phonetic entry assembly and touch-control input module, and be configured to: send voice messaging to cloud platform, for cloud platform, voice messaging identification is drawn to the second response signal of voice responsive information, and after reception second response signal, make voice output assembly and display module export corresponding content according to the second response signal.

Alternatively, above-mentioned children accompany robot also to comprise: voice recognition component, are configured to accompany from children the sound that identifies user the sound of robot and locate; Image recognition assembly, is configured to gather the image of surrounding environment, and according to the face image of the image recognition user of surrounding environment and motion state; And action executing assembly, be configured to perform the response sound of user and the action of motion state, when accompanying robot to call children user, drive children to accompany robot to move to user, realize the response personalized.

Alternatively, voice output assembly, display module, action executing assembly are also configured to respectively: perform remote control commands, remote control commands provides by cloud platform or with the terminal device that children accompany robot to bind.

According to another aspect of the present invention, additionally provide a kind of children and accompany system.These children system of accompanying comprises: above any one children introduced accompany robot.

Alternatively, above-mentioned children system of accompanying also comprises: cloud platform, be configured to receive the data of accompanying machine human hair to send by children, sends it back children accompany robot according to data genaration response signal.

Alternatively, cloud platform comprises: speech recognition component, is configured to identify that children accompany the voice of the user of robot; Semantic understanding assembly, is configured to carry out semantic understanding to the voice of user, to determine the intention of user; Speech production assembly, is configured to generate corresponding voice responsive according to the intention of user; Knowledge base assembly, is configured to store the knowledge base comprising encyclopaedic knowledge and educational resource, to generate the answer of problem in the intention for answering user; And media resource library component, be configured to storing multimedia resource storehouse, to provide corresponding content of multimedia according to the intention of user.

Alternatively, above-mentioned children system of accompanying also comprises: head of a family's terminal, accompanies robot data to be connected with children, and is configured to Long-distance Control children and accompanies robot to complete the instruction of the head of a family.

Alternatively, head of a family's terminal comprises: status poll assembly, be configured to: obtain the duty that children accompany robot, check for the head of a family, duty comprises following any one or multinomial content: robot motion, historical behavior record, position, electricity, network browsing record, memory space, use duration; Instant messaging assembly, is configured to: accompany robot to carry out instant messaging with children, communication mode comprise following any one or multiple: speech message, image information, real-time audio and video converse; Media play assembly, is configured to: accompany robot to push media file to children, and arranges the restrictive condition that children accompany robot broadcasting media file; Task pushes assembly, is configured to: receive the operation task of head of a family's input and be pushed to children and accompany robot, accompanying robot to complete operation task for children; And Control Component, be configured to accompany robot to carry out Long-distance Control to children, the project of control comprise following any one or multiple: volume, display brightness, action executing, dormancy shutdown, clock alarming, terminal authorization.

Children of the present invention accompany robot, utilize the voice messaging extracting user in phonetic entry assembly, touch-control input module is utilized to receive the touch control operation of user, to obtain the interactive information that user sends in several ways, children accompany robot to carry out intelligentized response to above voice messaging and touch control operation, sound feedback is exported by voice output assembly, display module output image is utilized to feed back, thus give user good experience, realize the company function that children accompany robot, save the head of a family at the energy and time of accompanying cost in children.

Further, children of the present invention accompany robot, utilize computation module and/or communications component generation in response to the response signal of user's information, guarantee that children accompany the input content of robot to meet the interactive requirements of user, meet human-subject test and the interest of preschool child.

Further, children of the present invention accompany robot, the sound and image that gather surrounding environment can also be configured with, to determine face image and the motion state of user, and utilize action executing assembly to perform the response sound of user and the action of motion state, when making user call children to accompany robot, drive children to accompany robot to move to user, realize the response personalized.

And children of the present invention accompany system, the artificial core of machine is accompanied with children, by cloud platform and head of a family's terminal, realize the functions such as long-distance education, multimedia, equipment control, instant messaging, education Robotics, Internet technology being applied to preschool child is kept an eye on, both saved the energy time of the head of a family, the use interest of accompanying target can have been improved again.

According to hereafter by reference to the accompanying drawings to the detailed description of the specific embodiment of the invention, those skilled in the art will understand above-mentioned and other objects, advantage and feature of the present invention more.

Accompanying drawing explanation

Hereinafter describe specific embodiments more of the present invention with reference to the accompanying drawings by way of example, and not by way of limitation in detail.Reference numeral identical in accompanying drawing denotes same or similar parts or part.It should be appreciated by those skilled in the art that these accompanying drawings may not be drawn in proportion.In accompanying drawing:

Fig. 1 is that children accompany the schematic architectural diagram of system according to an embodiment of the invention;

Fig. 2 is that children accompany the schematic diagram of robot according to an embodiment of the invention;

Fig. 3 is that children accompany the schematic diagram of robot according to another embodiment of the present invention;

Fig. 4 is that children accompany the schematic diagram of system medium cloud platform according to an embodiment of the invention; And

Fig. 5 is the schematic diagram of head of a family's terminal in children's company system according to an embodiment of the invention.

Detailed description of the invention

Fig. 1 is that children accompany the schematic architectural diagram of system according to an embodiment of the invention.These children system of accompanying can comprise in general manner: children accompany robot 100, cloud platform 200, head of a family's terminal 300, and wherein, children accompany robot 100 to be carried by use child or to be arranged in around it.Cloud platform 200 can carry out cloud computing to the data that children accompany robot 100 to upload, and provides corresponding Data support.Head of a family's terminal 300 is used by Parents, understands the running status that the real-time condition of children and children accompany robot 100, and accompany robot 100 to assign the instructions of the head of a family to children for the head of a family.Above children accompany robot 100, cloud platform 200, head of a family's terminal 300 can carry out data cube computation by network.

Fig. 2 is that children accompany the schematic diagram of robot 100 according to an embodiment of the invention, and these children accompany robot 100 can comprise in general manner: phonetic entry assembly 110, touch-control input module 120, voice output assembly 130, display module 140.

Phonetic entry assembly 110 can be configured to accompany from children the voice messaging extracting user the sound of robot 100 surrounding environment, such as phonetic entry assembly 110 can pass through microphone (being also called microphone or sound pick-up) and gather the sound that children accompany robot, such as can adopt two high definition microphone cooperating, and take noise reduction measure to suppress the noise of environment as far as possible.Children accompany robot 100 that speech recognition technology can be utilized to extract voice messaging.Utilize phonetic entry assembly 110 can obtain the voice operating of user.

Touch-control input module 120 is configured to the touch control operation being received user by interactive interface.Above interactive interface can utilize the screens such as touch screen to export, interactive interface can obtain come from user click, pull, the operation such as slip, these operations can correspond respectively to one or more function.Utilize touch-control input module 120 can receive the motion action of user.

Voice output assembly 130 is configured to export the reply voice of voice responsive information or the feedback sound of response touch control operation, and voice output assembly 130 can utilize the feedback sound such as the sound of the equipment such as audio frequency processing circuit, loudspeaker output voice, music, simulating nature.Display module 140 can be configured to export interactive interface or export the facial expression image mated with voice messaging and reply voice.The children of the present embodiment accompany robot 100 that voice output assembly 130 and display module 140 can be utilized to send sound and the image of response user current operation, meet the communication needs of user, the signal exported can be configured in conjunction with the cognition of Different age group children and characteristic of activities, meets the needs of different children.Thus give user good experience, realize the company function that children accompany robot.

Fig. 3 is that children accompany the schematic diagram of robot 100 according to another embodiment of the present invention, accompany on the basis of robot 100 the children of a upper embodiment, can also increase flexibly further arrange in computation module 150, communications component 160, voice recognition component 170, image recognition assembly 180, action executing assembly 190 one or more, to provide greater functionality.

Computation module 150 can be connected respectively with phonetic entry assembly 110 and touch-control input module 120, and voice messaging or touch control operation are identified, to generate the first response signal of voice responsive information or touch control operation, export corresponding content for voice output assembly 130 and display module 140 according to the first response signal.Computation module 150 can be trained the voice of user, obtains model of cognition, and utilizes this model of cognition to go out the voice of user from the voice recognition of surrounding environment.Computation module 150 to the training of the various facial expression image of children, can also obtain Expression Recognition model, for the expression identifying user from image in addition.

Communications component 160 is connected respectively with phonetic entry assembly 110 and touch-control input module 120, and send voice messaging to cloud platform 200, draw the second response signal of voice responsive information for the 200 pairs of voice messaging identifications of cloud platform, and after reception second response signal, make voice output assembly 130 and display module 140 export corresponding content according to the second response signal.Communications component 160 to be carried out the transmission of sound and view data by various communication, such as, can adopt the mode of the wireless-transmission networks such as Wi-Fi to carry out data transmission.

Computation module 150 and communications component 160 can configure simultaneously, also can select a configuration, utilize children to accompany the data computing capability self possessed of robot 100 and cloud computing resources to realize the generation of response signal respectively.

Voice recognition component 170 can be configured to accompany from children the sound that identifies user the sound of robot and locate.Image recognition assembly 180 is configured to gather the image of surrounding environment, and according to the face image of the image recognition user of surrounding environment and motion state.Voice recognition component 170 and image recognition assembly 180 can adopt mode identification technology to carry out sound and image procossing, obtain the information needed.

Action executing assembly 190 is configured to perform the response sound of user and the action of motion state, when accompanying robot 100 to call children user, drives children to accompany robot to move to user, realizes the response personalized.In a kind of optional embodiment, children accompany robot 100 that humanoid can be adopted to design, and multiple action actuating mechanism can respectively as the different parts such as four limbs, trunk, complete rotation, translation, all kinds of action such as flexible.Such as when determining that user calls children to accompany robot 100, children accompany robot 100 sound collection parts and image acquisition component can be arranged in the head that children accompany robot 100, following the motion of head, making detection side to can all the time towards as accompanying the user of target.

Action executing assembly 190 can utilize various servomotor, stepper motor and the transmission mechanism that coordinates with various motor to realize the various actions that children accompany robot 100.Such as, each shutdown place of robot 100 can be accompanied children, corresponding motion driving mechanism is set, to complete its predetermined action, as the rotation of head, the bending of limbs, children accompany advancing and turning to of robot 100 entirety.

The children of above-described embodiment accompany robot 100 can be provided with CPU (CentralProcessingUnit, central processing unit), memory, network communication module, camera, loudspeaker, microphone, motion sensor, ultrasonic sensing device, the parts such as touch screen.Wherein CPU and memory are used for accompanying the data of robot 100 to process and store to children, and can as a part for computation module 150; Camera, microphone, be respectively used to the acquisition function realizing image and sound, and can respectively as a part for voice recognition component 170 and image recognition assembly 180; Loudspeaker can as voice output assembly 130 at least partially, for realizing sound output function.Network communication module can as a part for communications component 160, to realize the communication function with cloud platform 200 and head of a family's terminal 300.Motion sensor and ultrasonic sensing device can as parts for action executing assembly 190; Touch screen can as the part touching input module.

Children accompany robot can also increase the positioning elements such as GPS (GlobalPositioningSystem, global positioning system) according to demand in addition, and for acquisition, children accompany the positional information of robot 100 and report to head of a family's terminal 300.

Children accompany robot 100 to utilize and realize a series of functions such as man-machine interaction, security monitoring, children education with upper-part.

When interactive, children accompany robot 100 can all the time towards user.In order to vivid and interesting more, children accompany robot 100 also to increase the control circuit of some expressions and limb action, such as, along with sound is opened one's mouth, blinks, shakes the head and rock health.

Children accompany robot 100 to complete interactive dialogue, and such as user flaps robot head, or when sending phonetic order as " telling a story to me ", voice output assembly 130 just can play the audio file of correspondence.

Children accompany robot 100 can also be provided with local human-computer interaction device.This local human-computer interaction device can obtain and simply arrange instruction, such as, start shooting, initialization etc.

Children accompany robot 100 can be preferred for nursing preschool children, and therefore its profile and housing need to adopt the material manufacture resisting beating property good, nontoxic, preferably can adopt the soft outer casing of lint class.

Children accompany robot 100 that cloud platform 200 and head of a family's terminal 300 can also be coordinated to realize intelligence and early teach function.The head of a family arranges learning tasks by head of a family's terminal 300 to child, child and children accompany robot 100 mutual, and complete learning tasks, the head of a family can receive feedback information, check the Task Progress of child at any time, send praise and incentive message by native system to child.Children accompany robot 100 can also complete the functions such as the statistical analysis of the study situation of child's entirety.Utilize these children to accompany robot 100, the head of a family can participate in the early education of child more easily.Even if the head of a family is not child at one's side, also can be long-range interactive with child, understand study situation, encourage child.

Fig. 4 is that children accompany the schematic diagram of system medium cloud platform 200 according to an embodiment of the invention, and this cloud platform 200 can comprise in general manner: speech recognition component 210, semantic understanding assembly 220, speech production assembly 230, knowledge base assembly 240, media resource library component 250.Utilize these parts, the functions such as cloud platform 200 can realize cloud computing, data provide.

Speech recognition component 210 can be configured to identify that children accompany the voice of the user of robot.Semantic understanding assembly 220 can be configured to carry out semantic understanding to the voice of user, to determine the intention of user.Speech production assembly 230 can be configured to generate corresponding voice responsive according to the intention of user.Thus the computing capability utilizing cloud platform 200 powerful, assisting child accompanies robot 100 to complete the speech exchange function with user.

Below the optional flow process of one that cloud platform 200 processes the sound that children accompany robot 100 to upload: receive and come from the voice signal that children accompany robot 100, through speech recognition (AutomaticSpeechRecognition, be called for short ASR) module, change into word, again through semantic understanding module, change into the instruction (such as " calling father ") that robot can perform, or the content play (such as one first nursery rhymes), returns to children and accompanies robot 100.The voice interactive function of cloud platform 200, comprises speech recognition and semantic understanding, take into account the feature of children's pronunciation and language, can carry out special customization and optimization for children.

Knowledge base assembly 240 can be configured to store the knowledge base comprising encyclopaedic knowledge and educational resource, to generate the answer of problem in the intention for answering user; Media resource library component 250 can be configured to storing multimedia resource storehouse, to provide corresponding content of multimedia according to the intention of user.Knowledge base assembly 240 and media resource library component 250 can accompany the Data support of robot 100 as children.

Cloud platform 200 can store every data that children accompany robot 100, and to the education educational resource data that children accompany robot 100 to provide corresponding, accompanies robot 100 to play to company target 100 for children.Thus utilize the storage capacity of cloud platform 200 magnanimity to realize data to provide and management function.Cloud platform 200 utilizes knowledge base assembly 240 and media resource library component 250 can provide rich content service, comprises the talking book such as story, nursery rhymes, daily initiation knowledge base, language arithmetic teaching content etc.These contents are all the lane databases being stored in cloud platform 200.Cloud platform 200 accompanies the information of robot 100 (as input information, files on each of customers, historical record etc.) to accompany robot 100 to provide suitable to children according to the children of its record or acquisition, high-quality content.Cloud platform 200 can also excavate new content from internet, automatically to upgrade content data base.

Cloud platform 200 can also possess subscriber management function, can record the information that children accompany robot 100 and user thereof, such as, can comprise child's name, the age, sex, hobby, family's long message etc.What children accompanied robot 100 to gather arrives usage behavior record, also will upload in the background data base of cloud platform 200, to carry out the training of analysis and various model of cognition.Children accompany the historical record of robot 100 operations also can be stored in cloud platform 200 in addition.Such as head of a family's terminal 300 and children accompany the intersection record of robot 100, switching on and shutting down time, content are play to record etc. and all can be preserved in cloud platform 200.

Head of a family's terminal 300 and children accompany robot 100 data cube computation, and are configured to Long-distance Control children and accompany robot 100 to complete the instruction of the head of a family.Head of a family's terminal 300 can be the electronic equipment that the heads of a family such as all kinds of personal computer (PC), smart mobile phone, panel computer use.It can realize a series of functions such as initial information setting, equipment state management, Content Management, behavior monitoring, position acquisition, member management.

Fig. 5 is the schematic diagram of head of a family's terminal 300 in children's company system according to an embodiment of the invention, and head of a family's terminal 300 can be provided with flexibly: status poll assembly 310, instant messaging assembly 320, media play assembly 330, task push assembly 340, Control Component 350.

Status poll assembly 310 can be configured to: obtain the duty that children accompany robot 100, check for the head of a family, duty comprises following any one or multinomial content: robot motion, historical behavior record, position, electricity, network browsing record, memory space, use duration.Head of a family's terminal 300 is when carrying out equipment state management, the various status datas coming from child custody robot and upload can be received, such as head of a family's terminal 300 can obtain the electricity of robot, uses the status datas such as duration, can also realize the Long-distance Control of remote on-off.

Instant messaging assembly 320 can be configured to: accompany robot 100 to carry out instant messaging with children, communication mode comprise following any one or multiple: speech message, image information, real-time audio and video converse;

Media play assembly 330 can be configured to: accompany robot 100 to push media file to children, and arranges children and accompany robot 100 to play the restrictive condition of media file.Head of a family's terminal 300, when carrying out Content Management, can increase newly, deletes the content such as song, story, picture stored in child custody robot.

Task pushes assembly 340 and can be configured to: receive the operation task of head of a family's input and be pushed to children and accompany robot 100, accompanying robot 100 to complete operation task for children;

Control Component 350 can be configured to accompany robot 100 to carry out Long-distance Control to children, the project of control comprise following any one or multiple: volume, display brightness, action executing, dormancy shutdown, clock alarming, terminal authorization.

In addition, head of a family's terminal 300, when carrying out initial information setting, can also obtain the head of a family and input the name of child, age-sex's (contributing to personalized recommendation learning content), family's long message, also has the options such as communication connection password.

Head of a family's terminal 300 is when carrying out behavior monitoring, and can also check the time that children accompany robot 100 and use, the period distributes, the ratio of study/amusement, the hobby in field, study schedule etc.

Head of a family's terminal 300 is when carrying out member management, and head of a family's terminal 300 that other kinsfolks can be used also joins children and accompanies in the communication target of robot 100, and line pipe of going forward side by side is managed.Such as invite other heads of a family to add, and chat is set respectively, the authority of interactive game, layout learning tasks.

Head of a family's terminal 300 can also remote opening or close children accompany the GPS of robot 100 to locate, camera, the parts such as microphone, to start or stop the correlation function that children accompany robot 100.

Children accompany robot 100 can by head of a family's terminal 300 remote control opener, or residing for it, some condition of environment triggers and opens, and sends the audiovideo and positional information that collect to background service and head of a family's terminal 300 in real time.

Utilize the children of the present embodiment to accompany system, children accompany robot 100 can also realize carrying out the communication functions such as real-time phonetic message communicating, real-time voice call and video calling with head of a family's terminal 300.The head of a family can understand child by head of a family's terminal 300 and use children to accompany the state of robot 100, comprises control children and accompanies robot 100 to take pictures, recorded voice, capture video.

Children accompany robot 100 can detect the sob/laugh of child, if environment is caused danger residing for child, can send warning reminding to head of a family's terminal 300.When child's study/amusement, children accompany robot 100 according to the sound of child, and the information such as expression can record splendid moment automatically, and with photo, sound, the form of video is preserved.

The children of the present embodiment accompany robot and children system of accompanying Robotics, Internet technology to be applied to the company of preschool child, intelligently respond various action and the state of user, give the experience that user is good, realize the company function that children accompany robot, save the head of a family at the energy and time of accompanying cost in children.

So far, those skilled in the art will recognize that, although multiple exemplary embodiment of the present invention is illustrate and described herein detailed, but, without departing from the spirit and scope of the present invention, still can directly determine or derive other modification many or amendment of meeting the principle of the invention according to content disclosed by the invention.Therefore, scope of the present invention should be understood and regard as and cover all these other modification or amendments.