CN107168085B - Intelligent household equipment remote control method, device, medium and computing equipment - Google Patents

Detailed Description

In order to enable a user to visually know the on-site environment information of the intelligent household equipment and save the expenditure of resources of the intelligent household equipment, the embodiment of the invention provides a remote control method, a remote control device, a remote control medium and computing equipment of the intelligent household equipment.

The preferred embodiments of the present invention will be described below with reference to the accompanying drawings of the specification, it being understood that the preferred embodiments described herein are merely for illustrating and explaining the present invention, and are not intended to limit the present invention, and that the embodiments and features of the embodiments in the present invention may be combined with each other without conflict.

In specific implementation, the user 10 sends a registration request to the smart home server through the smart home control client to obtain a user identifier, where the user identifier may be a mobile phone number of the user or a user name, and the like. After the user 10 successfully registers and obtains the user identifier, the smart camera identifier, and the smart home device identifier need to be bound.

Preferably, after the user successfully logs in the smart home server by using the registered user identifier, the user may enter the smart home device identifier binding page, and sequentially bind the smart camera identifier and each smart home device, for example, the user may input the smart home device identifier to be bound on the binding page and submit the smart home device identifier to the server for smart home device binding, or obtain the identifier of the smart home device by scanning a two-dimensional code or the like on the smart camera or the smart home device and submit the identifier to the smart server, which is not limited in the embodiment of the present invention.

In the following, with reference to fig. 2, a method for remotely controlling smart home devices according to an embodiment of the present invention is described with reference to an application scenario of fig. 1. It should be noted that, the above-mentioned remote control method using smart home devices. It should be noted that the above application scenarios are merely illustrated for the convenience of understanding the spirit and principles of the present invention, and the embodiments of the present invention are not limited in this respect. Rather, embodiments of the present invention may be applied to any scenario where applicable.

As shown in fig. 2, which is a schematic implementation flow diagram of the remote control method for smart home devices according to the embodiment of the present invention, the method may include the following steps:

and S21, receiving the real-time images of the intelligent home devices sent by the intelligent home server and displaying corresponding control pictures.

The real-time image is acquired by the intelligent camera and is sent to the intelligent home server.

During specific implementation, the intelligent camera acquires images of the field environment of the intelligent home equipment to obtain real-time images and sends the real-time images to the intelligent home server, and the intelligent home server sends the received real-time images to the intelligent home control client, so that a user can see the real-time images of the intelligent home equipment through the intelligent home control client.

And S22, receiving the environment information collected by the intelligent home equipment and sent by the intelligent home server, and determining the display information of the control picture according to the environment information.

The environment information is acquired by the intelligent home equipment and sent to the intelligent home server through the intelligent camera.

In this step, a sensor installed on the smart home device can acquire field environmental information according to a set period and send the field environmental information to the smart camera, and the smart camera sends the environmental information acquired by the smart home device to the smart home server.

The intelligent air conditioner can collect the ambient temperature according to a set period and send the ambient temperature to the intelligent camera, and the ambient temperature collected by the intelligent air conditioner is sent to the intelligent server by the intelligent camera.

Preferably, in order to save network transmission resources, the intelligent camera may further compare the environmental information acquired by the intelligent home device in the previous acquisition period after receiving the environmental information acquired by the intelligent home device, and if it is determined that the environmental information acquired by two adjacent times changes, the intelligent camera sends the environmental information acquired by the intelligent home device to the intelligent home server.

After receiving the environmental information collected by the intelligent camera, the intelligent home server sends the received environmental information to the intelligent home control client, so that the intelligent home control client determines the display information of the displayed control picture according to the received environmental information.

In specific implementation, the smart home control client may directly display the current ambient temperature on the smart air conditioner included in the control picture according to the received environmental information, for example, the smart home control client may directly display the current ambient temperature on the smart air conditioner included in the control picture according to the ambient temperature reported by the smart air conditioner, or the smart home device may update the color tone of the currently displayed control picture according to the received environmental information to prompt the current ambient temperature.

For example, according to the received ambient temperature, if the ambient temperature is judged to be higher than a preset first temperature threshold, the currently displayed control picture is adjusted to be warm tone, and if the ambient temperature is judged to be lower than a preset second temperature threshold, the currently displayed control picture is adjusted to be cold tone, so that a user can judge the on-site ambient temperature of the intelligent home equipment according to the control picture displayed by the intelligent home control client, and determine whether a control instruction needs to be sent to the intelligent home equipment according to the on-site ambient temperature. For example, if the user determines that the current ambient temperature is too low according to the control picture, a control instruction for starting heating may be sent to the intelligent air conditioner through the intelligent home control client, and if the user determines that the current ambient temperature is too high according to the control picture, a control instruction for starting cooling may be sent to the intelligent air conditioner through the intelligent home control client. For another example, if the smart home control client determines that the concentration of harmful gas or smoke in the current environment exceeds the preset concentration threshold according to the received concentration of harmful gas in the environment, the smart home control client may adjust the control picture to be a gray image, and the gray value of the gray image is increased according to the increase of the concentration of harmful gas, and when the user determines that the concentration of harmful gas in the current environment exceeds the preset threshold according to the control picture, the smart home control client sends a control instruction for closing a valve to the smart gas meter, and the like. Or, the smart home control client determines the on-site air quality of the smart home device according to the received pollutant index information, and adjusts the display color of the picture according to the determined air quality, for example, if the air quality is determined to be excellent, the display color of the picture is adjusted to be green, if the air quality is determined to be good, the display color of the picture is adjusted to be orange, if the air quality is determined to be light pollution, the display color of the picture is adjusted to be gray, and as the pollution index increases, the gray value of the gray level image also increases. Therefore, the user can intuitively know the change of the field environment according to the control face changing color displayed by the intelligent home control client.

During specific implementation, the intelligent home control client can also adjust the display color of the control picture while displaying the received environment information at the corresponding intelligent home equipment mark position in the control picture according to the received environment information.

It should be noted that, for the second implementation manner, that is, the implementation manner in which the smart home devices may also adjust the color tone of the currently displayed control screen according to the received environment information, if the smart home control client receives different environment information collected by a plurality of smart home devices at the same time, the smart home control client may determine, according to the preset display priority, which of the environment information collected by the smart home devices changes the color tone of the control screen.

For example, the smart home control client determines that the control picture to be adjusted and displayed is a gray picture according to the fact that the concentration of harmful gas in the received environmental information is higher than a preset concentration threshold, and determines that the current environmental temperature is higher than a preset first temperature threshold according to the environmental temperature in the received environmental information, and determines that the control picture to be adjusted and displayed is a warm tone.

Preferably, during specific implementation, if the intelligent home control client determines that the concentration of harmful gas or the concentration of smoke in the current environment exceeds a preset threshold according to the received environment information, the voice warning information can be played while the gray level image of the control picture is adjusted, so that a user is prompted to close the gas valve in time.

Or, in specific implementation, the smart home control client may further determine the currently displayed control screen according to a selection of the user, for example, if the user selects an intelligent air conditioner in the control screen, the smart home control client adjusts a display color of the control screen to be a warm tone or a cool tone according to the received ambient temperature, and if the user selects an air purifier, the smart home control client adjusts the display color of the control screen to be a green, orange, or grayscale image according to the received pollution index, and the like.

And S23, updating the displayed control picture according to the display information.

In this step, the smart home control client may update the displayed control picture according to the display information of the control picture determined in step S22.

Preferably, in the implementation, after receiving the real-time image sent by the smart home server, the smart home control client may further identify the smart home devices included therein, and mark the identified smart home devices, for example, the smart home device control client may highlight the edges of the identified smart home devices. In the embodiment of the invention, the intelligent home server can also identify and mark the intelligent home equipment in the received implementation image and then send the intelligent home equipment to the intelligent home control client, so that the intelligent home control client can directly display the intelligent home equipment without executing the step of identifying the intelligent home equipment, thereby reducing the resource consumption of the intelligent home control client.

During specific implementation, the intelligent home server can acquire image characteristic information of intelligent home devices of different brands and different models in advance, and the intelligent home devices contained in the real-time images acquired by the intelligent camera are identified according to the acquired image characteristics.

Further, the intelligent home control client adds a hidden control menu to each intelligent home device included in the control screen at a corresponding position according to the mark position of the intelligent home device. It should be understood that the corresponding control menus are different for different smart home devices, for example, for a smart air conditioner, the control menus may include several control operation instructions such as turn on cooling, turn on heating, and turn off.

During specific implementation, a user can also send a control operation instruction to corresponding intelligent home equipment according to the change of the control picture displayed by the intelligent home control client. Based on this, the remote control method for the smart home device provided by the embodiment of the present invention may further include the following steps:

firstly, an intelligent home control client receives a control operation instruction sent by a user aiming at any intelligent home equipment contained in a control picture;

and step two, the intelligent household control client sends the received control operation instruction to the intelligent camera through the intelligent household server, and the intelligent camera sends the control operation instruction to corresponding intelligent household equipment for execution.

Preferably, the control operation instruction includes a touch operation instruction or a voice control instruction. According to different types of control operation instructions sent by users, the flow executed by the smart home control client is also different, which is described below.

In the first mode, the control operation command sent by the user is a touch operation command.

In this embodiment, the Touch operation instruction may be divided into two types, one is a menu Touch operation instruction, and the other is an operation instruction implemented based on 3D Touch.

Taking a touch operation instruction sent by a user as a menu-type touch operation instruction as an example, when the smart home control client detects a touch operation of the user on any smart home device displayed in the control picture, the smart home control client displays a corresponding control menu. Preferably, the displayed control menu comprises at least one control operation instruction.

Based on the method, the intelligent home control client sends the control operation instruction selected by the user to the intelligent camera through the intelligent home server according to the control operation instruction selected by the user through the control menu, and the intelligent camera sends the control operation instruction to the corresponding intelligent home equipment for execution.

For example, when a user sees that the window begins to rain but is not closed at present according to a real-time image acquired by the intelligent camera, a control menu of the intelligent window can be called out through touch operation in a control picture, a control operation instruction for closing the window is selected and sent to the intelligent home server, the intelligent home server forwards the control operation instruction to the intelligent camera, and the intelligent camera sends the control instruction for closing the window to the intelligent window so as to close the window.

Take the Touch operation instruction sent by the user as the operation instruction realized by the 3D Touch as an example. In this embodiment, the smart home control client sets different 3D Touch control instructions for different smart home devices according to a user, for example, for a smart air conditioner, a clockwise rotation is preset to turn on heating, a counterclockwise rotation is preset to turn on cooling, and a re-pressing is used to turn off the air conditioner. Therefore, when a user needs to send a heating starting control instruction to the intelligent air conditioner, the intelligent air conditioner contained in the control picture displayed by the intelligent home control client is selected and rotates clockwise, the intelligent home control client recognizes the operation as the heating starting of the intelligent air conditioner and sends the operation to the intelligent home server, the operation is sent to the intelligent camera by the intelligent home server, and the intelligent camera sends the operation to the intelligent air conditioner to execute corresponding operation.

In specific implementation, the Touch operation instruction in the embodiment of the present invention may also be 4D Touch, and the like, which is not limited in the embodiment of the present invention.

In the second mode, the control operation instruction sent by the user is a voice control operation instruction.

In this implementation manner, the user can control the smart home device to execute corresponding operations through voice. During specific implementation, when a user determines that a control instruction needs to be sent to corresponding intelligent home equipment according to the environment information displayed by the intelligent home control client, the user can directly send a voice control instruction. For example, the voice control instruction sent by the user is 'turn on air conditioner heating', the intelligent home control client can send the received voice instruction to the intelligent home server, the voice control server performs voice recognition and then sends the voice instruction to the intelligent camera, and the intelligent camera sends the voice instruction to the intelligent air conditioner to execute corresponding operation.

According to the remote control method and device for the intelligent home equipment, the display information of the control picture is changed according to the environment information collected by the intelligent home equipment, so that a user can intuitively know the change of the on-site environment information of the intelligent home equipment through the change of the control picture without sending an environment information query instruction to the intelligent home equipment for querying, the interaction times of the user and the intelligent home equipment are reduced, and the resource overhead of the intelligent home equipment is saved.

Based on the same inventive concept, the embodiment of the invention also provides an intelligent household equipment remote control device, and as the problem solving principle of the device is similar to that of the intelligent household equipment remote control method, the implementation of the device can be referred to the implementation of the method, and repeated details are omitted.

As shown in fig. 3, which is a schematic structural diagram of an intelligent home device remote control apparatus provided in an embodiment of the present invention, the intelligent home device remote control apparatus may include:

the first receiving unit 31 is configured to receive a real-time image of the smart home device sent by the smart home server and display a corresponding control picture, where the real-time image is acquired by the smart camera and sent to the smart home server;

Optionally, the remote control apparatus for smart home devices provided in the embodiment of the present invention may further include:

the identification unit is used for identifying and marking the intelligent equipment contained in the control picture;

and the adding unit is used for adding a hidden control menu at a corresponding position according to the mark position of each intelligent household device contained in the control picture.

Optionally, the remote control apparatus for smart home devices provided in the embodiment of the present invention may further include:

the third receiving unit is used for receiving a control operation instruction sent by a user aiming at any intelligent household equipment contained in the control picture;

and the sending unit is used for sending the received control operation instruction to the intelligent camera through the intelligent home server, and the intelligent camera sends the control operation instruction to corresponding intelligent home equipment for execution.

Preferably, the control operation instruction includes a touch operation instruction or a voice control instruction.

For convenience of description, the above parts are separately described as modules (or units) according to functional division. Of course, the functionality of the various modules (or units) may be implemented in the same or in multiple pieces of software or hardware in practicing the invention.

After the method and the device for remotely controlling smart home devices according to the exemplary embodiment of the present invention are introduced, a device for remotely controlling smart home devices according to another exemplary embodiment of the present invention is introduced.

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.

In some possible embodiments, the smart home device remote control apparatus according to the present invention may include at least one processing unit, and at least one storage unit. Wherein the storage unit stores program codes, and when the program codes are executed by the processing unit, the processing unit is enabled to execute the steps of the intelligent home device remote control method according to various exemplary embodiments of the present invention described in this specification. For example, the processing unit may execute step S21 shown in fig. 2, receive a real-time image of the smart home device sent by the smart home server and display a corresponding control picture, where the real-time image is collected by the smart camera and sent to the smart home server, step S22, receive environment information collected by the smart home device sent by the smart home server, determine display information of the control picture according to the environment information, where the environment information is collected by the smart home device and sent to the smart home server through the smart camera, and step S23, update the displayed control picture according to the display information.

In some possible embodiments, various aspects of the remote control method for smart home devices provided by the present invention may also be implemented as a program product, which includes program codes, and when the program product runs on a computer device, the program codes are configured to enable the computer device to execute the steps in the remote control method for smart home devices according to various exemplary embodiments of the present invention described in this specification, for example, the computer device may execute step S21 shown in fig. 2, receive a real-time image of a smart home device sent by a smart home server, where the real-time image is collected by a smart camera and sent to the smart home server, and display a corresponding control screen, step S22, receive environment information collected by the smart home device sent by the smart home server, determine display information of the control screen according to the environment information, and step S23, updating the displayed control picture according to the display information.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to the program product for the remote control of the intelligent household equipment, a portable compact disc read-only memory (CD-ROM) can be adopted, the program code is contained, and the program product can be operated on a server device. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device over any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., over the internet using an internet service provider).

It should be noted that although in the above detailed description several units or sub-units of the apparatus for remote control of smart home devices are mentioned, this division is only not mandatory. Indeed, the features and functions of two or more of the units described above may be embodied in one device, according to embodiments of the invention. Conversely, the features and functions of one unit described above may be further divided into embodiments by a plurality of units.

Moreover, while the operations of the method of the invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.