patents.google.com

CN119316765A - Headphone control method, headphone and computer readable storage medium - Google Patents

️Tue Jan 14 2025

Detailed Description

Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for explaining the embodiments of the present application and are not to be construed as limiting the embodiments of the present application.

The earphone is used as a wearable device, and supports a user to wear in sports and daily life scenes. Thus, the headset can collect data of the user wearing the headset. Modern working modes are mostly in sitting office, long sitting time is accompanied, the head of a user is basically in a stable screen-facing state in a deep focused scene, the head is less in activity, and the posture tends to be fixed. There has been extensive research finding that prolonged exposure to a sedentary environment during work has a significant correlation with discomfort and pain in the neck, shoulders, back. Wherein the inactivity of the head is highly correlated with neck discomfort. During riding, the eyes need to look ahead directly, the cervical vertebra can be in the overstretched state, and the muscle on the back side of the neck continuously works to keep balance, and long-time riding can enable the cervical vertebra to keep for a long time under the high-pressure posture, so that the risk of overstrain injury of the neck is improved. However, the human body cannot always know that the human body is in a fatigue state in time. The application aims to judge whether the head of a user is in a relatively static state (namely, a fatigue state) for a long time through the earphone 10, and give a reminder to the user when the user is in the fatigue state. In order to solve the above problems, the present application provides an earphone 10 (as shown in fig. 2, 3 and 14), a method for controlling the earphone (as shown in fig. 1, 4 to 12 and 15 to 17), and a computer readable storage medium (as shown in fig. 18).

Referring to fig. 1 to 3, a method for controlling an earphone according to an embodiment of the present application includes:

02, acquiring detection data acquired by the sensor module 12;

05, determining the current state of the head of the user wearing the earphone 10 according to the detection data and a preset state threshold, wherein the current state comprises a first state and a second state, and the movement amplitude of the head of the user in the first state is larger than that of the head of the user in the second state;

07, accumulating the time length of the head of the user continuously in the second state in the case that the current state is the second state, and

091, Sending out prompt information under the condition that the accumulated time length reaches a preset time length threshold value.

The above-mentioned earphone control method can be applied to the earphone 10, and the earphone 10 according to the embodiment of the application includes a control module 11, a sensor module 12, a prompt module 14 and a command receiving module 15.

In particular, the earphone 10 is an audio device mainly used for acousto-electric conversion, for example, converting an audio signal into sound, allowing a user to hear music, movies, games or other audio contents, or converting sound into an electrical signal. The design of the earphone 10 is intended to provide a private listening environment so that the user can enjoy audio content alone without affecting surrounding persons. The earphone 10 may be worn on a user's ear, and may be used with a mobile phone, a computer, an intelligent wearable device (such as a smart watch, a smart bracelet, smart glasses, a smart helmet, etc.), a head display device, a virtual reality device, etc. The earphone 10 includes an air conduction earphone and a bone conduction earphone. An air conduction earphone, i.e., an air conduction earphone, is an earphone that propagates sound by air vibration. Bone conduction headphones, i.e. bone conduction headphones, are headphones that convert sound into different mechanical vibrations, transmitting sound waves through the skull, bone labyrinth, inner ear lymph, augers, auditory centers, etc. of a person. The air conduction earphone and the bone conduction earphone can be suitable for scenes, and the applicability of the earphone 10 is improved.

The earphone 10 includes a battery compartment assembly for receiving a battery and/or a control compartment assembly having a control function. The control box assembly includes a control box 119 and the battery box assembly includes a battery box 117. The control box 119 may be used to control the turning on and off of the earphone 10 and adjust the volume of the earphone 10, and the battery box 117 may be used to house a battery for powering the earphone 10 so that the earphone 10 may operate normally.

The earphone 10 further comprises a to-be-connected piece 13, the to-be-connected piece 13 comprising an ear-hook 137 and/or a rear-hook 139. When the user wears the earphone 10, the back hanging 139 of the earphone 10 is worn on the head, and the ear hanging 137 of the earphone 10 is worn on the back of the ear, so that the stability of wearing the earphone 10 can be improved, and the earphone 10 is not easy to fall off even under the outdoor or sports condition of the user. Rear hitch 139 is used to connect battery compartment 117 and control compartment 119. The earphone 10 further comprises a transducer assembly 30, and an ear hook 137 for connecting the battery compartment 117 and the transducer assembly 30, and for connecting the control compartment 119 and the transducer assembly 30. The transducer assembly 30 is adapted to engage the skin of a person, and the transducer assembly 30 is adapted to mechanically vibrate to allow the user to hear sounds when the earphone 10 is in use.

More specifically, the earphone 10 further includes a control module 11, a sensor module 12, a prompting module 14, and an instruction receiving module 15.

The control module 11 is a module within the headset 10 that is responsible for processing various data and coordinating various functions, including but not limited to audio processing, connecting devices, power management, user interaction, etc. The control module 11 is in communication with the sensor module 12. The control module 11 and the sensor module 12 may form a wired communication connection through a data line, or may form a wireless communication connection through a wireless signal. The mode of the control module 11 for acquiring the detection data acquired by the sensor module 12 may be that the control module 11 directly reads the detection data acquired by the sensor module 12, or that the control module 11 periodically sends a request to poll the sensor module 12 to acquire the latest detection data, or that wireless connection is adopted between the sensor module 12 and the control module 11, and the control module 11 acquires the detection data acquired by the sensor module 12 through a wireless communication protocol.

The sensor module 12 is a module for collecting detection data. The sensor module 12 is capable of monitoring and collecting signals of a user during wearing the earphone 10 in real time and transmitting detection data formed by the signals to the control module 11. The sensor module 12 includes, but is not limited to, one or more of an inertial measurement unit (Inertial Measurement Unit, IMU), a pressure sensor, an electrocardiograph sensor, a temperature sensor, and the like. The sensed data includes, but is not limited to, one or more of tri-axial acceleration, tri-axial angular acceleration, pressure, heart rate, temperature, and the like. The detection data collected by the sensor module 12 may be related data of a human body (for example, heart rate) or related data of an external environment (for example, ambient temperature). The headset 10 of the present application includes at least one sensor module 12. In embodiments where the headset 10 includes multiple sensor modules 12, the types of detection data collected by the different sensor modules 12 may be the same or different. The signal-formed detection data may characterize the current state of the user. The manner in which the sensor module 12 collects the detection data includes, but is not limited to, sampling at a constant sampling rate, sampling at a variable sampling rate, and sampling at a time window. In the present application, the sensor samples at a constant sampling rate, and more specifically, the present application acquires a set of sampled data at one second intervals. The constant sampling rate is simple and convenient, detection data can be continuously collected, continuous monitoring is realized, and state change in the detection data is not easy to miss.

The prompt module 14 is used for sending out prompt information. The alert information includes, but is not limited to, a voice alert, an action alert (e.g., vibration), a text alert, a graphical interface alert, etc., or any combination thereof.

The instruction receiving module 15 is configured to receive an instruction (as shown in fig. 14) sent by an external device, where the external device includes at least one of a mobile phone, a watch, a server, a computer, and a tablet computer.

In some embodiments, the instruction receiving module 15 includes an input module (not shown) disposed on the control box 117 or on the battery box 119, the input module being configured to input a user instruction, the input module including at least one of a key and a touch screen. The input module is configured to input a user instruction, where the user instruction at least includes a scene entry instruction, so that the control module 11 can determine whether the current scene is in the second scene based on whether the instruction receiving module 15 receives the scene entry instruction.

In some embodiments, the instruction receiving module 15 further includes a communication module (not shown), where the communication module includes an instruction receiving module 15 disposed on the control box 117 or the battery box 119, and specifically, the instruction receiving module 15 is capable of receiving an instruction sent by an external device, and transmitting the instruction to the control module 11 by the communication module.

In the method of 02, the sensor module 12 is used to collect detection data. The control module 11 is configured to obtain detection data collected by the sensor module 12, determine a current state of a head of a user wearing the earphone 10 according to the detection data and a preset state threshold, where the current state includes a first state and a second state, the motion amplitude of the head of the user in the first state is greater than the motion amplitude of the head of the user in the second state, and accumulate a duration of time that the head of the user is continuously in the second state when the current state is the second state. The prompt module 14 is configured to send out prompt information when the accumulated duration reaches a preset duration threshold.

In the method of 05, the preset state threshold is a predefined parameter for distinguishing between different current states of the user's head. It will be appreciated that the earphone 10 is worn on the head of a human body, and the sensor module 12 is capable of collecting at least detection data of the head of the user, and determining the current state of the head of the user wearing the earphone 10 according to the detection data and the preset state threshold. More specifically, the preset state threshold may include an acceleration threshold that is used to characterize the intensity of the movement of the head, an angular velocity threshold that is also used to characterize the intensity of the movement of the head, and a temperature threshold that is used to characterize whether the user wearing the headset 10 is in a healthy state.

In an embodiment of the application, the current state comprises a first state and a second state, the movement amplitude of the head of the user in the first state being greater than the movement amplitude of the head of the user in the second state. More specifically, in the first state, the user's head has more significant movement, and the range of motion is greater, such as rapid head rotation, large head tilt, or frequent head movement. For example, the user may be in a first state while performing swimming, basketball, etc. In the second state, the user's head has no significant motion, and the motion amplitude is small, even stationary. For example, the user may be in the second state while reading or riding long distances. For example, the first state generally refers to a moving state and the second state generally refers to a stationary state. Wherein the motion amplitude in the motion state is greater than a preset first motion amplitude threshold, and the motion amplitude in the stationary state is less than a preset second motion amplitude threshold, the first motion amplitude threshold > the second motion amplitude threshold, and the second motion amplitude threshold may be zero, or a smaller value greater than zero. The motion amplitude may be a displacement amount on the triaxial axes (X, Y and Z), or a rotation angle around the triaxial axes (X, Y and Z).

In the method of 07, in the case that the control module 11 recognizes that the current state is the second state, the control module 11 accumulates the duration that the head of the user is continuously in the second state, so that the control module 11 may acquire the duration that the user is in the second state, that is, the control module 11 may acquire the duration that the user is in the current state with a small motion amplitude, so as to provide data for the subsequent method.

In the method of 091, the preset duration threshold is a parameter predefined by the control module 11, and is used for the control module 11 to determine the accumulated duration, and serve as a basis for the prompt module 14 to send out prompt information. The manner in which the alert message is sent includes, but is not limited to, sending an audio alert and sending a vibration alert.

In the control method of the earphone, the control module 11 of the earphone 10 can determine the current state of the head of the user wearing the earphone 10 by detecting the data and the preset state threshold, judge whether the head is in the second state, accumulate the duration that the head is continuously in the second state, and send out the prompt information to prompt the user that the head is continuously in the second state for a certain duration under the condition that the accumulated duration reaches the preset duration threshold, so as to prompt the user that the current state of the head needs to be changed, and avoid the head of the user being in the same state for a long time, thereby avoiding the fatigue of the head being in the same state for a long time.

Referring to fig. 2-4, in some embodiments, the sensor module 12 includes an accelerometer 122, the detected data includes three-axis accelerations detected by the accelerometer 122, the preset state threshold includes a preset acceleration difference threshold ka,05, and the method includes:

051 determining the current state of the head of the user wearing the earphone 10 according to the triaxial acceleration and the acceleration difference threshold ka within the preset time window.

The above-described control method of the earphone may be applied to the earphone 10, and the control module 11 is further configured to determine the current state of the head of the user wearing the earphone 10 according to the triaxial acceleration and the acceleration difference threshold ka within the preset time window.

In particular, the accelerometer 122 is capable of acquiring acceleration of the measurement head in three spatial dimensions (X, Y, Z three axes). That is, in a case where the user wears the headphone 10 on his head, the accelerometer 122 can measure three-axis accelerations of the head, including X-axis acceleration, Y-axis acceleration, and Z-axis acceleration. The X-axis acceleration represents the movement speed change of the head along the X-axis direction, the Y-axis acceleration represents the movement speed change of the head along the Y-axis direction, and the Z-axis acceleration represents the movement speed change of the head along the Z-axis direction. Therefore, the triaxial acceleration includes acceleration in three spatial dimensions, and can fully express the total acceleration of the head as compared with the uniaxial acceleration.

In the method of 051, the preset time window is a time range of the obtained triaxial acceleration. For example, the preset time window may be a time window with a fixed length and rolling with time, and the control module 11 acquires the detection data acquired by the sensor module 12 at a constant time interval, for example, the preset time window has a fixed length of 5 minutes, and the control module 11 acquires the three-axis acceleration data acquired by the sensor module 12 at the current time, the three-axis acceleration data acquired by the sensor module 12 2 minutes before the current time, and the three-axis acceleration data acquired by the sensor module 12 2 minutes after the current time, with the current time as the center. By the next time, the control module 11 acquires the triaxial acceleration data acquired by the sensor module 12 at the next time, the triaxial acceleration data acquired by the sensor module 12 2 minutes before the next time, and the triaxial acceleration data acquired by the sensor module 12 2 minutes after the next time, with the next time as the center. The adoption of the time window to collect the detection data can reduce the interference of related data, improve the accuracy of the control module 11 in determining the current state of the head of the user wearing the earphone 10, reduce the calculation load of the control module 11, and avoid the excessive detection data, so that the control module 11 is heavy in load. The rolling time window may provide continuous and time-sequential tri-axial acceleration data that more accurately reflects the current state of the head of the user wearing the headset 10.

The acceleration difference threshold value ka is a preset parameter, and the state of the user is judged according to the comparison result of the triaxial acceleration data and the acceleration difference threshold value ka in a preset time window, and a specific judging mode is further described below.

Referring to fig. 3 and 5, in some embodiments, the method of 051 includes:

0511, fusing triaxial accelerations at a plurality of preset moments in a preset time window to obtain a plurality of fused acceleration values An (n is a natural number greater than 1) corresponding to the preset moments respectively;

0513, screening out a fusion acceleration maximum value Amax and a fusion acceleration minimum value Amin from a plurality of fusion acceleration values An;

0515 obtaining the acceleration difference value delta A according to the maximum value Amax and the minimum value Amin of the fused acceleration, and

0517 Determining the current state of the head of the user wearing the earphone 10 from the acceleration difference deltaa and the acceleration difference threshold ka.

The control method of the earphone can be applied to the earphone 10, and the control module 11 is further used for fusing triaxial accelerations at a plurality of preset moments in a preset time window to obtain a plurality of fused acceleration values An corresponding to the preset moments respectively, screening out a fused acceleration maximum value Amax and a fused acceleration minimum value Amin from the fused acceleration values An, acquiring An acceleration difference value delta A according to the fused acceleration maximum value Amax and the fused acceleration minimum value Amin, and determining the current state of the head of a user wearing the earphone 10 according to the acceleration difference value delta A and the acceleration difference threshold value ka.

Specifically, in the method of 0511, a plurality of groups of triaxial accelerations are included under a preset time window, and each group of triaxial accelerations at least includes an X-axis acceleration, a Y-axis acceleration and a Z-axis acceleration. And respectively fusing the triaxial accelerations under a plurality of groups of preset moments to obtain fused acceleration values under the plurality of preset moments. It is understood that the fusion process includes filtering to remove noise, including but not limited to Kalman filtering, gaussian filtering, median filtering, and the like. Partial noise in the triaxial acceleration can be removed through filtering, and accuracy of the fusion acceleration value is improved.

For example, in the preset time window T corresponding to the current time T0, the three-axis acceleration A1 (which is a set of X, Y, Z three-axis accelerations ax1, ay1 and az 1) at the preset time T1, the three-axis acceleration A2 (which is a set of X, Y, Z three-axis accelerations ax2, ay2 and az 2) at the preset time T2, the three-axis acceleration a3 (which is a set of X, Y, Z three-axis accelerations ax3, ay3 and az 3) at the preset time T3 are included, the three-axis acceleration An (which is a set of X, Y, Z three-axis accelerations axn, ayn and azn) at the preset time T3 are included, the three-axis accelerations are respectively fused, the fused acceleration A1 is obtained, the fused acceleration A2 at the preset time T1 is obtained, the fused acceleration a3 is obtained at the preset time T3, and the fused acceleration An at the preset time tn is obtained. The fused acceleration values carry more information and more accurately characterize the current state of the head of the user wearing the headset 10 than do non-fused acceleration values. The fusion processing is also helpful to eliminate occasional abnormal values or instantaneous large-amplitude fluctuation, so that the 0511 method is more anti-interference and has robustness.

In the method of 0513, the control module 11 screens out a fusion acceleration maximum value Amax and a fusion acceleration minimum value Amin from a plurality of fusion acceleration values, that is, within a preset time window T, selects a fusion acceleration value A1, a fusion acceleration value A2, a fusion acceleration value a 3..the maximum value in the fusion acceleration value An as the fusion acceleration maximum value Amax, and selects a fusion acceleration value A1, a fusion acceleration value A2, a fusion acceleration value a 3..the minimum value in the fusion acceleration value An as the fusion acceleration minimum value Amin. The maximum value Amax and the minimum value Amin of the fusion acceleration are screened, the data size is small, the screening mode does not involve complex operation, the control module 11 can directly acquire the moving range of the head of the user wearing the earphone 10, the moving range of the head of the user is responded quickly, and the current state of the head under a plurality of preset time windows is responded quickly.

0515, The control module 11 makes a difference between the fusion acceleration maximum value Amax and the fusion acceleration minimum value Amin to obtain an acceleration difference Δa, i.e. Δa=amax-Amin. The acceleration difference value delta A is large, which indicates that the movement amplitude of the head of the user in the time window T is large, the head can move rapidly, and the acceleration difference value delta A is small, which indicates that the movement amplitude of the head of the user in the time window T is small, and the head can be static relative to the body of the user.

In the method of 0517, the control module 11 compares the acceleration difference Δa with the acceleration difference threshold ka and determines the current state of the head of the user wearing the earphone 10. The manner of comparison includes, but is not limited to, direct comparison of the acceleration difference value Δa with the acceleration difference threshold value ka (e.g., direct calculation of the difference between the acceleration difference value Δa and the acceleration difference threshold value ka). The acceleration difference threshold ka can provide a direct standard for the control module 11, and the control module 11 can directly distinguish the magnitude of the acceleration difference Δa, so as to facilitate the subsequent operation of the control module 11.

Referring to fig. 2 and 6, in some embodiments, the method of 0517 includes:

05171 determining that the current state of the head of the user wearing the earphone 10 is the first state in the case of Δa > ka;

05173 in the case of Δa < ka, the current state of the head of the user wearing the earphone 10 is determined to be the second state.

The above-described control method of the earphone may be applied to the earphone 10, and the control module 11 may be further configured to determine that the current state of the head of the user wearing the earphone 10 is a first state in the case of Δa > ka, and determine that the current state of the head of the user wearing the earphone 10 is a second state in the case of Δa < the acceleration difference threshold ka.

In addition, in the case of Δa=ka, the control module 11 may determine that the current state of the head of the user wearing the earphone 10 is the first state or the second state, and may be set according to the need. The control module 11 simplifies the logic of judging the current state by setting the definite acceleration difference threshold ka, and can directly divide the current state of the head of the user into the first state and the second state by judging the magnitude relation between the acceleration difference delta A and the acceleration difference threshold ka, which is beneficial to quickly judging the current state of the head of the user in real time under the condition that the sensor module 12 collects the detection data in real time.

Referring to fig. 3 and 7, in some embodiments, the sensor module 12 includes a gyroscope 121, the detected data includes three-axis angular velocities detected by the gyroscope 121, the preset state threshold includes a preset angular velocity difference threshold kω, and the method further includes:

053 determining the current state of the head of the user wearing the earphone 10 according to the triaxial angular velocity and the angular velocity difference threshold k omega within the preset time window.

The above-described earphone control method may be applied to the earphone 10, and the control module 11 is further configured to determine the current state of the head of the user wearing the earphone 10 according to the triaxial angular velocity and the angular velocity difference threshold kω within the preset time window.

Specifically, gyroscope 121 is capable of measuring angular velocities of the head in three spatial dimensions (X, Y, Z three axes), including an X-axis angular velocity, a Y-axis angular velocity, and a Z-axis angular velocity. The X-axis angular velocity characterizes the angular variation of the head rotation about the X-axis, the Y-axis angular velocity characterizes the angular variation of the head rotation about the Y-axis, and the Z-axis angular velocity characterizes the angular variation of the head rotation about the Z-axis. Thus, the triaxial angular velocity includes angular velocities in three spatial dimensions, and can fully express the resultant angular velocity of the head as a whole, as compared to the uniaxial angular velocity.

In the method of 053, the preset time window is also a time range of the obtained triaxial angular velocity. For example, the preset time window may be a time window with a fixed length and rolling with time, and the control module 11 acquires detection data acquired by the sensor module 12 at a constant time interval, for example, the preset time window has a fixed length of 5 minutes, and the control module 11 acquires the three-axis angular velocity data acquired by the sensor module 12 at the current time, the three-axis angular velocity data acquired by the sensor module 122 minutes before the current time, and the three-axis angular velocity data acquired by the sensor module 122 minutes after the current time, with the current time as the center. By the next time, the control module 11 acquires the triaxial angular velocity data acquired by the sensor module 12 at the next time, the triaxial angular velocity data acquired by the sensor module 122 minutes before the next time, and the triaxial angular velocity data acquired by the sensor module 122 minutes after the next time, centering on the next time. The effect of collecting the detection data by using the time window is the same as before, and will not be described in detail here.

The angular velocity difference threshold kω is a preset parameter, and the state of the user is determined according to a comparison result between the triaxial angular velocity data and the angular velocity difference threshold kω in a preset time window, and a specific determination manner is further described below.

Referring to fig. 3 and 8, in some embodiments, the method of 053 includes:

0531 fusing the triaxial angular velocities at a plurality of preset moments in a preset time window to obtain a plurality of fused angular velocity values omega m (m is a natural number greater than 1) corresponding to the preset moments respectively;

0533, screening out a fusion angular velocity maximum value OMEGA max and a fusion angular velocity minimum value OMEGA min from a plurality of fusion angular velocity values OMEGA m;

0535 obtaining an angular velocity difference DeltaOmega from the fusion angular velocity maximum value Omax and the fusion angular velocity minimum value Omin, and

0537 Determining the current state of the head of the user wearing the earphone 10 from the angular velocity difference ΔΩ and the angular velocity difference threshold kω.

The earphone 10 according to the embodiment of the application includes a control module 11, where the control module 11 is further configured to fuse three-axis angular velocities at a plurality of predetermined moments within a predetermined time window to obtain a plurality of fused angular velocity values Ω m corresponding to the predetermined moments, screen out a fused angular velocity maximum value Ω max and a fused angular velocity minimum value Ω min from the plurality of fused angular velocity values Ω m, obtain an angular velocity difference ΔΩ according to the fused angular velocity maximum value Ω max and the fused angular velocity minimum value Ω min, and determine a current state of the head of a user wearing the earphone 10 according to the angular velocity difference ΔΩ and the angular velocity difference threshold kω.

Specifically, in the method of 0531, a plurality of sets of three-axis angular velocities are included under the preset time window, and each set of three-axis angular velocities includes at least an X-axis angular velocity, a Y-axis angular velocity, and a Z-axis angular velocity. And respectively fusing the triaxial angular velocities under a plurality of preset time intervals to obtain fused angular velocity values under a plurality of preset time intervals. It is understood that the fusion process includes filtering to remove noise, including but not limited to Kalman filtering, gaussian filtering, median filtering, and the like. The filtering can remove part of noise in the triaxial angular velocity, and accuracy of the fusion angular velocity value is improved.

For example, within the preset time window T corresponding to the current time T0, the three-axis angular velocity ω1 (which is a set of X, Y, Z three-axis accelerations ωx1, ωy1, and ωz1) at the preset time T1, the three-axis angular velocity ω2 (which is a set of X, Y, Z three-axis accelerations ωx2, ωy2, and ωz2) at the preset time T2, the three-axis angular velocity ω3 (which is a set of X, Y, Z three-axis accelerations ωx3, ωy3, and ωz3) at the preset time T3, the three-axis angular velocity ωm (which is a set of X, Y, Z three-axis accelerations ωxm, ωym, and ωzm) at the preset time tm, after the three-axis angular velocities are respectively fused, the fused three-axis angular velocity ω1 is obtained, the fused angular velocity value Ω 1 at the preset time T1 is obtained, the fused angular velocity ω2 at the preset time T2 is obtained, and the fused angular velocity value Ω 3 at the preset time T3 is obtained after the three-axis angular velocity ωm is fused. The fused angular velocity value Ω m carries more information, and more accurately characterizes the current state of the head of the user wearing the earphone 10, and more characterizes the change of the rotation angle of the head of the user, than the non-fused acceleration value. The fusion processing is also helpful to eliminate occasional outliers or instantaneous large-amplitude fluctuation, so that the 0531 method is more anti-interference and has robustness.

In the method of 0533, the control module 11 screens out a fusion angular velocity maximum value Ω max and a fusion angular velocity minimum value Ω min from a plurality of fusion angular velocity values, that is, within a preset time window T, selects a fusion angular velocity value Ω 1, a fusion angular velocity value Ω 2, and a fusion angular velocity value Ω 3. The screening fusion angular velocity maximum value omega max and fusion angular velocity minimum value omega mim are small in data size, the screening mode does not involve complex operation, the control module 11 can directly acquire the moving range of the head of the user wearing the earphone 10, the moving range of the head of the user can be responded quickly, and the current state of the head under a plurality of preset time windows can be responded quickly.

In the method of 0535, the control module 11 makes a difference between the fusion angular velocity maximum value Ω max and the fusion angular velocity minimum value Ω mim to obtain the angular velocity difference ΔΩ, that is ΔΩ=Ω max- Ω mim. The angular velocity difference delta omega has a large value, which indicates that the movement amplitude of the head of the user in the time window T is large, the head can rotate greatly, and the angular velocity difference delta omega has a small value, which indicates that the movement amplitude of the head of the user in the time window T is small, and the head can be static relative to the body of the user.

In the method of 0537, the control module 11 compares the angular velocity difference ΔΩ with an angular velocity difference threshold kω and determines the current state of the head of the user wearing the earphone 10. The manner of comparison includes, but is not limited to, direct comparison of the angular velocity difference ΔΩ with the angular velocity difference threshold kω (e.g., direct calculation of the difference between the angular velocity difference ΔΩ and the angular velocity difference threshold kω). The angular velocity difference threshold kω can provide a direct criterion for the control module 11, and the control module 11 can directly distinguish the magnitude of the angular velocity difference ΔΩ, so as to facilitate the subsequent calculation of the control module 11.

Referring to fig. 3 and 9, in some embodiments, the method of 0537 includes:

05371 determining that the current state of the head of the user wearing the earphone 10 is the first state in the case of ΔΩ > kω;

05373 in the case of ΔΩ < kω, the current state of the head of the user wearing the headphone 10 is determined to be the second state.

The above-described control method of the earphone may be applied to the earphone 10, and the control module 11 is further configured to determine that the current state of the head of the user wearing the earphone 10 is a first state in case of ΔΩ > kω, and determine that the current state of the head of the user wearing the earphone 10 is a second state in case of ΔΩ < kω.

In addition, in the case where ΔΩ=kω, the control module 11 may determine that the current state of the head of the user wearing the earphone 10 is the first state or the second state, and may be set as required. The control module 11 simplifies the logic of current state judgment by setting a definite angular velocity difference threshold kω, and can directly divide the current state of the user's head into a first state and a second state by judging the magnitude of the angular velocity difference ΔΩ and the angular velocity difference threshold kω, which is beneficial to quickly judging the current state of the user's head in real time under the condition that the sensor module 12 collects detection data in real time.

Referring to fig. 3 and 10, in some embodiments, the sensor module 12 includes an accelerometer 122 and a gyroscope 121, the detected data includes a triaxial acceleration detected by the accelerometer 122 and a triaxial angular velocity detected by the gyroscope 121, the preset state threshold includes a preset acceleration difference threshold ka and a preset angular velocity difference threshold kω, and the method of 05 further includes:

055 determining the current state of the head of the user wearing the earphone 10 according to the triaxial acceleration, the triaxial angular velocity, the acceleration difference threshold ka and the angular velocity difference threshold kω within the preset time window.

The above-described earphone control method may be applied to the earphone 10, and the control module 11 is further configured to determine the current state of the head of the user wearing the earphone 10 according to the triaxial acceleration, the triaxial angular velocity, the acceleration difference threshold ka and the angular velocity difference threshold kω within the preset time window.

Specifically, the accelerometer 122 can acquire three-axis acceleration as detection data, and the gyroscope 121 can acquire three-axis angular velocity as detection data. The preset time window, the triaxial acceleration, the triaxial angular velocity, the acceleration difference threshold ka and the angular velocity difference threshold kω are the same as the previous explanation of the preset time window, the triaxial acceleration, the triaxial angular velocity, the acceleration difference threshold ka and the angular velocity difference threshold kω, and are not described herein.

The sensor module 12 uses two different types of sensors (i.e. the accelerometer 122 and the gyroscope 121), can provide two types of detection data (i.e. the triaxial acceleration and the triaxial angular velocity), and provides more comprehensive and accurate detection data, so as to more comprehensively reflect the current state of the head of the user wearing the earphone 10, and also can supplement the detection data collected by one sensor under the condition that the other sensor is interfered or the detection data is too noisy, so as to improve the robustness of the control module 11.

Referring to fig. 3 and 11, in some embodiments, the method of 055 includes:

0551, fusing triaxial acceleration values An under a plurality of preset moments in a preset time window to obtain a plurality of fused acceleration values omega m corresponding to the preset moments respectively, and fusing triaxial angular velocities under the plurality of preset moments in the preset time window to obtain a plurality of fused angular velocity values omega m corresponding to the preset moments respectively;

0553 screening out a fusion acceleration maximum value Amax and a fusion acceleration minimum value Amin from a plurality of fusion acceleration values An, and screening out a fusion angular velocity maximum value OMEGA & lt/EN & gt and a fusion angular velocity minimum value OMEGA & lt/EN & gt from a plurality of fusion angular velocity values OMEGA & lt/EN & gt;

0555 obtaining the acceleration difference DeltaA according to the fusion acceleration maximum value Amax and the fusion acceleration minimum value Amin, and obtaining the angular velocity difference Deltaomega according to the fusion angular velocity maximum value Omax and the fusion angular velocity minimum value Omin, and

0557 Determining the current state of the head of the user wearing the earphone 10 from the acceleration difference deltaa, the acceleration difference threshold ka, the angular velocity difference deltaΩ, and the angular velocity difference threshold kω.

The earphone 10 according to the embodiment of the application comprises a control module 11, wherein the control module 11 is further used for fusing triaxial accelerations at a plurality of preset moments in a preset time window to obtain a plurality of fused acceleration values An corresponding to the preset moments respectively, fusing triaxial angular velocities at the preset moments in the preset time window to obtain a plurality of fused angular velocity values Omega corresponding to the preset moments respectively, screening out a fused acceleration maximum value Amax and a fused acceleration minimum value Amin from the fused acceleration values An, screening out a fused angular velocity maximum value Omega and a fused angular velocity minimum value Omega from the fused angular velocity values Omega, acquiring An acceleration difference value delta A according to the fused acceleration maximum value Amax and the fused acceleration minimum value Amin, acquiring An angular velocity difference value delta omega according to the fused angular velocity maximum value Omega and the fused angular velocity minimum value Omega, and determining the current head state of a user wearing the earphone 10 according to the acceleration delta A, the acceleration difference threshold value ka, the angular velocity difference delta omega and the angular velocity difference value omega.

Specifically, in the method of 0551, the acquisition of the plurality of fusion acceleration values An is consistent with the method of 0511, and the acquisition of the plurality of fusion angular velocity values Ω m is consistent with the method of 0531, which will not be described herein.

In the method of 0553, the acquisition of the maximum value Amax and the minimum value Amin of the fusion acceleration is consistent with that in the method of 0513, and the acquisition of the maximum value Ω max and the minimum value Ω min of the fusion angular velocity is consistent with that in the method of 0533, and details are not repeated here.

In the method of 0555, the acquisition of the acceleration difference Δa is consistent with that in the method of 0515, and the acquisition of the angular velocity difference ΔΩ is consistent with that in the method of 0535, and will not be described herein.

In the methods 0551, 0553 and 0555, the data related to the triaxial acceleration and the triaxial angular velocity are consistent with corresponding preset time windows.

In the method of 0557, the control module 11 determines the current state of the head of the user wearing the earphone 10 from the acceleration difference Δa, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω. There are a number of ways of determining. For example, in embodiments of the threshold comparison method, the control module 11 may directly compare the magnitudes of the acceleration difference ΔA and the angular velocity difference ΔΩ with respective thresholds, embodiments of which are described in the methods of 05571 and 05573.

For another example, the control module 11 may determine the current state based on the ratio of the acceleration difference ΔA and the angular velocity difference ΔΩ to the respective thresholds. More specifically, the control module 11 sets the probability of acceleration to P1, the control module 11 sets the probability of angular velocity to P2, the probability of acceleration p1=acceleration difference Δa/acceleration difference threshold ka, the probability of angular velocity p2=angular velocity difference ΔΩ/angular velocity difference threshold kω, the probability of the current state to P, the probability of the current state p=f (P1, P2) is obtained by a predetermined function f, the current state is determined to be the first state when P is in the first section, and the current state is determined to be the second state when P is in the second section.

For example, the control module 11 may comprehensively evaluate the acceleration difference Δa, the acceleration difference threshold ka, the angular velocity difference ΔΩ, the angular velocity difference threshold kω according to a pre-trained machine learning model to determine the current state. And are not described in detail herein.

In the 055 method, the fused acceleration value An carries more information, compared with a non-fused acceleration value, the method can more accurately represent the acceleration information of the current state of the head of the user wearing the earphone 10 and can more represent the moving speed of the head of the user, and the fused angular velocity value Om carries more information, compared with the non-fused angular velocity value, the method can more accurately represent the angle information of the current state of the head of the user wearing the earphone 10 and can more represent the change of the rotation angle of the head of the user. The current state is determined by fusing the acceleration difference Δa obtained by the acceleration values, the angular velocity difference ΔΩ obtained by fusing the angular velocity values, the acceleration difference threshold ka, and the angular velocity difference threshold kω, and the data is rich, so that the current state of the head of the user wearing the earphone 10 is more comprehensively reflected, or in the case that one data (the acceleration difference Δa or the angular velocity difference ΔΩ) is too noisy, the current state of the head of the user wearing the earphone 10 may be obtained with another data (the angular velocity difference ΔΩ or the acceleration difference Δa) or corrected, and the robustness of the control module 11 may be improved.

Referring to fig. 3 and 12, in some embodiments, the method of 0557 includes:

05571 determining that the current state of the head of the user wearing the earphone 10 is the first state in the case where Δa > ka, and/or the angular velocity difference ΔΩ > kω are added;

05573 in the case where the acceleration difference Δa < ka and the angular velocity difference ΔΩ < kω, the current state of the head of the user wearing the headphone 10 is determined to be the second state.

The above-described control method of the earphone may be applied to the earphone 10, and the control module 11 may be further configured to determine that the current state of the head of the user wearing the earphone 10 is a first state in the case of Δa > ka, and/or the angular velocity difference ΔΩ > kω, and determine that the current state of the head of the user wearing the earphone 10 is a second state in the case of the acceleration difference Δa < ka, and ΔΩ < kω.

In addition, in the case where Δa=ka, and ΔΩ=kω, the control module 11 may determine that the current state of the head of the user wearing the headphone 10 is the first state or the second state, and may be set as required. The control module 11 determines the current state together by the comparison result between the acceleration difference value Δa and the acceleration difference threshold value ka, and the comparison result between the angular velocity difference value ΔΩ and the angular velocity difference threshold value kω, with higher accuracy.

Referring to fig. 2,3 and 13, in some embodiments, the control method further includes:

03 identifying a current scene in which the earphone 10 is located, the current scene including a first scene and a second scene, and

And 04, determining a preset state threshold according to the current scene, wherein the preset state threshold in the first scene is smaller than the preset state threshold in the second scene.

The control method of the earphone can be applied to the earphone 10, and the control module 11 is further configured to identify a current scene in which the earphone 10 is located, where the current scene includes a first scene and a second scene, and determine a preset state threshold according to the current scene, where the preset state threshold in the first scene is smaller than the preset state threshold in the second scene.

Specifically, in the methods of 03 and 04, the first scene is a sitting posture scene, and the second scene is a riding scene. It will be appreciated that in a riding scenario, where the road surface is relatively bumpy, the stability of the user's head may be low, and the user's head may be prone to vibration or jolt. The preset state threshold value in the first scene is smaller than the preset state threshold value in the second scene, normal signal agitation generated by the road surface in riding can be filtered, and noise of detection data is reduced.

Referring to fig. 2,3, 14 and 15, in some embodiments, the method of the earphone 10 further includes the instruction receiving module 15,03 includes:

031, determining the current scene based on the triaxial acceleration and the instruction received by the instruction receiving module 15.

The control method of the earphone can be applied to the earphone 10, the earphone 10 of the embodiment of the application further comprises an instruction receiving module 15, the instruction receiving module 15 is used for receiving instructions, and the control module 11 is further used for determining the current scene based on the triaxial acceleration and the instructions received by the instruction receiving module 15.

Specifically, in the method of 031, the manner in which the control module 11 determines the current scene may be independently determined based on the triaxial acceleration, or may be independently determined based on the instruction received by the instruction receiving module 15, or may be determined based on the triaxial acceleration and the instruction received by the instruction receiving module 15 in a fused manner. More specifically, the instruction receiving module 15 receives an instruction sent by an external device, where the external device includes at least one of a mobile phone, a watch, a server, a computer, and a tablet computer. The present application only shows the process of the wristwatch sending an instruction to the headset 10 in fig. 14. The user can turn on the riding mode through keys of the wristwatch or the touch screen, and the wristwatch transmits an instruction to the instruction receiving module 15, whereby the earphone 10 can recognize the current scene.

For example, when the current scene determined based on the tri-axis acceleration is different from the current scene determined based on the instructions received by the receiving module, the prompt module 14 may issue an abnormality alert to let the user determine whether the current scene is correct. The manner in which the control module 11 determines the current scene is not limited to one, and can improve accuracy of current scene recognition and reduce erroneous judgment.

Referring to fig. 2, 3, 14, 15, and 16, in some embodiments, the method 031 includes:

0311, determining whether the current scene is in the first scene based on a change in the Z-axis acceleration among the three-axis accelerations;

0313, determining whether the current scene is in the second scene based on whether the instruction receiving module 15 receives the scene entry instruction.

The control method of the earphone can be applied to the earphone 10, and the earphone 10 of the embodiment of the application comprises a control module 11, wherein the control module 11 is further used for determining whether the current scene is in a first scene or not based on the change of the Z-axis acceleration in the three-axis acceleration, and determining whether the current scene is in a second scene or not based on whether the instruction receiving module 15 receives a scene entering instruction or not.

Specifically, in the method of 0311, the control module 11 may determine whether the current scene is in the first scene according to a change in the Z-axis acceleration. The Z-axis acceleration characterizes the acceleration of the user's head in the Z-axis direction (i.e., the vertical direction). The Z-axis acceleration also changes when the user's head moves in the vertical direction. It will be appreciated that the direction of the Z-axis acceleration is opposite when the user is sitting and standing. That is, for the Z-axis acceleration of the user while sitting (regarded as a first Z-axis acceleration), the direction of the first Z-axis acceleration is a first direction, and for the Z-axis acceleration of the user while standing (regarded as a second Z-axis acceleration), the direction of the second Z-axis acceleration is a second direction, and the first direction and the second direction are opposite. Thus, whether the current scene is in the first scene, i.e., the sitting position scene, can be determined by the change of the Z-axis acceleration.

In the method of 0313, the control module 11 determines whether the current scene is in the second scene, that is, determines whether the current scene is in the riding scene, based on whether the instruction receiving module 15 receives the scene entry instruction. The method for acquiring the scene entering instruction is direct, the accuracy of current scene identification is improved, the control module 11 is not required to judge, and the memory of the control module 11 can be saved.

Referring to fig. 2,3 and 17, in some embodiments, the method for controlling the earphone further includes:

01, setting a preset duration threshold of the earphone 10 in different scenes according to user input;

043, determining a preset time length threshold according to the current scene, wherein the preset time length threshold in the first scene is smaller than the preset time length threshold in the second scene.

The control method of the earphone can be applied to the earphone 10, the earphone 10 of the embodiment of the application comprises a control module 11, the control module 11 is further used for setting preset duration thresholds of the earphone 10 in different scenes according to user input, identifying a current scene of the earphone 10, wherein the current scene comprises a first scene and a second scene, and determining the preset duration threshold according to the current scene, wherein the preset duration threshold in the first scene is smaller than the preset duration threshold in the second scene.

Specifically, the preset duration thresholds corresponding to different current scenes are different, that is, the first scene corresponds to the preset duration threshold in the first scene, and the second scene corresponds to the preset duration threshold in the second scene. Therefore, the preset time length threshold value which is more in line with the current scene can be set according to the different current scenes, so that the judgment of the subsequent current state is more accurate. The preset duration threshold value in the first scene is smaller than the preset duration threshold value in the second scene, so that the duration threshold value in the second scene can be reduced

Referring to fig. 2,3 and 17, in some embodiments, the control method further includes:

When the accumulated time length does not reach the preset time length threshold value, the accumulated time length is cleared, and the detection data acquired by the acquisition sensor module 12 is returned to be executed.

The method for controlling the earphone can be applied to the earphone 10, and the earphone 10 according to the embodiment of the application comprises a control module 11, wherein the control module 11 is further used for clearing the accumulated time length and returning to execute the detection data acquired by the acquisition sensor module 12 when the accumulated time length does not reach the preset time length threshold.

Specifically, the present invention relates to a method for manufacturing a semiconductor device. The earphone control method further comprises 09 whether the accumulated time length reaches a preset time length threshold value. I.e. the control module 11 is configured to determine whether the accumulated duration reaches a preset duration threshold. The method 09 includes the method 091, if the accumulated duration does not meet the method 091, the accumulated duration is cleared when the accumulated duration does not reach the preset duration threshold, and the detection data acquired by the acquisition sensor module 12 is returned to be executed. During the period of time accumulated by the control module 11, the user's head may suddenly rotate or move, if the current state of the head exceeds a certain threshold, for example, at a certain moment in any time window, the acceleration difference Δa is greater than the acceleration difference threshold ka, and the angular velocity difference ΔΩ is greater than the angular velocity difference threshold kω, the accumulated period of time is cleared, and the control module 11 returns to and re-executes the methods of 02, 05, 07, 09.

Referring to fig. 2,3 and 17, in some embodiments, the control method further includes:

After the prompt message is sent, the accumulated time length is cleared, and the detection data acquired by the acquisition sensor module 12 is returned to be executed.

The control method of the earphone can be applied to the earphone 10, and the earphone 10 in the embodiment of the application comprises a control module 11 and a prompt module 14, wherein the control module 11 is further used for clearing accumulated time length after the prompt module 14 sends out prompt information and returning to execute to acquire detection data acquired by the sensor module 12.

Specifically, after the prompt module 14 sends the prompt information, the accumulated duration in the control module 11 is cleared, and the control module 11 returns to the method after executing 02 and 02. Therefore, the earphone 10 can continuously determine the current state of the head of the user wearing the earphone 10 according to the detection data and the preset state threshold, and send out the prompt message again when the accumulated time length reaches the preset time length threshold. Continuous detection of the current state of the head of the user by the headset 10 is achieved.

Referring to fig. 2,3 and 18, the present application further provides a computer readable storage medium 200 having a program 202 stored thereon, where the program 202, when executed by the processor 20, implements the control method according to any of the above embodiments.

For example, in the case where the program 202 is executed by the processor 20, the following control method is implemented:

02, acquiring detection data acquired by the sensor module 12;

07, under the condition that the current state is the second state, accumulating the duration that the head of the user is continuously in the second state;

091, sending out prompt information under the condition that the accumulated time length reaches a preset time length threshold value.

As another example, in the case where the program 202 is executed by the processor 20, the following control method is implemented:

0551, fusing triaxial acceleration under a plurality of preset moments in a preset time window to obtain a plurality of fused acceleration values corresponding to the preset moments respectively, and fusing triaxial angular velocities under the plurality of preset moments in the preset time window to obtain a plurality of fused angular velocity values corresponding to the preset moments respectively;

0553 screening out a fusion acceleration maximum value Amax and a fusion acceleration minimum value Amin from a plurality of fusion acceleration values, and screening out a fusion angular velocity maximum value OMEGA max and a fusion angular velocity minimum value OMEGA min from a plurality of fusion angular velocity values;

For another example, when the program 202 is executed by the processor 20, the control methods 01、02、03、031、0311、0313、04、043、05、051、0511、0513、0515、0517、05171、05173、053、0531、0533、0535、0537、05371、05373、055、0551、0553、0555、0557、05571、05573、07、09、091、 and 093 can be realized.

In the computer readable storage medium 200 of the present application, the control module 11 of the earphone 10 can determine the current state of the head of the user wearing the earphone 10 by detecting data and a preset state threshold, determine whether the head is in the second state, accumulate the duration that the head is continuously in the second state, and send out a prompt message to prompt the user that the head is continuously in the second state for a certain duration when the accumulated duration reaches the preset duration threshold, so as to prompt the user that the current state of the head needs to be changed, and avoid the head of the user being in the same state for a long time, thereby avoiding fatigue of the head being in the same state for a long time.

In the description of the present specification, reference to the terms "certain embodiments," "in one example," "illustratively," and the like, means that a particular feature, structure, material, or characteristic described in connection with the embodiments or examples is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

While embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the application, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the application.