CN107103840B - Foldable device and control method thereof - Google Patents

For example, when the hinge is installed on the

100, the

100 may be folded in such a manner that two surfaces of the

100 are folded by the hinge to such an extent that the two surfaces are in contact with each other or almost in contact with each other to become parallel or almost parallel. Further, when the

100 is formed of a flexible material, the

100 may be folded along an arbitrary line to the extent that two surfaces of the

100 approach each other and become parallel.

As shown in fig. 1A, the

100 may be a foldable

100 that is folded using a hinge.

As shown in fig. 1A, the

100 may be used in a folded state or may be used in an unfolded state.

The

100 may switch its screen according to the state of the

100.

Further, throughout the specification, the state of the

100 is changed from the open state to the folded state by the folding motion. The

100 changes from the folded state to the unfolded state by the unfolding motion.

According to one or more exemplary embodiments, the

100 may include a smartphone, a tablet Personal Computer (PC), a notebook, a wearable device, an electronic book, or the like.

In an exemplary embodiment, when the

110 of the first application is displayed on the

100, if the

100 detects a folding motion or an unfolding motion, the

100 may simultaneously display the

110 of the first application and the

120 of the second application. The second application may vary according to various exemplary embodiments.

Throughout the specification, "the execution screen of the first application", "the first application screen", or "the screen of the first application" refers to a screen displayed on the display as a result of executing the first application. Further, "the execution screen of the second application", "the second application screen", or "the screen of the second application" refers to a screen displayed on the display as a result of executing the second application. Referring to fig. 1A, when the

100 is in a folded state, areas of two surfaces facing each other are the same. Accordingly, the

100 may be symmetrically folded, but this is merely an example, and the areas of two surfaces facing each other in the folded state may be different. Thus, the

100 may be folded asymmetrically.

Fig. 1B illustrates an

100 folded by bending according to another exemplary embodiment.

As shown in fig. 1B, the

100 may be bent in an arbitrary line, and since the

100 is bent, a region where the arbitrary line exists may be bent to a predetermined degree. Further, when two surfaces facing each other become parallel due to bending of the electronic device, the

100 may be in a folded state.

Fig. 2 is a block diagram of an

100a according to another example embodiment.

The

100a includes a display 210 (i.e., a display unit), a state detector 220 (i.e., a state detection unit), and a controller 230 (i.e., a control unit).

The

210 displays a screen of an application run by the

230, a user interface screen, or a screen showing a state of the

100 a. The

230 runs at least one application and controls the

210 to display a screen of the at least one running application on the

210. When the execution screen of at least one first application is displayed, if the

230 detects a folding motion or an unfolding motion with respect to the

100a, the

230 causes the execution screen of the at least one first application and the execution screen of at least one second application to be simultaneously displayed.

For example, as shown in fig. 1A, when the

100a in the folded state displays the execution screen of the

110, if the

100a is unfolded and the

230 thus detects the unfolding motion, the

100a may simultaneously display the execution screen of the

110 and the execution screen of the

120.

The

230 may generally control the operation of the

100 a. For example,

230 may run and control an Operating System (OS) of

100a, may process various types of data, and may control elements of

100a (including

210,

220, etc.).

The

220 detects a folding motion and an unfolding motion for the

100 a.

In one or more exemplary embodiments, the

220 may detect a movement that changes the state of the

100a from the folded state to the open state, or a movement that changes the state of the

100a from the open state to the folded state.

The

100 may include a

7880, i.e., a sensor (see fig. 78). The

7880 may sense a state of the

100, a motion of the

100, or a situation around the

100, and may transmit the sensed information to the

230.

The

7880 may include at least one of the following sensors: a magnetic sensor, an acceleration sensor, a hall sensor, a bending sensor, a gyroscope sensor, a proximity sensor, a temperature/humidity sensor, an infrared sensor, a location sensor (e.g., Global Positioning System (GPS)), an atmospheric pressure sensor, an RGB sensor (i.e., an illuminance sensor), but one or more exemplary embodiments are not limited thereto. The function of the sensor may be understood by those of ordinary skill in the art based on the name of the sensor or is well known in the related art.

In one or more exemplary embodiments, the

220 of the

100a may detect a movement that changes the state of the

100a to an open state or a folded state by using the

7880. For example, the

220 may detect the folding motion or the unfolding motion by using a hall sensor or a magnetic sensor provided in the folding area.

In one or more exemplary embodiments, the

220 may detect whether the current state of the

100a is an open state or a folded state, and the

220 may detect a folding motion or an unfolding motion when the current state is changed.

In one or more exemplary embodiments, the

220 may measure a bending angle or a folding angle of the

100 a. If the

100a has a hinge, the

220 may measure the folding angle of the hinge.

In one or more exemplary embodiments, the state detection sensor is included in a region of the

100a that are close to each other when the

100a are bent or folded, and thus the

220 may detect the folded state. The state detection sensor may include at least one of a proximity sensor, an illuminance sensor, a magnetic sensor, a hall sensor, a touch sensor, a bending sensor, and an infrared sensor, or a combination thereof.

In one or more exemplary embodiments, the

220 may determine whether the

100a is in a folded state or an open state, and may provide the determination result to the

230. In this case, the

230 may not need to separately determine the folded state or the opened state, but may recognize whether the state of the

100a is the folded state or the opened state according to the output from the

220.

In one or more exemplary embodiments, when the

220 provides the

230 with information about a bending angle or a folding angle or sensed information obtained by the state detection sensor, the

230 may determine the folded state or the opened state of the

100 a.

Fig. 3 is a block diagram of an

100b according to another example embodiment.

The

100b may include a

310 and a

320. The

310 and the

320 may be distinguished from each other in a hardware manner or a software manner.

For example, the

310 and the

320 may be two hardware screens. The

310 and the

320 may be respectively disposed on any surfaces of the

100b along the same direction. In addition, the

310 may be disposed at a front surface of the

100b, and the

320 may be disposed at a rear surface of the

100 b.

In one or more exemplary embodiments, the

310 and the

320 may be one physical element including two different regions as software.

One display formed on one surface of the

100b may be divided into at least two software regions, which may be used as a display part, respectively. For example, a hardware screen provided at the front surface of the

100b may be divided into at least two software areas, which may be the

310 and the

320, respectively.

Further, a portion of the hardware screen disposed at the front surface of the

100b may be the

310, and a portion of the hardware screen disposed at the rear surface of the

100b may be the

320.

When the display is software, the position and size of the display may be changed according to whether the

100b is folded or rolled. The position or size of the display may be changed dynamically.

Although fig. 3 illustrates two displays (i.e., the

310 and the

320 in one or more exemplary embodiments), the

100b may include at least three displays.

The

230 may control the first and second application screens to be displayed on at least one of the first and

310 and 320. In one or more exemplary embodiments, a first application screen may be displayed on the

310 and a second application screen may be displayed on the

320.

Fig. 4 illustrates an arrangement of a

310 and a

320 according to an exemplary embodiment.

As shown in fig. 4, when the front surface of the

100b is a first surface and the rear surface of the

100b is a second surface, the

310 may be disposed on the first surface of the

100b and the

320 may be disposed on the second surface of the

100 b.

Each of the

310 and the

320 may correspond to a portion of a surface of the

100b, or may correspond to an entire portion of the surface. In one or more exemplary embodiments, the

310 may be disposed on the first surface of the

100b as a whole, or may be divided into a plurality of regions, and may be disposed on the first surface of the

100 b. In one or more exemplary embodiments, the

320 may be disposed on the second surface of the

100b as a whole, or may be divided into a plurality of regions, and may be disposed on the second surface of the

100 b.

Fig. 5 illustrates an

100 implemented to have a foldable structure according to an exemplary embodiment.

The

100 may be implemented in such a way: the elements of the device 100 (including the

310, the

320, the

230, the housing, etc.) are flexible. In one or more exemplary embodiments, only some elements of the apparatus 100 (e.g., the housing, etc.) may be flexible, and other elements (e.g., the battery, etc.) may be rigid.

The

210 may be implemented to have at least one of a foldable structure, a flexible structure, and a rigid structure. In addition, the

310 may be foldable and the

320 may be rigid.

When the

210 has a foldable characteristic, a folding area of the

210 may be set to match a folding area of the

100.

When the

210 has a flexible characteristic, the

210 may be freely disposed on the

100.

When the

210 has a rigid characteristic, the

210 may be disposed in an area of the

100 other than the foldable area or the bendable area.

The

100 comprising the flexible display may be deformed by using a hinge or by being bendable. The

100 may be folded by deforming. In fig. 6 through 11, when the

100 is folded, the

610 may indicate a portion deformed due to being folded.

As shown in fig. 6, the

210a may be unitary to span the

610 at the first surface of the

100 a. The

210a may be a foldable display or a flexible display. The display may not be disposed on the second surface of the

100 a.

The folding motion may be defined as a motion of folding two areas of the first surface exposing the second surface divided by the

610 to face each other. An unfolding motion may be defined as a motion that causes the

100a to unfold after the

100a is folded.

Display 210a1 and display 210a2 may be disposed in two regions of the first surface of

100a, where the two regions do not overlap with

610. Thus, the region is divided by the

610. Each of display 210a1 and display 210a2 may be at least one of a foldable display device, a flexible display device, and a rigid display device.

The folding motion may be defined as a motion in which the first surface is exposed and two regions of the second surface divided by the

610 are folded to face each other. An unfolding motion may be defined as a motion that causes the

100a to unfold after the

100a is folded.

Fig. 8 illustrates a

310a and a

320a according to another exemplary embodiment.

The

310a may be a unitary body to span the

610 at the first surface of the

100 b. The

320a may be disposed in one of two regions of the second surface of the

100b, wherein the two regions are separated by a

610. The

310a may be a foldable display device or a flexible display device. The

320a may be at least one of a foldable display device, a flexible display device, and a rigid display device.

Fig. 9 illustrates a structure of a

310a and a

320b according to another exemplary embodiment.

The

310a may be unitary, spanning the

610 at the first surface of the

100 b. The

320b may be unitary, spanning the

610 at the second surface of the

100 b. Each of the

310a and the

320b may be a foldable display device or a flexible display device.

Fig. 10 illustrates a structure of the first and

310a and 320c1 and 320c2 according to another exemplary embodiment.

The

310a may be unitary, spanning the

610 at the first surface of the

100 b. The second displays 320c1 and 320c2 may be disposed in two regions of the second surface of the

100b, wherein the two regions are separated by a

610. The

310a may be a foldable display device or a flexible display device. Each of the second displays 320c1 and 220c2 may be at least one of a foldable display device, a flexible display device, and a rigid display device.

Fig. 11 illustrates a structure of the first displays 310b1 and 310b2 and the

310a according to another exemplary embodiment.

The first displays 310b1 and 310b2 may be respectively disposed at two regions of the first surface of the

100b, wherein the two regions do not overlap the

610 and are divided by the

610. The

320a may be disposed in one of two regions of the second surface of the

100b, wherein the two regions are divided by the

610. Each of the first displays 310b1 and 310b2 and the

320a may be at least one of a foldable display device, a flexible display device, and a rigid display device.

As shown in fig. 12, the

310a may correspond to a portion of a hardware screen disposed on a first surface of the

100 b. The

320a may correspond to a portion of a hardware screen disposed on a second surface of the

100 b.

As shown in fig. 13, the first display 310a1 may correspond to a portion of a hardware screen disposed on a first surface of the

100 b. The second display 310a2 may correspond to the remaining portion of the hardware screen other than the portion of the

1.

Fig. 14A to 14F illustrate folded states of the

100 according to various exemplary embodiments.

The folded state of fig. 14A, 14B, and 14C is an example in which the

100 is folded using a hinge. The folded state of fig. 14D, 14E, and 14F is an example in which the

100 is folded by bending.

The folded state and the unfolded state may be quantized into folded shape estimates within a predetermined range. The folded shape estimate may vary depending on the configuration of the

220. For example, the folded shape estimation value may be a bending angle of the

100, a folding angle of the

100, or a sensing value of a state detection sensor. For example, the sensing value of the state detection sensor may be a sensing value of a proximity sensor, a sensing value of an illuminance sensor, a sensing value of a magnetic sensor, a sensing value of a hall sensor, or a sensing value of a touch sensor.

The folded state of the

100 may be estimated based on the folded angle of the

100, but the one or more exemplary embodiments are not limited thereto.

The folded state refers to a state in which the folded angle of the

100 is in the first range. For example, the folded state may refer to a state in which the folded angle of the

100 is close to 0 degree. As shown in fig. 14A to 14F, the folding angle refers to an angle defined from a vertex at which two facing surfaces intersect due to folding.

The fold lines of the

100 may be preset such that the

100 may be folded only at the preset fold lines. The number of fold lines may vary according to various exemplary embodiments. For example, the

100 may be folded in various ways, e.g., the

100 may be folded two or three times.

In one or more exemplary embodiments, the

100 may be folded or bent at any point of the

100. In this case, the

100 may detect the folded or bent shape by using a sensor.

Fig. 15 shows a folded state of the

100 according to an exemplary embodiment.

The folded state of the

100 refers to a state in which the

100 is symmetrically folded. As shown in fig. 15, the

100 may be folded symmetrically at the

610. The

100 may be folded symmetrically by using a hinge. In one or more exemplary embodiments, the

100 may be symmetrically folded by bending.

Fig. 16 shows a folded state of the

100 according to another exemplary embodiment.

Here, the folded state of the

100 refers to a state in which the

100 is folded asymmetrically. As shown in fig. 16, the

100 may be folded asymmetrically, exposing the

1610. The

100 may be folded asymmetrically by using a hinge. In one or more exemplary embodiments, the

100 may be folded asymmetrically by bending.

In one or more exemplary embodiments, key buttons, a portion of the

210, a touch sensor, etc. may be disposed in the

1610.

Fig. 17 shows the folded state of the

100b according to an exemplary embodiment.

Here, the folded state of the

100b means a state in which: when one of the

310 and the

320 of the

100b is disposed to face the user, the quadrangular portion of the other of the

310 and the

320, which does not face the user, is asymmetrically folded to face the user. For example, as shown in fig. 17, when the

310 is disposed to face a user, a portion of the

320 may be asymmetrically folded, thereby facing the user. The

100b may be folded asymmetrically by using a hinge. In one or more exemplary embodiments, the

100b may be asymmetrically folded by bending.

Fig. 18 shows the folded state of the

100b according to another exemplary embodiment.

The folded state of the

100b means the following state: when one of the

310 and the

320 of the

100b is disposed to face the user, the triangular portion of the other not facing the user is asymmetrically folded to face the user. For example, as shown in fig. 18, when the

310 is disposed to face a user, the triangular portion of the

320 may be folded into a triangle, thereby facing the user.

The

100b may be folded asymmetrically by using a hinge or by bending.

Fig. 19 shows the folded state of the

100b according to another exemplary embodiment.

The folded state of the

100b means the following state: when one of the

310 and the

320 of the

100b is disposed to face the user, portions of the other of the

310 and the second display, which does not face the user, are folded, thereby being exposed in a plurality of regions. For example, as shown in fig. 19, when the

310 is disposed to face a user, the third and

1910 and 1920 of the

320 may be folded to face the user. The folded state shown in fig. 19 may be referred to as a multi-region folded state.

The

100b may be folded asymmetrically by using a hinge or by bending.

Fig. 20A to 20F illustrate an opened state of the

100 according to various exemplary embodiments.

The state of fig. 20A, 20B, and 20C is an example in which the

100 is folded by using a hinge. The states of fig. 20D, 20E, and 20F are examples in which the

100 is folded by bending.

The unfolded state refers to a state in which the folding angle of the

100 is within the second range. For example, the unfolded state may refer to a state in which the folding angle of the

100 is approximately equal to 180 degrees.

Fig. 21 shows an open state of the

100 according to an exemplary embodiment.

As shown in fig. 21, in the unfolded state, when the folding angle of the

100 is 180 degrees, the

100 is unfolded. As shown in fig. 21, the window of the

210 shown in the open state may be divided so that a plurality of application screens may be displayed on the divided window (S2102).

In one or more exemplary embodiments, at least one display having one of various shapes may be disposed on a surface opposite to the

210 exposed in the open state. Further, as shown in fig. 21, the display on the opposite surface may be in a closed state (S2104).

Fig. 22 shows an open state of the

100 according to another exemplary embodiment.

As shown in fig. 22, in the open state, the

100 is unfolded, and thus, the folding angle of the

100 is approximately 180 degrees. As shown in fig. 22, one application screen may be displayed on the

210 exposed in the open state (S2202).

In one or more exemplary embodiments, at least one display having one of various shapes may be disposed on a surface opposite to the

210 exposed in the open state. Further, as shown in fig. 22, the display on the opposite surface may be in a closed state (S2204).

The device to be controlled by using the method may be any electronic device that is folded by folding with a hinge or by bending and has at least one display. For example, the method may be performed on the

100a shown in fig. 2 or the

100b shown in fig. 3. The method is performed on the

100a shown in fig. 2, but one or more exemplary embodiments are not limited thereto.

The

100a displays a screen of the first application on the display 210 (S2502).

When the

220 or the

230 detects the folding motion or the unfolding motion (S2504), the

230 simultaneously displays the screen of the first application and the screen of the second application on the display 210 (S2506).

When an unfolding motion that changes the state of the

100 from a folded state to an open state is detected, the execution screen of the first application and the execution screen of the second application may be simultaneously displayed.

First, the

100 in the folded state displays the execution screen of the first application (S2602).

When the

100 is in the folded state, the

230 may display a running screen of the first application on the first surface of the flexible display serving as the display. As shown in fig. 6, in a case where the

210a is displayed on the first surface of the

100 as a whole, the execution screen of the first application may be displayed in an area of the

210 a. As shown in fig. 7, in the case where the displays 210a1 and 210a2 are respectively disposed at two regions of the first surface of the

100a (where the two regions are separated by the folding region 610), the execution screen of the first application may be displayed on only one of the displays 210a1 and

2.

As shown in fig. 9 and 12, when the

320b is disposed to span the

610, the execution screen of the first application may be displayed on an area of the

320 b. The area of the

320b may be an area facing a user, a predefined area, etc. As shown in fig. 10, in the case where the second displays 320c1 and 320c2 are respectively disposed at two regions of the second surface of the

100a, which are separated by the

610, the execution screen of the first application may be displayed on only one of the second displays 320c1 and

2. The one of the second displays 320c1 and 320c2 on which the execution screen of the first application is displayed may be a user facing area, a predefined area, or the like.

Next, when the

220 detects the unfolding motion (S2604), the

230 simultaneously displays the execution screen of the first application and the execution screen of the second application (2606).

When the

100 in the folded state is unfolded, the

230 may display a running screen of the first application and a running screen of the second application on the second surface of the flexible display serving as the display. The second application may be related to the first application. The user may use the

100 in a folded state generally, and then, when the user desires to use a larger screen, the user may unfold and use the

100. Further, since the

100 in the open state can simultaneously display the execution screen of the first application and the execution screen of the second application, the user can conveniently use a plurality of applications.

As shown in fig. 27, when the state of the

100 is changed from the folded state in which the screen of the first application is displayed on the

210 to the open state, the screen of the first application and the screen of the second application may be simultaneously displayed on the

210.

When the

100 is in the folded state, the screen of the first application is displayed on an area of the

210 of the first surface of the

100, and when the

100 is in the open state, the screen of the first application and the screen of the second application are displayed on the entire area of the

210 of the first surface.

In one or more exemplary embodiments, when the

100 is in the folded state, a screen of a first application is displayed on an area of the

210 of the first surface of the

100, and when the

100 is in the opened state, a screen of the first application and a screen of a second application are displayed on the

210 of the second surface of the

100.

When the

100b detects a folding motion that changes the state of the

100b from the open state to the partially folded state, the

100b simultaneously displays the screen of the first application and the screen of the second application. The partially folded state (as shown in fig. 17 to 19) refers to the following state: when one of the

310 and the

320 of the

100b is disposed to face the user, a portion of the other of the

310 and the

320, which does not face the user, is asymmetrically folded to face the user.

First, the

100b in the open state displays a screen of a first application on the first display 310 (S2802). When the

220 detects a folding motion for changing the

100b into a partially folded state (S2804), the

230 displays a screen of a first application on an area of the

310 and displays a screen of a second application on an area of the second display 320 (S2806).

In the embodiment of fig. 28, the

310 and the

320 may be disposed on different surfaces of the

100b, respectively.

The region of the

310 may be a region of the

310 that is exposed to a user according to a state in which the portion of the

100b is folded. I.e., the area of the

310 not covered by the

320.

The region of the

320 refers to a region disposed in a direction exposed to the user according to the partially folded state of the

100 b.

As shown in fig. 29A and 29B, when the screen of the first application is displayed on the

310 of the device 100B in the open state (S2902), when the

100a is changed to the partially folded state having the quadrangular shape (S2904), the screen of the first application may be displayed on an area of the

310 and the screen of the second application may be displayed on an area of the

320.

As shown in fig. 29A, the screen of the first application may be displayed with a portion of the screen of the first application covered. That is, the

320 covers a portion of the screen of the first application.

Alternatively, as shown in fig. 29B, in one or more exemplary embodiments, at least one of the size and scale of the screen of the first application may change to match the area of the region not covered by the

320. The screen of the second application may be displayed on an area of the

320 disposed on the same side as the

310 due to the folding. The screen size of the second application may be adjusted to match the size of the screen of the first application that changes due to the folding, or may be displayed with a portion of the screen of the second application overlaid.

As shown in fig. 30A and 30B, when the screen of the first application is displayed on the

310 of the device 100B in the open state, when the device 100B is changed to the partially folded state having the triangular shape, the screen of the first application may be displayed on an area of the

310 and the screen of the second application may be displayed on an area of the

320.

As shown in fig. 30A, the screen of the first application may be displayed in a state where a portion of the screen of the first application is covered. That is, the

320 may cover a portion of the screen of the first application.

Alternatively, as shown in fig. 30B, in one or more exemplary embodiments, at least one of the size and scale of the screen of the first application may be changed to correspond to an area of the region not covered by the

320. Further, in one or more exemplary embodiments, a blank area where no content is displayed may be included in an area not covered by the

320. The blank area may have a size or shape that causes the screen of the first application to be displayed in a rectangular shape.

The screen of the second application may be displayed on an area of the

320 disposed on the same side as the

310 due to the folding. The screen of the second application may be adjusted to match the size of the area of the

320.

As shown in fig. 31A and 31B, when a screen of a first application is displayed on the

310 of the device 100B in an open state, when a plurality of regions of the device 100B are changed to a partially folded state, the screen of the first application may be displayed on the region of the

310 and the screen of a second application may be displayed on one or more regions of the

320. For example, a text message received from a person named cheolso KIM may be displayed on

3110 and a phone application screen displaying an icon for calling cheolso KIM may be displayed on

3120.

As shown in fig. 31A, the screen of the first application may be displayed with a portion of the screen of the first application covered. That is, the plurality of

3110 and 3120 of the

320 may cover a portion of the screen of the first application.

Alternatively, as shown in fig. 31B, in one or more exemplary embodiments, at least one of the size and scale of the screen of the first application may be changed to match the area of the region not covered by the

3110 and 3120 of the

320.

The screen of the second application may be displayed on

3110 and 3120 of the

320 disposed on the same side as the

310 due to the folding. In addition, screens of different applications may be displayed on the plurality of

3110 and 3120 of the

320.

The screen of the second application may be adjusted to match the size of the

3110 and 3120 of the

320 that are in the same direction as the

310 due to the folding.

When the user uses the

100b in the open state, if the user wants to view simple contents, the user may fold the region of the

100b, and thus may view the simple contents by using the display on the opposite surface of the

100 b. For example, when the user watches a video, if the

2910 indicating that a text message is received is displayed, the user may fold the region of the

100b and may simply view the content of the text message.

Fig. 32 is a flowchart of a method of controlling the

100 according to another exemplary embodiment.

When the

100 detects the folding motion or the unfolding motion, the

100 determines the second application according to the preset criterion. According to one or more exemplary embodiments, the preset criterion for determining the second application may be changed.

First, the

100 displays a screen of a first application (S3202), and when the

220 detects a folding motion or an unfolding motion (S3204), the

230 determines a second application (S3206). Next, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S3208).

Fig. 33 shows a structure of an

100c according to another exemplary embodiment.

The

100c includes a

210, a

220, a

230, and a user interface 3310 (i.e., a user input unit or an input/output (I/O) unit).

The

210 displays a screen of an application run by the

230, a screen of a user interface, or a screen indicating a state of the

100 c.

210 may include a

310 disposed on a first surface of

100c and a

320 disposed on a second surface of

100 c.

The

230 runs at least one application and controls the

210 to display a screen of the at least one application. When the screen of the first application is displayed, if the

230 detects a folding motion or an unfolding motion, the

230 simultaneously displays the screen of the first application and the screen of the second application.

The

230 may generally control the operation of the

100 c. For example,

230 may run an operating system of

100c, may process various types of data, and may control elements of

100c (including

210,

220,

3310, etc.).

The

3310 receives user input. The

3310 may include at least one of a key, a touch sensor, a touch screen, a pen recognition panel, a bending sensor, a bio-signal detection sensor, and a microphone, or a combination thereof. The

3310 may be provided together with a user interface screen through a Graphical User Interface (GUI).

The

3310 may receive user inputs for controlling the

100 c. For example, the

3310 may receive user input to turn the

100c on and off, user input to run an application, user input to an application, and so forth. Further, the

3310 may receive a user input selecting the second application, a user input selecting whether to simultaneously display the screen of the first application and the screen of the second application when the folding motion or the unfolding motion is detected, or a user input selecting a display method related to the screen of the second application when the folding motion or the unfolding run is detected.

The

3310 may receive a user input selecting the second application. For example, the

230 may display a second application selection menu on the

210 and may receive user input through the second application selection menu. The

230 may determine the second application based on user input via the

3310.

In one or more exemplary embodiments, when the folding motion or the unfolding motion is detected, the

3310 may receive a user input selecting whether the screen of the first application is simultaneously displayed with the screen of the second application. The

230 displays the screen of the second application and the screen of the first application only when the user selects to display the screen of the second application.

Fig. 34 is a flowchart of a method of controlling the

100 according to another exemplary embodiment.

First, the

230 simultaneously displays the second application selection menu and the screen of the first application (S3402). The second application selection menu is configured to allow the user to select the second application.

A second application selection menu may be displayed as a GUI on the

210.

In one or more exemplary embodiments, the second application selection menu is provided to receive a user input via a touch sensor, key buttons, or the like provided in a predetermined area of the housing of the

100 c. Here, information regarding the second application selection menu may be displayed on an area of the

210.

Next, when the

220 detects the folding motion or the unfolding motion (S3404), the

230 determines whether an input of a user selection has been received through the second application selection menu (S3406).

If the input of the user selection has been received (S3406), the

230 may determine the application selected by the user as the second application, and may simultaneously display a screen of the first application and a screen of the second application (S3408).

If the input selected by the user has not been received (S3406), the

230 changes the screen of the

210 according to the preset criteria (S3410). The preset criteria may vary according to various exemplary embodiments. The preset criteria may include determining an application as the second application, wherein the application is preset to run with the first application. In one or more exemplary embodiments, the preset criterion may include determining an application as the second application, wherein the application is preset by a user via a setting menu or the like. In one or more exemplary embodiments, the preset criterion may include changing a screen of the first application by changing a size or a setting of the screen of the first application when the folding motion or the unfolding motion is detected.

Fig. 35 illustrates an example of providing the second

3520 according to an exemplary embodiment.

The

100c may be folded asymmetrically. In a folded state, the

100c displays a screen of a first application on the

210 and provides a second

3520 using the

3510.

The second

3520 displays one or more user-selectable applications and receives user input selecting an application. As shown in fig. 35, the

3510 may be divided into a plurality of regions to which the user-selectable applications may be respectively matched.

A screen of a first application may be displayed on the

320 and the

3510 may be located on the

310. The

3510 may be defined as a portion of the

310 exposed in a folded state. If the

310 is a touch screen, a second

3520 may be displayed on the

3510 and the

100c may receive user input (being a touch input to the first display 310).

In one or more exemplary embodiments, the

3510 may be a region on a housing of the

100c where a touch sensor, a proximity sensor, or the like is disposed. In one or more exemplary embodiments, information regarding the second

3520 may be displayed on the

3510 on the housing or may be displayed on an outwardly exposed region of the

210.

The second

3520 is provided via a predetermined area physically separated from the

210 which asymmetrically folds and displays the first application. The user can intuitively access the second

3520. Also, since the second

3520 is provided by using an area of a lower layer exposed due to asymmetric folding, the second

3520 may be displayed without covering the screen of the first application and complicating the screen setting.

Fig. 36 illustrates an example of providing a second

3650 according to another exemplary embodiment.

Referring to fig. 36, the second

3650 may be provided only in response to a user's request for the second

3650. For example, the

230 of the

100c in the folded state may display a screen of a first application and a

3640 for requesting a second

3650 on the display 210 (S3610). The user may request

100c to display a second

3650 by selecting

3640. For example, the user may request the

100c to display the second

3650 by clicking or dragging the

3640.

When the

100c displays the second

3650, the

230 may display a screen of the first application and the second

3650 on the display 210 (S3620). The user may select the second application from the second

3650. User input may be received in the form of touch input, key input, pen input, voice input, and the like.

When the user selects the second application from the second

3650 and changes the

100c to the open state (S3630), the

230 displays a screen of the first application and a second application screen on the display 210 (S3630). As described above with reference to fig. 34, if the user does not select the second application, when the folding motion or the unfolding motion is detected, the screen of the

210 may be determined and displayed according to the preset criteria.

Referring to fig. 36, the state of the

100c is changed from the folded state to the open state. In one or more exemplary embodiments, even if it is preset that a screen of a first application and a screen of a second application are simultaneously displayed when the state of the

100c is changed from the open state to the folded state, the

3640 requesting the second

3650 may be provided. That is, in a folded state of the

100c, a screen of the first application and the

3640 may be provided, and when the user requests the second

3650, the

100c in the folded state may simultaneously display the screen of the first application and the second

3650. Further, if the user selects the second application, when the state of the

100c is changed from the folded state to the open state, the

100c in the open state may simultaneously display the screen of the first application and the screen of the second application selected by the user.

The second

3650 may be displayed together with the screen of the first application only when the user desires. Accordingly, it is possible to significantly reduce the problem of the screen setting being complicated due to the second

3650 or due to the screen of the first application being covered by the second

3650.

Fig. 37 illustrates an example of providing a second

3730 according to another exemplary embodiment.

Referring to fig. 37, the

230 of the

100c in the open state displays a screen of a first application and a second

3730 on the first display 310 (S3710). When a user input selecting the second application is received via the second

3730 and the

100c is partially folded, the

230 displays a screen of the first application on the

310 and displays a screen of the second application selected by the user on the exposed area of the second display 320 (S3720).

The user having selected the second application can view the screen of the second application by performing a simple gesture (e.g., partially bending or folding a portion of the

100 c), and thus the user can conveniently view the screen of the second application.

Referring to fig. 38, the

100c simultaneously displays a first application screen and information on a second application selection menu and receives a user's selection by using elements of the

3310 formed on the housing of the

100 c. For example, the

100c may receive a user's selection by using the

3810a and 3810b as elements of the

3310.

The

100c may also accurately receive the user input by using the

3310 provided on the housing of the

100c, and the area of the screen occupied by the second application selection menu is reduced.

First, the

230 displays a screen of a first application on the display 210 (S3902).

Next, when the

220 detects the folding motion or the unfolding motion (S3904), the

230 displays the screen of the first application and the second application selection menu simultaneously (S3906).

When receiving a user selection for the second application (S3908), the

230 determines the application selected by the user as the second application and simultaneously displays a screen of the first application and a screen of the second application (S3910).

After detecting the folding motion or the unfolding motion (S3904), if the user selection is not received within a preset time, the

230 may remove the second application selection menu from the screen.

As shown in fig. 40, when an unfolding motion for the

100c is detected, the

230 may simultaneously display a screen of a first application and a second

4010 on the

210. In addition, a similar example may be made when a folding motion for the

100c is detected.

First, the

230 displays a screen of a first application on the display 210 (S4102).

Next, when the

220 detects a folding motion or an unfolding motion (S4104), a screen of the first application, a screen of the second application, and a second application selection menu are simultaneously displayed (S4106).

When a user input to select the second application is received (S4108), the

230 simultaneously displays a screen of the first application and a screen of the second application selected by the user (S4110). The previously displayed screen of the second application is replaced by a screen of the second application selected by the user. In one or more exemplary embodiments, a previously displayed screen of the second application and a screen of the second application selected by the user are simultaneously displayed.

After detecting the folding motion or the unfolding motion (S4104), if a user input selecting the second application is not received within a preset time, the

230 may remove the second application selection menu from the screen.

Fig. 42 illustrates an example of providing a second

4210 according to another exemplary embodiment.

Referring to fig. 42, the

230 of the

100c in the folded state displays a screen of a first application on the

210, and when the

100c is changed to the open state, the

230 may simultaneously display the screen of the first application, the screen of a second application, and the second

4210 on the

210.

Fig. 43 shows an example of providing a second

4360 according to another exemplary embodiment.

Referring to fig. 43, the

230 of the

100c in the folded state displays a screen of a first application on the display 210 (S4310), and when the

100c is changed to the open state, the

230 may simultaneously display the screen of the first application, the screen of a second application, and a

4350 for requesting a second

4360 on the display 210 (S4320). When the user requests the

100c to provide the second application selection menu through the

4350, the

230 simultaneously displays a screen of the first application, a screen of the second application, and the second application selection menu 4360 (S4330). When the user input is received through the second

4360, the

230 simultaneously displays a screen of the first application and a screen of the second application selected by the user (S4340).

Fig. 44 is a flowchart of a method of controlling the

100a according to another exemplary embodiment.

Referring to fig. 44, when the folding motion or the unfolding motion is detected, the

100a determines the second application based on a list of pre-stored related applications.

First, the

100a displays a screen of a first application (S4402). When the

220 detects a folding motion or an unfolding motion (S4404), the

230 determines a second application based on the list of related applications (S4406). The list of related applications represents the type of the second application to be matched according to the type of the first application. A list of related applications may be stored in the

100 c. For example, a list of related applications may be stored in a memory of the

100 c.

Next, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S4408).

In fig. 46, a Social Network Service (SNS) application is used in the

100c in a folded state. When the

100c is changed to the open state, the

230 determines the second application as an album application based on the list of related applications and simultaneously displays a screen of the SNS application and a screen of the album application. The user may upload a picture to the SNS application by dragging or dropping the picture from the album application.

FIG. 47 is a flowchart of a method of controlling

100c according to another example embodiment.

Referring to fig. 47, when the

100c detects a folding motion or an unfolding motion, the

100c determines a second application based on an input to the first application. Since the input to the first application typically represents the current user's interests, information about the current interests of the user may be obtained.

First, the

100c displays a screen of a first application (S4702). When the

220 detects a folding motion or an unfolding motion (S4704), the

230 analyzes an input to the first application to determine a second application (S4706). For example, the input to the first application may include a voice of a caller or recipient of the telephony application, a message of a messenger, and so on. Next, the

230 determines a second application based on the analysis result of the input to the first application (S4708).

When the second application is second determined, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S4710).

Referring to fig. 48, when the first application is a call application, the

230 recognizes the content of a phone conversation between a caller and a recipient, and determines the second application according to the content of the phone conversation. For example, if one of the call participants says "how do you stroll around a south-Jiangnan station on the weekend? ", the

230 recognizes that the specific region name is included in the phone conversation, and thus may determine the map application as the second application.

Thereafter, when the

100c detects a folding motion or an unfolding motion, the

230 displays a screen of a call application as a screen of a first application, and displays a screen of a map application as a screen of a second application. When the screen of the map application is displayed, the

230 may display a map screen in which "south of the river station" identified from the phone conversation is marked.

The

100c can recognize the contents of the user's telephone conversation, and thus can easily and conveniently provide the user with information of interest to the user.

Referring to fig. 49, when the first application is a messenger application or a short message application, the

230 may analyze the content of a message transmitted from the first application or the content of a message received by the first application, and thus may determine the second application. For example, if a message transmitted or received by a first application includes "new gap S5 published", the

230 may analyze the content of the message and may determine a search application as a second application to search for the content of the message in a website.

Thereafter, when the

100c detects a folding motion or an unfolding motion, the

230 may simultaneously display a screen of a messenger application or a short message application as a first application and a screen of a search application as a second application. The

230 may display a screen related to a search result obtained by inputting a keyword included in a message into the search window on the screen of the search application.

Fig. 50 is a flowchart of a method of controlling the

100a according to another exemplary embodiment.

Referring to fig. 50, when a notification event occurs and a folding motion or an unfolding motion is detected, the

100a determines an application related to the notification event as a second application. The user may run an application related to the notification event by performing a simple motion (e.g., by changing the folded state of the

100 a).

First, the

100a displays a screen of a first application (S5002), and when the

220 detects a folding motion or an unfolding motion (S5004), the

230 determines a second application.

The

230 determines whether a notification event occurs (S5006). The notification event may include receiving a short message, receiving an incoming call, receiving an email, receiving an instant messaging message, receiving a notification from an SNS application, or receiving a notification from various applications.

If the notification event occurs (S5006), the

230 determines the application related to the notification event as the second application (S5008). For example, if a short message has been received, the short message application is determined as the second application. If the mail has been received, the mail application is determined as the second application. If the instant messaging message has been received, the instant messaging application is determined to be the second application. The SNS application is determined as the second application if the notification from the SNS application has been received.

Next, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S5012).

If the notification event does not occur (S5006), the

230 changes the screen of the

210 according to preset criteria (S5010). The preset criteria may vary according to various exemplary embodiments. The preset criteria may include determining an application as the second application, wherein the application is pre-configured to run with the first application. In one or more exemplary embodiments, the preset criterion may include determining an application as the second application, wherein the application is preset by a user via a setting menu or the like. In one or more exemplary embodiments, the preset criterion may include changing a screen of the first application by changing a size or a setting of the screen of the first application when the folding motion or the unfolding motion is detected.

Referring to fig. 51, the

100c receives an instant messenger message when the

100c displays a screen of a first application, and the

230 simultaneously displays a screen of a messenger application and a screen of the first application when the

100c detects a folding motion. When the screen of the first application is displayed, if the

5110 indicating the notification event is displayed, the user may perform an expansion motion on the

100c, and thus may run an application related to the notification event and may view the notification event.

Fig. 52 is a flowchart of a method of controlling the

100a according to another example embodiment.

Referring to fig. 52, when receiving content or a link and detecting a folding motion or an unfolding motion, the

100a determines an application for executing the content or the link as a second application. The user can run an application for executing content or links by simply folding or unfolding the

100 a.

First, the

100a displays a screen of a first application (S5202), and when the

220 detects a folding motion or an unfolding motion (S5204), the

230 determines whether content or a link is received via the first application (S5206). The content may include pictures, videos, music, contact information, e-commerce cards, and the like. The links may include internet address links, application travel path links, map information links for map applications, and the like.

When the content or the link is received (S5206), the

230 determines an application for running the content or the link received via the first application as the second application (S5208). For example, if a picture is received, the second application may be an album application, a photo replication application, a photo viewer application, or the like. If a video is received, the second application may include a video copy application, a video browser application, etc. in the first application. The second application may be a music application if music is received. The second application may be a contact information application if contact information is received. If an electronic commerce card is received, the second application may include a contact information application, an electronic commerce card management application, and the like. If an internet site link is received, the second application may be an internet browser application. The second application may be an application installation application if the application runtime path link is received. The second application may be a mapping application if a mapping information link of the mapping application is received.

Next, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S5212).

When the content or the link is not received (S5206), the

230 changes the screen of the

210 according to a preset criterion (S5210). The preset criteria may vary according to various exemplary embodiments. For example, in the present embodiment, the preset criterion may include determining an application as the second application, wherein the application is preset to be run together with the first application. In some embodiments, the preset criteria may include determining an application as the second application, wherein the application is preset by the user via a setup menu or the like. In some embodiments, the preset criteria may include changing a screen of the first application by changing a size or setting of the screen of the first application when the folding motion or the unfolding motion is detected.

Referring to fig. 53, in a case where the first application is an instant messenger application, a message accompanied by a picture is received via the instant messenger application, and an expansion motion for the

100c is detected, the

230 may determine the album application as the second application. In this case, when the unfolding motion for the

100c is detected, the screen of the instant messenger application and the screen of the album application are simultaneously displayed. In addition, the

230 may display a screen in which a picture of a message attached to the instant messenger application is played in the album application.

Referring to fig. 54, when the first application is an instant messenger application, a message attached with a map link is received via the instant messenger application, and an expansion motion for the

100c is detected, the

230 may determine the map application as the second application. In this case, when the unfolding motion for the

100c is detected, the screen of the instant messenger application and the screen of the map application are simultaneously displayed. In addition, the

230 may display a map corresponding to the map link of the instant messenger application in the map application.

Fig. 55 is a flowchart of a method of controlling the

100a according to another example embodiment.

Referring to fig. 55, when the folding motion or the unfolding motion is detected, the

100a determines the second application based on the application use history of the user.

First, the

100a displays a screen of a first application (S5502), and when the

220 detects a folding motion or an unfolding motion (S5504), the

230 determines a second application based on an application use history of the user (S5506). For example, the

230 determines an application commonly used by the user, a most recently used application, or an application running in the background as the second application. In one or more exemplary embodiments, when the user requests the

100a to run a specific application via the second application selection menu, the

230 may obtain information on the user's preferred application by learning the user's application selection history, and may determine the user's preferred application as the second application.

Next, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S5508).

FIG. 56 is a flowchart of a method of controlling the

100a according to another example embodiment.

Referring to fig. 56, when the

100a detects a folding motion or an unfolding motion, the

100a determines an application preset by a user as a second application.

First, the

100a displays a screen of a first application (S5602), and when the

220 detects a folding motion or an unfolding motion (S5604), the

230 determines an application previously set as a second application by a user as the second application (S5606). For example, the setting may be made in such a manner that: when the user unfolds the

100a (i.e., when the state of the

100a changes from the folded state to the open state), the

100a always displays the screen of the first application and the screen of the internet browser application at the same time. The user may set the second application in advance by using an application or a setting menu for setting of the

100 a.

Next, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S5608).

Fig. 57 shows a flow chart of a method of controlling the

100a according to another exemplary embodiment.

Referring to fig. 57, when the

100a detects a folding motion or an unfolding motion, the

100a determines a second application based on the state of the user.

First, the

100a displays a screen of a first application (S5702), and when the

220 detects a folding motion or an unfolding motion (S5704), the

230 determines a second application based on the state of the user (S5706). For example, the

230 may determine the second application in consideration of the current location, time, schedule, etc. of the user.

Next, the

230 simultaneously displays the determined screen of the second application and the screen of the first application (S5708).

Referring to fig. 58, in case that the first application is a schedule management application, the

230 may determine the second application based on the current location of the user, the current time, and the schedule. For example, in a case where the schedule management application includes a recording schedule about a wedding of a daphne cathedral at 3 pm today and the current time is 2 pm, when the user performs a spreading motion on the apparatus while the schedule management application is displayed on the apparatus, the

230 may simultaneously display both the schedule management application and a map application showing a planned path from the current location to the daphne cathedral.

Fig. 59 shows a flowchart of a method of controlling the

100c according to another exemplary embodiment.

Referring to fig. 59, when the

100c detects a folding motion or an unfolding motion, the

100c may simultaneously display a screen of a first application and a screen of a second application according to a user input, or may display only the screen of the first application, or may not display the screen of the second application.

First, the

100c displays a screen of a first application and simultaneously provides a window division selection menu (S5902). In one or more exemplary embodiments, a window division selection menu may be provided as a GUI displayed on the

210. The window division selection menu may be provided in a preset region of the housing of the

100c (similar to the second

3520 shown in fig. 35).

Next, when the

220 detects a folding motion or an unfolding motion (S5904), the

230 determines whether window division is selected (S5906).

When the window division is selected, the

230 simultaneously displays the screen of the first application and the screen of the second application (S5908). The second application may be determined according to the various methods described above.

When the window division is not selected (S5906), the

230 displays a screen of the first application (S5910). That is, when the window is not selected, the

230 displays only the screen of the first application, and does not display the screen of the second application.

Fig. 60 illustrates an example of providing a window

6020 according to an exemplary embodiment.

Referring to fig. 60, when the

100c is asymmetrically folded, a screen of a first application is displayed on the

210, and a window

6020 is provided through the

6010.

From the window

6020, the user may select a division window so that the screen of the second application and the screen of the first application are simultaneously displayed, or may select a full screen window so that only the screen of the first application is displayed without displaying the screen of the second application. As shown in fig. 60, the

6010 may be divided into two areas, and a window division option may be matched with the two areas.

The

6010 may be on the

210. The

6010 may be defined as a portion of the region exposed to the outside in the folded state of the

210. When the

210 is a touch screen, a window

6020 may be displayed on the

6010 and may receive a user selection in the form of a touch input to the

210.

In one or more exemplary embodiments, the

6010 may be disposed on the housing of the

100c, for example, the

6010 may be an area where a touch sensor, a proximity sensor, or the like is disposed. Information regarding the window

6020 may be displayed in the

6010 on the housing, or may be displayed on a portion of the outwardly exposed area of the

210.

When the

100c is asymmetrically folded, the window

6020 is disposed in a preset region physically separated from the

210 on which the screen of the first application is displayed, so that the user can intuitively access the window

6020. In addition, by providing the window

6020 with the area of the lower layer exposed due to the asymmetric folding, the window

6020 can be displayed without covering the screen of the first application and without complicating the screen setting.

Referring to fig. 61, in the folded state of the

100c, when the user selects an option of displaying the screen of the second application and changes the state of the

100c from the folded state to the open state, the

230 simultaneously displays the screen of the first application and the screen of the second application.

Referring to fig. 62, in the folded state of the

100c, when the user selects an option not to display the screen of the second application and changes the state of the

100c from the folded state to the open state, the

230 displays only the screen of the first application. In the open state, the size or setting of the screen of the first application may be changed according to a preset criterion.

Fig. 63 illustrates an example of providing a window

6320 according to an exemplary embodiment.

According to the present embodiment, when the

100c simultaneously displays the screen of the first application and the screen of the second application, the

100c may provide a window

6320 for receiving an input of selecting the setting form of the screen of the first application and the setting form of the screen of the second application. The user may select settings of the screen of the first application and the screen of the second application from the window

6320. The window

6320 may be provided through the

210 or the housing of the

100 c.

Referring to fig. 63, the

100c is asymmetrically folded, and the

100c in a folded state displays a screen of the first application on the

210 and provides a window

6320 to the

6310.

The window

6320 is a menu from which the user can select options related to the settings of the screens of the first and second applications. For example, the window

6320 may include an option as to whether the first application is set in the left area or in the right area or in a full screen. The

6310 may be divided into three regions, and window setting options may be matched with the three regions.

The

6310 may be a region on the

210. The

6310 may be defined as a portion of the region of the

210 exposed to the outside in the folded state. When the

210 is a touch screen, a window

6320 may be displayed on the

6310 and may receive a user selection in the form of a touch input to the

210.

In one or more exemplary embodiments, the

6310 may be provided on the housing of the

100c, and may be a region where a touch sensor, a proximity sensor, or the like is provided, for example. Information about the window

6320 may be displayed in a

6310 on the housing or may be displayed on a portion of the outwardly exposed region of the

210.

When the

100c is asymmetrically folded, the window

6320 may be disposed in a preset area physically separated from the

210 on which the screen of the first application is displayed, so that the user may intuitively access the window

6320. In addition, the window

6320 may be provided by using an area of a lower layer exposed due to asymmetric folding. The window

6320 may be displayed without covering the screen of the first application and without complicating the screen setting.

Referring to fig. 64, in the folded state of the

100c, when the user selects an option of displaying the screen of the first application in the right region and changes the state of the

100c from the folded state to the open state, the

230 displays the screen of the first application in the right region and displays the screen of the second application in the left region of the screen.

Referring to fig. 65, in the folded state of the

100c, when the user selects an option to display the first application in a full screen and changes the state of the

100c from the folded state to the open state, the

230 displays the first application in the full screen without displaying the screen of the second application.

Referring to fig. 66, in the folded state of the

100c, when the user selects an option to display the screen of the first application in the left area and changes the state of the

100c from the folded state to the open state, the

230 displays the screen of the first application in the left area and displays the screen of the second application in the right area of the screen.

Fig. 67 illustrates settings of a screen of a first application and a

6710 of a second application according to an exemplary embodiment.

In one or more exemplary embodiments, when the first and

6710 are simultaneously displayed, the first and second application screens 6710 may be set in various ways.

As shown in fig. 67, in the case where the folded shape of the

100a is changed and the first application screen and the

6710 are thus displayed simultaneously, the

6710 may be displayed with the first application screen partially covered. In this case, for example, the

6710 may be displayed in the form of a pop-up window.

Further, in a case where the folded shape of the

100a is changed and the first application screen and the

6710 are thus displayed simultaneously, the first application screen may be displayed in a full screen form and the

6710 may be displayed to cover a portion of the screen of the first application. Alternatively, the

6710 may be displayed in a full screen form, and the first application screen may be displayed while covering a portion of the

6710.

In some embodiments, as described above, the first and second application screens 6710 may be displayed in equally divided regions of the screen of the

100 a.

Referring to fig. 68, when the

100a detects a folding motion and thus displays a first application screen and a second application screen simultaneously, a plurality of second application screens may be displayed simultaneously with the first application screen. The plurality of second application screens may be screens of the same application or screens of different applications.

In the case where the folded shape of the

100a is changed and thus the first application screen and the second application screen are simultaneously displayed, the screen of the

100a may be divided as shown in fig. 68, and the first application screen and the plurality of second application screens may be disposed in the divided screen of the

100 a. According to various exemplary embodiments, the size of the screen of the first application and the size of the screen of the second application may be different from each other or different from each other.

Fig. 69 illustrates the operation of the

100 according to an exemplary embodiment.

Referring to fig. 69, the

100 detects the gaze of the user, and thus, the

100 may turn on only one of the first and

310 and 320 to which the gaze of the user is directed, and may turn off the other one of the displays. For example, when the user views the surface on which the

310 is disposed, the

320 may be turned off. In order to detect the gaze of the user, the

100 may have a camera, gaze detection sensor, or the like.

Referring to fig. 70, when a screen of a first application is displayed, information on a second application may also be provided. For example, in the case where the second application is a contacts application (as shown in fig. 70), when the

100a is unfolded, a screen of the contacts application may be displayed on the

100 a.

Referring to fig. 71, in the case where a notification event occurs while a screen of a first application is displayed, the

100a may provide information indicating that a user may check the notification event by unfolding the

100 a. For example, in the case where a text message is received while the screen of the first application is displayed (as shown in fig. 71), the

100a may show that the text message can be checked by expanding the

100 a.

Fig. 72 shows a structure of an

100d according to another exemplary embodiment.

Referring to fig. 72, the

210c may be disposed on a first surface of the

100d hidden when the

100d is folded, and the display may not be disposed on a second surface of the

100d disposed on an opposite side of the first surface. Further, when the

100d is folded asymmetrically, a portion of the first surface may be exposed outwardly when the

100d is folded.

A second

3520 may be disposed in an area of the first surface that is exposed outward when the

100d is asymmetrically folded.

A second

3520 may be displayed as a GUI on the

210 c. The

210c may include a

7210 exposed to the outside when the

100d is asymmetrically folded. The

210c may correspond to a

7210 and a

7220 integrally formed or divided by a frame or the like, wherein a second

3520 is displayed in the

7210 and an operation screen of the

100c is displayed in the

7220.

In one or more exemplary embodiments, a second

3520 may be provided so as to receive a user input by using a touch sensor or key buttons provided in a preset area of the housing of the

100 d. Information regarding the second

3520 may be displayed on an area of the

210 c.

Fig. 73 illustrates an example of a second

3520 according to an exemplary embodiment.

The second

3520 may display user-selectable applications, and a user may select an application from the second

3520. As shown in fig. 73, the

7210 may be divided into a plurality of areas, and the user-selectable application may be matched with the plurality of areas.

Fig. 74 illustrates an example of selecting a second application from the second

3520 according to an exemplary embodiment.

Referring to fig. 74, the

100d in a folded state provides a second

3520. When the user selects one of the plurality of second applications included in the second

3520 and expands the

100d (S7402), the

100d may display a screen of the user-selected second application on a predetermined region of the

210 c. For example, in the case where the

100d is a smartphone in a folded state and a waiting mode, when the user selects a call function from the second

3520 and changes the folded state of the

100d to an open state (S7402), the second application screen may be displayed in the

7410 of the

210c, and the first application screen may be displayed in the ninth area 7420 (S7404), the first application screen may include a home screen, an application list screen, a screen of an application preset by the user, and the like, which are displayed when the screen is opened in the waiting mode.

When the user makes a call by using the

100d, the

100d can recognize the contents of the user's voice conversation. When the

100d recognizes a word related to a specific application from the content of the voice conversation, the

100d includes the specific application in the second

3520. Recognition of the content of a voice conversation can be performed by utilizing various speech recognition algorithms. Information regarding the particular application associated with the identified term may be stored in

100d or may be set by the user.

For example, as shown in fig. 75, when the user makes a call by using the

100d in the folded state, the user mentions the word "schedule" (S7532). If the word "schedule" and an application related to the word "schedule" are allocated in the

100d, the

100d recognizes the word "schedule" (S7532). The

100d may set a

7510 for selecting an application related to the word "schedule" on the second application selection menu 3520 (S7534). The

100d may set a

7510 corresponding to an application related to the recognized word on the touch interface using the

210a, and may display a picture or text corresponding to the

7510 on the touch interface.

The user can select a related application by using the

7510 of the related application, and can expand the

100d (S7534) to display the

7520 of the related application (S7536). The

100d may recognize the contents of the user's voice conversation and may allow the user to easily use the application, thereby increasing user convenience.

Fig. 76 shows the structure of an

100e according to an exemplary embodiment.

The

100e is a rollable device. As shown in fig. 76, the

210d of the

100e may have two states, namely, a rolled state and an unrolled state. The user may change the state of the

100e from the rolled state to the unrolled state by grasping and pulling the

7610 of the

100e apart or by pressing a preset button of the

100 e. The second

3520 may be provided in a preset area of the

100e that is exposed to the outside when the

100e is rolled. For example, as shown in fig. 76, the second

3520 may be provided in a preset area of a housing of the

100e, wherein the housing maintains the

210d in a rolled state.

The second

3520 may be provided in the form of a touch screen, a touch sensor, a button, or the like. In one or more exemplary embodiments, the type of application selectable from the second

3520 may be preset in the

100e, may be determined according to a user's selection, or may be changed according to an operation mode of the

100 e.

Fig. 77 illustrates a process in which the

100e provides the second application menu according to an exemplary embodiment.

Referring to fig. 77, the

100e in the rolled state provides a second

3520, and the user selects an application from the second application selection menu 3520 (S7702). Thereafter, when the user changes the state of the

100e to the unfolded state (S7704), the

210d is exposed, and a screen of an application selected by the user is displayed on the

210d (S7706). The selection of the application may be performed before the user expands the

210d (S7702), may be performed when the user expands the

210d, or may be performed after the

210d expands.

When the user selects the second application from the second

3520, the

100e may simultaneously display a screen of the second application selected by the user and a screen of a preset first application or a screen of a currently executed first application.

Fig. 78 shows a block diagram of an

100f according to another exemplary embodiment.

As shown in fig. 78, the structure of the

100f may be applied to various types of devices, including a mobile phone, a tablet PC, a Personal Digital Assistant (PDA), an MP3 player, an autonomous service terminal, an electronic photo frame, a navigation device, a digital TV, or a wearable device, such as a watch or a Head Mounted Display (HMD)).

Referring to fig. 78, the

100f may include at least one selected from: a display 7810 (i.e., a display unit), a controller 7870 (i.e., a control unit), a

7820, a Global Positioning System (GPS)

7825, a communicator 7830 (i.e., a communication unit or transceiver), a

7835, an

7840, a user interface 7845 (i.e., a user input or user input unit), a microphone 7850 (i.e., a microphone unit), a camera 7855 (i.e., an image capture unit), a speaker 7860 (i.e., a speaker unit), a motion detector 7865 (i.e., a motion detection unit), a sensor 7880 (i.e., a sensing unit).

The

7810 may include a

7811 and a controller for controlling the

7811. The

7811 may be a variety of displays (including Liquid Crystal Displays (LCDs), Organic Light Emitting Diode (OLED) displays, Active Matrix Organic Light Emitting Diode (AMOLED) displays, Plasma Display Panels (PDPs), etc.) the

7811 may be flexible, transparent, and/or wearable. The

7810 may be combined with the

7847 of the

7845 and thus may be provided as a touch screen. The touch screen may include a module having a stacked structure including the

7811 and the

7847.

The

7820 may include at least one of an internal memory and an external memory.

The internal memory may include at least one of: volatile memory (e.g., Dynamic Random Access Memory (DRAM), static ram (sram), synchronous dynamic ram (sdram), etc.), non-volatile memory (e.g., one-time programmable read only memory (OTPROM), programmable ROM (prom), erasable programmable ROM (eprom), electrically erasable programmable ROM (eeprom), mask ROM, flash ROM, etc.), Hard Disk Drives (HDD), and Solid State Drives (SSD). The

7870 may load instructions or data from at least one of the non-volatile memory and other elements to the volatile memory and may process the instructions or data. Further, the

7870 may store data received from or generated by another element in the non-volatile memory.

The

7820 may store various programs and data used in the operation of the

100 f. For example,

7820 may temporarily or semi-permanently store portions of content to be displayed on the lock screen.

The

7870 may control the

7810 to display a portion of the content stored in the

7820. In other words, the

7870 may display a portion of the content stored in the

7820 on the

7810. When a user gesture is performed in an area of the

7810, the

7870 may perform a control operation corresponding to the user gesture.

The

7870 may include at least one of:

7871,

7872, Central Processing Unit (CPU)7873, Graphics Processing Unit (GPU)7874, and

7875. The

7871,

7872,

7873, and GPU7874 may be interconnected via

7875.

7873 accesses

7820 and performs boot operations by utilizing the operating system stored in

7820. Then, the

7873 performs various operations by using various programs, contents, or data stored in the

7820.

7872 may store a set of instructions for starting the system. For example, when a boot instruction is input to the

100f and power is supplied to the

100f, the

7873 may copy the OS stored in the

7820 to the

7871 according to the instruction stored in the

7872, run the OS, and thereby boot the system. When the boot operation is completed, the

7873 can copy various programs stored in the

7820 to the

7871, and can perform various operations by running the programs copied to the

7871. When

100f starts up, GPU7874 displays the UI screen in

7810. In more detail, GPU7874 may generate a screen that displays an electronic document that includes various objects (e.g., content, icons, menus, etc.). The GPU7874 calculates coordinate values of an object to be displayed according to the layout of the UI screen, and calculates attribute values of the shape, size, or color of the object. GPU7874 may then generate UI screens having various layouts including objects based on the calculated attribute values. The UI screen generated by GPU7874 may be provided to

7810 and may thus be displayed in an area of

7810.

The

7825 may receive GPS signals from GPS satellites and may calculate the current location of the

100 f. In the case of using a navigation program or requiring the current location of the user, the

7870 may calculate the location of the user by using the

7825.

The

7830 may perform communication with various external devices according to various types of communication methods. The

7830 may include at least one selected from a wireless fidelity (Wi-Fi)

7831, a

7832, a

7833, and a Near Field Communication (NFC)

7834. The

7870 may perform communication with various external devices by using the

7830.

The Wi-

7831 and the

7832 can perform communication by utilizing Wi-Fi and Bluetooth, respectively. If the Wi-

7831 or the

7832 is used, the

7831 or the

7832 may first transmit and receive various types of connection information including service set identification information (SSID), session keys, etc., a connection for communication may be established by using the connection information, and then various types of information may be transmitted and received. The

7833 may be a chip that performs communication according to various communication standards, such as Institute of Electrical and Electronics Engineers (IEEE), ZigBee, third generation mobile communication technology (3G), third generation partnership project (3GPP), Long Term Evolution (LTE), and the like. The

7834 refers to a chip that operates with NFC using a 13.56MHz band among various radio frequency identification (RF-ID) bands (e.g., 135kHz, 13.56MHz, 433MHz, 860-960 MHz, 2.45GGz, etc.).

The

7835 may process video data included in content received by using the

7830 or may process video data included in content stored in the

7820.

7835 may perform various image processing (e.g., decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc.) on the video data.

The

7840 may process audio data included in content received by using the

7830 or may process audio data included in content stored in the

7820.

7840 may perform various processing on the audio data (e.g., decoding, amplification, noise filtering, etc.).

When running the reproducing program for multimedia contents, the

7870 may reproduce the multimedia contents by driving the

7835 and the

7840. The

7860 may output audio data generated in the

7840.

The

7845 may receive various instructions input from a user. The

7845 may include at least one selected from the group consisting of

7846, a

7847, and a

7848

The

7846 may be of various types (e.g., mechanical buttons, rollers, etc. that may be formed on the front, sides, rear, etc. of the outer surface of the body of the

100 f).

The

7847 may sense a touch input by a user and may output a value of a touch event corresponding to a signal generated by the sensed touch input. When the

7847 is combined with the

7811 and thus formed as a touch screen, the touch screen may be configured as a capacitive touch screen, a resistive touch screen, or a piezoelectric touch screen by using various types of touch sensors. The capacitive touch screen may calculate touch coordinates by sensing a small amount of electricity generated when a body part of a user touches a surface of the capacitive touch screen coated with a dielectric material. The resistive touch screen may include two embedded electrode plates, and touch coordinates may be calculated by sensing a flow of current occurring when a user touches the resistive touch screen, which causes upper and lower plates of a touch point to contact each other. Touch events occurring on a touch screen may be generated by a user's finger, but may also be generated by an object formed of a conductive material capable of changing capacitance.

The

7848 may sense a proximity input or a touch input of a stylus (stylus or stylus) performed by a user and may output a sensed pen proximity event or a sensed pen touch event. The

7848 may be an electromagnetic resonance (EMR) type pen recognition panel, or may sense a touch input or a proximity input according to a change in electromagnetic field intensity occurring when a touch pen approaches or touches a touch screen. In more detail, the

7848 may include an electromagnetic induction coil sensor having a mesh structure, an electric signal processor for sequentially supplying an Alternating Current (AC) signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor. When a pen having an internal resonant circuit is placed near the loop coil of the

7848, the magnetic field transmitted from the loop coil generates a current in the resonant circuit of the pen based on mutual electrostatic induction. Due to the current, an induced magnetic field is generated from a coil forming a resonance circuit in the pen, and the

7848 detects the induced magnetic field from the loop coil capable of receiving a signal, thereby sensing a touch input or a proximity input by the pen. The

7848 may be disposed to occupy a predetermined area under the

7811, and may have a size capable of covering a display area of the

7811, for example.

The

7850 may receive input user voice or other sounds and may convert the user voice or other sounds into audio data. The

7870 may use the user's voice input via the

7850 in call-related operations, or may convert the user's voice into audio data and may store the audio data in the

7820.

The

7855 may capture still images or moving pictures according to the user's control. The

7855 may include front cameras, rear cameras, and the like.

If the

7855 and the

7850 are formed, the

7870 may perform a control operation according to a user's voice input via the

7850 or a user's motion recognized by the

7855. For example, the

100f may operate in a motion control mode or a voice control mode. If the

100f operates in the motion control mode, the

7870 may activate the

7855 and may capture an image of the user, and track a change in the motion of the user, and may perform a control operation corresponding thereto. If the

100f operates in a voice control mode (i.e., a voice recognition mode), the

7870 may analyze a user's voice input via the

7850 and may perform a control operation according to the analyzed user's voice.

The

7865 may detect motion of the body of the

100 f. The

100f may be rotated or tilted in various directions. Here, the

7865 may detect a motion characteristic (e.g., a rotation direction, a rotation angle, an inclination angle, etc.) by using at least one of a magnetic sensor, a gyro sensor, an acceleration sensor, and the like.

The

100f may further include a Universal Serial Bus (USB) port for connecting the

100f with a USB connector, various external input ports including an earphone, a mouse, a Local Area Network (LAN) for connecting with various external terminals, etc., a Digital Media Broadcasting (DMB) chip for receiving and processing DMB signals, various sensors, etc.

The names of the elements in the

100f may vary. Further, the

100f may include at least one selected from the above elements, or may be implemented with more or less elements than the above elements.

210 may correspond to display 7810 of fig. 78. The

230 may correspond to the

7870 of fig. 78. The

3310 may correspond to the

7845 of fig. 78. The

220 may correspond to the

7880 of fig. 78.