US20140287779A1 - System, method and device for providing personalized mobile experiences at multiple locations - Google Patents

Images

Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/02—Services making use of location information
  • H04W4/025—Services making use of location information using location based information parameters
  • H04W4/027—Services making use of location information using location based information parameters using movement velocity, acceleration information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L67/00—Network arrangements or protocols for supporting network services or applications
  • H04L67/2866—Architectures; Arrangements
  • H04L67/30—Profiles
  • H04L67/306—User profiles
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L67/00—Network arrangements or protocols for supporting network services or applications
  • H04L67/50—Network services
  • H04L67/52—Network services specially adapted for the location of the user terminal
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/02—Services making use of location information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/02—Services making use of location information
  • H04W4/024—Guidance services
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/90—Details of database functions independent of the retrieved data types
  • G06F16/95—Retrieval from the web
  • G06F16/953—Querying, e.g. by the use of web search engines
  • G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

• Some embodiments of the present invention relate to personalized travel experiences.
• some embodiments of the present invention relate to mobile devices and systems, as well as related methods, for providing digital story experiences related to a common theme at different geographic locations.
• Smart phones, tablet computers, and other portable devices incorporating wireless connections to the Internet have opened up opportunities for new, entertaining tourism experiences. These devices are currently used to provide location-aware travel guides to various cities and historical sites. For example, various smart phone apps provide a guide to restaurants, bars, and nightlife in cities such as Boston and New York. Some of these apps use the smart phone's built-in GPS to provide various maps and lists of venues in order of distance from the user's current location.
• Fodor'STM City Apps provides iPhoneTM and AndroidTM apps for a number of major cities, including New York City.
• the Fodor's apps provide recommendations for sightseeing, restaurants and hotels.
• Each Fodor's app permits the user to book hotels, restaurants, and entertainment in the particular city, using ExpediaTM, OpenTableTM, and TicketsNowTM. It also permits the user to bookmark and create comments about their favorite attractions.
• the user can download an interactive offline map and reviews, so that the user can browse the map, read reviews, and make notes when in the subway or other areas with poor wireless reception.
• Photography is often used to record and share experiences, such as vacation trips, family outings, or seasonal events. Still and video images of such experiences can be captured using image capture devices including camera phones (such as smart phones), digital still cameras, and camcorders.
• image capture devices including camera phones (such as smart phones), digital still cameras, and camcorders.
• the digital images captured by these image capture devices can be shared by e-mail and uploaded to web sites such as FacebookTM and FlickrTM, where they can be viewed by friends.
• the uploaded images can be printed using on-line photo service providers, such as ShutterflyTM. Users can order photo products, such as photo books and collages, which utilize uploaded digital images.
• a geofence it is known to use a “geofence” to create a virtual perimeter for a real-world geographic area, such as a boundary around a store, school, or other area of interest.
• the location-aware device such as a smart phone
• LBS location-based service
• the device can generate a notification.
• the notification can be sent to an email account or another smart phone.
• a parent can be notified when a child leaves an area defined by a geofence.
• augmented reality it is known to utilize augmented reality in apps running on smart phones.
• the AurasmaTM augmented reality platform developed by Hewlett Packard (“HP”)TM, Palo Alto, Calif. can enable a smart phone to recognize real world images.
• the real world images can be overlaid with animations, videos, and 3D models to provide augmented reality experiences.
• Locast Another known prior art system is “Locast”, developed by the MIT media Lab. According to their website, Locast can be used to create interactive narratives that are crafted by linking together videos and photos thematically, geographically, and chronologically. These stories can be explored by viewers in a non-linear fashion.
• This MIT group has developed the Open Locast Web Application, which includes a map-based front-end built upon OpenLayers and the GoogleTM Maps API, that provides an interface for browsing, searching, and interacting with media content.
• This group has also developed the Open Locast Android Application, which provides interactive content recording/creation, browsing and searching. It supports content synchronization for offline content capturing, viewing and browsing, allowing for use in locations with limited or no connectivity.
• a method executed by a data processing device system includes the steps of: storing, in a processor-accessible memory device system communicatively connected to the data processing device system, a user profile associated with a user; storing, in the processor-accessible memory device system, data indicating a plurality of location-specific digital stories related to a common theme at a plurality of locations; determining whether or not a current location of a mobile device associated with the user corresponds to one of the plurality of locations related to the plurality of location-specific digital stories; determining, if it is determined that the current location of the mobile device corresponds to a first one of the plurality of locations, and based at least on an analysis of the user profile, that either a first case or a second case exists indicating that the user has or has not, respectively, been presented with at least one of the plurality of location-specific digital stories at a different one of the plurality of locations different
• the first digital story may introduce the common theme, and the second digital story may continue the common theme, which was introduced at the different one of the plurality of locations.
• User profiles for a plurality of users, and the data, may be stored by a network-accessible storage system.
• the method may include the step of providing general content to the mobile device if it is determined that the current location of the mobile device does not correspond to one of the plurality of locations related to the plurality of location-specific digital stories.
• the method may include determining a travel direction of the mobile device and providing the first digital story or the second digital story in response to the determined travel direction.
• the user profile may include at least one user preference, and the method may include selecting the first digital story from a plurality of stored first digital stories in response to the stored user preference.
• the plurality of stored first digital stories may be related to the first one of the plurality of locations.
• the user preference may include a language preference, and the method may include accessing the stored user profile to determine the language preference and selecting the first digital story from the plurality of stored first digital stories in response to the determining of the language preference.
• the user preference includes a demographic group of the user, and the method includes accessing the stored user profile to determine the language preference and selecting the first digital story from the plurality of stored first digital stories in response to the determining of the demographic group.
• the first digital story, the second digital story, or both is or are configured to instruct the user to capture one or more digital images
• the method includes requesting a photo product related to the common theme.
• the photo product may be defined to incorporate at least one digital image captured by the user.
• the method includes suggesting a location for a next digital story in response to answers provided by the user during the first digital story or the second digital story.
• a mobile device may include a memory device system story content data; an output device system; a location determination unit configured to determine a geographic location of the mobile device; and a data processing device system communicatively connected to the output device system, the memory device system, and the location determination unit.
• the memory device system may store program instructions configured to cause the data processing system at least to: store, in the memory device system, data indicating a plurality of location-specific digital stories related to a common theme at a plurality of locations; determine whether or not a current location of the mobile device, which is provided by the location determination unit, corresponds to one of the plurality of locations related to the plurality of location-specific digital stories; determine, if it is determined that the current location of the mobile device corresponds to a first one of the plurality of locations, that either a first case or a second case exists indicating that the user has or has not, respectively, been presented with at least one of the plurality of location-specific digital stories at a different one of the plurality of locations different than the first one; acquire, from the memory device system, first digital story content data of the digital story content data and provide the first digital story content data to the output device system in response to it being determined that the first case exists; and acquire, from the memory device system, second digital story content data of the digital story content data and provide the second digital story
• the output device system may include an image display, a speaker, an audio output jack, or a combination thereof.
• the first digital story content data, the second digital story content data, or both may include audio content data, and the program instructions may be configured to cause the data processing device system at least to provide music content data to the output device system when the current location of the mobile device does not correspond to one of the plurality of locations.
• the first digital story content data, the second digital story content data, or both may be configured to instruct the user to capture one or more digital images using the mobile device.
• At least some of the plurality of location-specific digital stories are associated with particular travel directions, and the program instructions are configured to cause the data processing device system at least to: determine, based at least on input from the location determination unit, a travel direction of the mobile device; and provide the first digital story content data or the second digital content data in response to the determined travel direction.
• a system includes a memory device system storing a user profile associated with a user of a mobile device; a network-accessible storage device system storing data indicating a plurality of location-specific digital stories related to a common theme at a plurality of locations; a location determination unit configured to determine a geographic location of the mobile device; and a data processing device system.
• the data processing device system may be configured at least to: determine whether or not a current location of the mobile device, which is provided by the location determination unit, corresponds to one of the plurality of locations related to the plurality of location-specific digital stories; determine, if it is determined that the current location of the mobile device corresponds to a first one of the plurality of locations, and based at least on an analysis of the user profile, that either a first case or a second case exists indicating that the user has or has not, respectively, been presented with at least one of the plurality of location-specific digital stories by the mobile device at a different one of the plurality of locations different than the first one; provide a first digital story of the plurality of location-specific digital stories stored by the network-accessible storage device system to the mobile device in response to it being determined that the first case exists; and provide a second digital story of the plurality of location-specific digital stories stored by the network-accessible storage device system to the mobile device in response to it being determined that the second case exists.
• the data processing device system is configured to automatically determine whether or not to provide the first digital story using audio data, based on measurements performed by the mobile device.
• the memory device system which stores the user profile, may also store user profiles for a plurality of users and may be at least part of the network-accessible storage device system.
• the first digital story, the second digital story, or both may include an augmented reality image of a historical character, and (b) may be configured to cause the mobile device to display the augmented reality image of the historical character along with an image captured by the mobile device.
• At least some of the plurality of location-specific digital stories are associated with particular travel directions, and the data processing device system is configured at least to: determine a travel direction of the mobile device; and provide the first digital story or the second digital story in response to the determined travel direction.
• a computer program product may be provided that comprises program code portions for performing some or all of any of the methods and associated features thereof described herein, when the computer program product is executed by a computer or other computing device or device system.
• Such a computer program product may be stored on one or more non-transitory computer-readable storage mediums.
• each of any or all of the computer-readable data storage medium systems described herein is a non-transitory computer-readable data storage medium system including one or more non-transitory computer-readable storage mediums storing one or more programs or program products which configure a data processing device system to execute some or all of one or more of the methods described herein.
• any or all of the methods and associated features thereof discussed herein may be implemented as all or part of a device system or apparatus.
• FIG. 1 illustrates a system configured to generate personalized travel experiences, according to some embodiments of the present invention
• FIG. 2 is a block diagram of a particular implementation of the system of FIG. 1 in accordance with some embodiments of the present invention
• FIG. 3 is a block diagram of a smart phone, which may be all or part of the system of FIG. 1 , according to some embodiments of the present invention
• FIG. 4 is a flow diagram depicting steps for providing location-specific digital stories related to a common theme at a plurality of different locations, according to some embodiments of the present invention
• FIG. 5 is a flow diagram depicting a particular implementation of step 425 in FIG. 4 pertaining to selecting a location specific story, according to some embodiments of the present invention
• FIG. 6 is an example of a map depicting different locations at which location-specific digital story experiences related to a common theme can be provided, according to some embodiments of the present invention.
• FIG. 7A depicts an example of a user interface screen for selecting a theme for location-specific stories, according to some embodiments of the present invention
• FIG. 7B depicts a user interface screen which begins to introduce a theme and character of a story, according to some embodiments of the present invention
• FIG. 8A depicts a user interface screen for presenting a first location-specific digital story associated with a first theme at a first geographic location, according to some embodiments of the present invention
• FIG. 8B depicts a user interface screen for presenting a second location-specific digital story associated with the first theme at the first geographic location, according to some embodiments of the present invention
• FIG. 9 depicts a user interface screen for presenting a location-specific digital story associated with the first theme at a second geographic location, according to some embodiments of the present invention.
• FIG. 10 depicts a user interface screen for presenting a location-specific digital story associated with the first theme at a third geographic location, according to some embodiments of the present invention
• FIG. 11 depicts a photo postcard product which includes a user-captured image and pre-stored information, according to some embodiments of the present invention
• FIG. 12 is a flow diagram depicting steps for providing travel direction-dependent digital stories at a plurality of different locations, according to some embodiments of the present invention.
• FIG. 13 is an example of a map depicting different locations and travel directions at which travel direction-dependent digital stories can be provided, according to some embodiments of the present invention.
• FIG. 14 is an example of a map depicting a plurality of adjacent geofences which can be used to determine a travel direction, according to some embodiments of the present invention.
• the word “or” is used in this disclosure in a non-exclusive sense.
• the word “set” is intended to mean one or more, and the word “subset” is intended to mean a set having the same or fewer elements of those present in the subset's parent or superset.
• the phrase “at least” is used herein at times merely to emphasize the possibility that other elements may exist besides those explicitly listed. However, unless otherwise explicitly noted (such as by the use of the term “only”) or required by context, non-usage herein of the phrase “at least” nonetheless includes the possibility that other elements may exist besides those explicitly listed.
• the phrase, ‘based at least upon A’ includes A as well as the possibility of one or more other additional elements besides A.
• the phrase, ‘based upon A’ includes A, as well as the possibility of one or more other additional elements besides A.
• the phrase, ‘based only upon A’ includes only A.
• the phrase ‘configured at least to A’ includes a configuration to perform A, as well as the possibility of one or more other additional actions besides A.
• the phrase ‘configured to A’ includes a configuration to perform A, as well as the possibility of one or more other additional actions besides A.
• the phrase, ‘configured only to A’ means a configuration to perform only A.
• program in this disclosure should be interpreted as a set of instructions or modules that may be executed by one or more components in a system, such as a controller system or data processing device system, in order to cause the system to perform one or more operations.
• the set of instructions or modules may be stored by any kind of memory device, such as those described subsequently with respect to FIG. 1 , FIG. 2 , and FIG. 3 .
• this disclosure may describe or similarly describe that the instructions or modules of a program are configured to cause the performance of an action.
• the phrase “configured to” in this context is intended to include at least (a) instructions or modules that are presently in a form executable by one or more data processing devices to cause performance of the action (e.g., in the case where the instructions or modules are in a compiled and unencrypted form ready for execution), and (b) instructions or modules that are presently in a form not executable by the one or more data processing devices, but could be translated into the form executable by the one or more data processing devices to cause performance of the action (e.g., in the case where the instructions or modules are encrypted in a non-executable manner, but through performance of a decryption process, would be translated into a form ready for execution).
• the word “module” may be defined as a set of instructions.
• device and the phrase “device system” both are intended to include one or more physical devices or sub-devices (e.g., pieces of equipment) that interact to perform one or more functions, regardless of whether such devices or sub-devices are located within a same housing or different housings.
• device may equivalently be referred to as a “device system”.
• phrase “in response to” may be used in this disclosure.
• this phrase might be used in the following context, where an event A occurs in response to the occurrence of an event B.
• such phrase includes, for example, that at least the occurrence of the event B causes or triggers the event A.
• FIG. 1 schematically illustrates a personalized travel experience generation system 100 , according to some embodiments of the present invention.
• the system 100 may include a data processing device system 110 , a data input-output device system 120 , and a processor-accessible memory device system 130 .
• the processor-accessible memory device system 130 and the data input-output device system 120 are communicatively connected to the data processing device system 110 .
• the data processing device system 110 includes one or more data processing devices that implement or execute, in conjunction with other devices, such as those in the system 100 , methods of various embodiments of the present invention, including the example methods of FIG. 4 , FIG. 5 , and FIG. 12 described herein.
• Each of the phrases “data processing device”, “data processor”, “processor”, and “computer” and the like is intended to include any data processing device, such as a central processing unit (“CPU”), a desktop computer, a laptop computer, a mainframe computer, a tablet computer such as an iPadTM, a personal digital assistant, a cellular phone, a mobile device, a smart phone, or any other device for processing data, managing data, or handling data, whether implemented with electrical, magnetic, optical, biological components, or otherwise.
• CPU central processing unit
• a desktop computer such as a laptop computer, a mainframe computer, a tablet computer such as an iPadTM, a personal digital assistant, a cellular phone, a mobile device, a smart phone, or any other device for processing
• the processor-accessible memory device system 130 includes one or more processor-accessible memory devices configured to store program instructions and other information, including the information and program instructions needed by a data processing device system to execute the methods of various embodiments, including the example methods of FIG. 4 , FIG. 5 , and FIG. 12 described herein.
• each of the steps illustrated in the example methods of FIG. 4 , FIG. 5 , and FIG. 12 may represent program instructions stored in the processor-accessible memory device system 130 and configured to cause a data processing device system to execute the respective step.
• the processor-accessible memory device system 130 may be a distributed processor-accessible memory device system including multiple processor-accessible memory devices communicatively connected to the data processing device system 110 via a plurality of computers and/or devices.
• the processor-accessible memory device system 130 need not be a distributed processor-accessible memory system and, consequently, may include one or more processor-accessible memory devices located within a single data processing device.
• processor-accessible memory is intended to include any processor-accessible data storage device, whether volatile or nonvolatile, electronic, magnetic, optical, or otherwise, including but not limited to, registers, floppy disks, hard disks, Compact Discs, DVDs, flash memories, ROMs, EEPROMs, and RAMs.
• processor-accessible memory and “processor-accessible memory device” is intended to include or be a processor-accessible (or computer-readable) data storage medium.
• each of the phrases “processor-accessible memory” and “processor-accessible memory device” is intended to include or be a non-transitory processor-accessible (or computer-readable) data storage medium.
• the memory device system 130 may be considered to include or be a non-transitory processor-accessible (or computer-readable) data storage medium system.
• the memory device system 130 may be considered to include or be a non-transitory processor-accessible (or computer-readable) storage medium system.
• the phrase “communicatively connected” is intended to include any type of connection, whether wired or wireless, between devices, data processors, or programs in which data may be communicated. Further, the phrase “communicatively connected” is intended to include a connection between devices or programs within a single data processor, a connection between devices or programs located in different data processors, and a connection between devices not located in data processors at all.
• the processor-accessible memory device system 130 is shown separately from the data processing device system 110 and the data input-output device system 120 , one skilled in the art will appreciate that the processor-accessible memory device system 130 may be located completely or partially within the data processing device system 110 or the data input-output device system 120 .
• data input-output device system 120 is shown separately from the data processing device system 110 and the processor-accessible memory device system 130 , one skilled in the art will appreciate that such system may be located completely or partially within the data processing system 110 or the processor-accessible memory device system 130 , depending upon the contents of the input-output device system 120 . Further still, the data processing device system 110 , the data input-output device system 120 , and the processor-accessible memory device system 130 may be located entirely within the same device or housing or may be separately located, but communicatively connected, among different devices or housings.
• the system 100 of FIG. 1 may be implemented by a single application-specific integrated circuit (ASIC) in some embodiments.
• ASIC application-specific integrated circuit
• the data input-output device system 120 may include a mouse, a keyboard, a touch screen, a computer, a processor-accessible memory device, a network-interface-card or network-interface circuitry, or any device or combination of devices from which a desired selection, desired information, instructions, or any other data is input to the data processing device system 110 .
• the data input-output device system 120 may include a user-activatable control system that is responsive to a user action.
• the data input-output device system 120 may include any suitable interface for receiving a selection, information, instructions, or any other data from other devices or systems described in various ones of the embodiments.
• the data input-output device system 120 also may include an image generating device system, a display device system, an audio generating device system, an audio transducer, a computer, a processor-accessible memory device, a network-interface-card or network-interface circuitry, or any device or combination of devices to which information, instructions, or any other data is output by the data processing device system 110 .
• the input-output device system 120 may include any suitable interface for outputting information, instructions, or data to other devices and systems described in various ones of the embodiments. If the input-output device system 120 includes a processor-accessible memory device, such memory device may or may not form part or all of the memory device system 130 .
• the user interfaces of at least FIG. 7A , 7 B, 8 A, 8 B, 9 , 10 , or a combination thereof may be implemented as part of the data input-output device system 120 , according to various ones of some embodiments of the present invention.
• FIG. 2 is a block diagram of a particular implementation of the system of FIG. 1 in accordance with some embodiments of the present invention.
• a system 214 for providing location-based digital stories to a plurality of users of mobile devices at a plurality of locations.
• digital story relates to, among other things, a telling of a story with any of a variety of digital multimedia types, including digital audio, digital graphics images, including digital still photographs, and digital video images and animations. It will be understood that a digital story may relate to, for example, travel information, historic information or business information.
• the phrase digital story experience relates to, among other things, the presentation of a digital story on a device, such as a smart phone or tablet computer, using digital audio, or digital still images including graphics, or digital video images, or a combination of digital audio, digital still images, and digital video images.
• a first mobile device such as smart phone 300 A located at a first location A
• a second mobile device such as smart phone 300 B, located at a second location B
• the cellular provider network 240 provides both voice and data communications using transmission devices located at cell towers throughout a region.
• the cellular provider network 240 is communicatively connected to a communication network 250 , such as the Internet.
• each mobile device such as smart phone 300 A
• the smart phone 300 A can be used to present a digital story to a single user or to a group of users who are viewing a display of the smart phone 300 A, or listening to audio provided by the smart phone 300 A.
• the user or group of users may be situated in a vehicle such as a car, for example, and the digital story can be provided by the vehicle's audio system using, for example, a BluetoothTM connection to transmit the audio from the smart phone 300 A to the vehicle's audio system as is well-known in the art.
• system 214 typically includes many other mobile devices, in addition to smart phone 300 A and smart phone 300 B. It will be understood that the system 214 can include multiple cellular provider networks 240 , for example networks provided by companies such as Verizon, AT&T, and Sprint, which can be communicatively connected to the communication network 250 .
• cellular provider networks 240 for example networks provided by companies such as Verizon, AT&T, and Sprint, which can be communicatively connected to the communication network 250 .
• System 214 also includes one or more computers 218 which communicate with the communication network 250 and service provider 280 via a communication service provider (CSP) 220 .
• CSP communication service provider
• computer 218 enables remote users, who might not be able to travel to the locations where the location-specific stories are provided, to obtain a virtual experience from their home.
• the user of one of the computers 218 can use a computer mouse to change their virtual location on a digital map displayed in a window on the display of the computer 218 .
• the computer 218 can then be used, rather than one of the smart phones 300 A, 330 B, to provide a virtual digital story experience to a remote user, who may be located in another country, for example.
• the communications network 250 enables communication with a service provider 280 .
• Service provider 280 includes a web server 282 for interfacing with communications network 250 .
• web server 282 transfers data to a computer system 286 which manages data associated with various customers and digital story content associated with one or more themes at a plurality of locations.
• system 214 can include a plurality of service providers 280 , which provide different services and can support different regions of the world.
• the computer system 286 includes an account manager 284 , which runs software to permit the creation and management of individual customer (e.g. user) accounts, including user profiles, which are stored in customer database 288 .
• customer database 288 provides a network-accessible storage device system which stores profiles for a plurality of users of mobile devices, such as smart phones 300 A and 300 B.
• the user profile information stored in customer database 288 can include personal information such as the user's nickname, full name and address, demographic information, and interests.
• the demographic information in the user profile can include the approximate age of the user, whether the user is male or female, or a language preference of the user, since the user may be visiting from another country.
• the user profile information stored in customer database 288 can also include billing information such as credit card information, and authorization information that controls access to the information in the customer database by third parties.
• the user profile information stored in customer database 288 includes data which indicates which digital stories have been experienced by the user, including the theme, location, and the date and time that the digital story was presented to the user, as will be described later in reference to FIG. 4 .
• the account manager 284 also permits the uploading and management of collections of digital story content data for providing digital story experiences, such as digital audio recordings, digital still images, and digital video images associated with various story themes and locations, which is stored in content database 290 .
• content database 290 provides an example of a network-accessible storage device system which stores data for providing a plurality of location-specific digital stories related to a common theme at a plurality of locations.
• computers 218 are used by content curators associated with a plurality of venues, to provide, manage, and update the digital story content associated with location-specific digital stories associated with the venues, which is stored in a content database 290 .
• users of mobile devices such as smart phones 300 A and 300 B, capture digital images during a digital story experience at one or more locations.
• the captured digital images are uploaded and stored in the customer database 288 .
• Content database 290 stores data which identifies the geographic locations associated with location-specific digital stories that can be provided using the system depicted in FIG. 2 .
• the geographic location data can use, for example, GPS coordinate boundaries of an area, such as a geofence, or object identifying feature points in images captured in an area.
• the geographic location data can also use one or more identifiers for wireless communications antennas, which are located in the geographic area associated with the location-specific digital story.
• the content database 290 also stores guidance information, which is used to suggest additional locations for digital story experiences that may be of interest to users, and to guide them to the suggested locations.
• the guidance information also provides guidance to locations which are likely to be considered to be good “photo spots” by the particular user of one of the smart phones 300 A, 300 B.
• the guidance information includes at least one image related to the suggested location.
• the guidance can include a photo of a particular object, along with a map or an audio or text message that provides a general direction, or other clues, for locating the object.
• the guidance can also include text or graphics which instruct the user to capture an image of their group near the object, and to upload the captured image to the service provider 280 .
• guidance for suggested digital story experience locations is provided in a manner so as to dynamically alter the experience responsive to user-captured images or other input received from the user during the digital story experience.
• the digital story experience automatically adapts to a particular user's situation and conditions. For example, an uploaded digital still image captured by a user at one point in the digital story experience can indicate that the user is accompanied by children. This can result modifications to the digital story experience in order to be more suitable for a younger audience. In another example, an uploaded digital still image captured by a user can indicate that it is raining or snowing. As a result, the digital story experience can be tailored to indoor venues.
• the computer system 286 includes a processor 292 , which can be used to analyze the pixel data of some of the customer images which are uploaded and stored in the customer database 288 .
• the processor 292 can analyze the pixel data in order to detect faces in one or more customer images using a variety of known face detection algorithms.
• the face detection algorithm determines the number of faces that can be detected in an image, in order to determine how many people are depicted in the image.
• the face detection algorithm determines if the detected faces are female faces or male faces.
• the face detection algorithm determines the approximate ages of the people whose faces have been detected.
• approximate age relates to categorizing one or more faces into broad, age-related categories. These approximate age categories can include, for example, babies, young children, teens, younger adults, and older adults (i.e. senior citizens).
• the processor 292 in the computer system 286 can analyze the pixel data of some of the customer images in order to determine whether one or more landmarks are depicted in the images.
• image recognition algorithms are used, for example, as part of the Google GogglesTM Application (APP) for the Android mobile platform, which is available from Google, Mountain View, Calif.
• the processor 292 in the computer system 286 creates the information needed to provide a unique photo product for a particular user of one of the smart phones 300 A, 300 B by incorporating images captured by the user during one or more digital story experiences with pre-stored information, such as professional images and textual descriptions.
• pre-stored information such as professional images and textual descriptions.
• This enables a photo product to be automatically created by placing the user-captured images in predetermined locations in the photo product, so that they are associated with the pre-stored information. For example, a first image captured by the user near the Lincoln Memorial in Washington D.C. can be associated with pre-stored information which describes the romance of Abraham Lincoln and provides an image related to his Gettysburg Address speech.
• a second image, captured by the user near the White House, can be associated with pre-stored information that describes or depicts the current president. This enables a photo product to be automatically produced using the user-captured images at two different locations, along with the pre-stored information associated with the two different locations.
• the processor 292 in the computer system 286 modifies the appearance of one or more of the captured digital images, so that it has a more suitable appearance when incorporated into the photo product.
• faces in the captured digital image can be detected, and the processor 292 can crop the digital image to enlarge the size of the faces and remove some of the distracting background surrounding the face.
• captured digital images can be processed by the processor 292 to provide a different image appearance.
• captured digital images can be processed so that the newly captured images appear to be older photographs, such as daguerreotypes, so that they have a more suitable appearance when positioned in a photo product in association with an image related to the Gettysburg Address.
• the captured digital images can be processed to provide an image having a different color tint, contrast, or external shape, so that it has a more suitable appearance when positioned in a photo product as part of an advertisement for a product or service.
• the captured digital images can be processed to provide a cartoon effect or a coloring book effect so that they have a more suitable appearance when positioned in a children's photo product in association with pre-stored cartoons or as part of a page which provides a “coloring book” for a child.
• captured digital images can be processed by the processor 292 to provide a different image appearance in response to the image content of the captured image.
• the processor 292 can determine the location of multiple faces within the image and automatically crop the captured digital image using different aspect ratios for different captured images in order to produce a more suitable appearance in the photo product.
• the captured digital images can be processed by the processor 292 to provide a different image appearance in response to the location where the image was captured.
• the processor 292 can provide a “cartoon” effect for images captured in a particular location, such as images captured in a particular park or playground.
• the captured digital images can be processed by the processor 292 to provide a different image appearance in response to both the image content of the captured image and the location where the image was captured.
• the processor 292 can provide a color-based object extraction algorithm (e.g. “green screen” effect”) on images captured in a particular location when the processor 292 can determine that a background area of the captured image is a predetermined color (e.g. green).
• the communications network 250 enables communication with a fulfillment provider 270 .
• the fulfillment provider 270 produces and distributes enhanced photo products.
• the fulfillment provider 270 includes a fulfillment web server 272 , and a fulfillment computer system 276 that further includes a commerce manager 274 and a fulfillment manager 275 .
• Fulfillment requests received from service provider 280 are handled by commerce manager 274 initially before handing the requests off to fulfillment manager 275 .
• Fulfillment manager 275 determines which equipment is used to fulfill the ordered good(s) or services such as a digital printer 278 or a DVD writer 279 .
• the digital printer 278 represents a range of color hardcopy printers that can produce various photo products, including prints and postcards. The hardcopy prints can be of various sizes, including “poster prints”, and can be sold in frames.
• the DVD writer 279 can produce CDs or DVDs, for example PictureCDs, having digital still and video images and application software for using the digital images.
• the photo products are provided to the user of the smart phones 300 A, 300 B, or to a recipient designated by the user of the smart phones 300 A, 300 B.
• the photo products are provided using a transportation vehicle 268 .
• the photo products are provided at a retail outlet, for pickup by the user of the smart phones 300 A, 300 B, or by a designated recipient.
• system 214 also includes one or more kiosk printers 224 which communicate with the communication network 250 and service provider 280 via a communication service provider (CSP) 222 .
• CSP communication service provider
• This enables printed photo products, created by the service provider 280 using digital images captured by smart phones 300 A, 300 B, to be provided at retail establishments.
• the retail establishments which can be for example gift shops, may be located at or near some of the locations where the location-specific digital story experiences are provided.
• the user of the smart phones 300 A, 300 B receives the photo product at a discount, or free of charge, in order to encourage the user to enter the store where they will potentially purchase other items.
• the photo product includes advertising of merchants which are located near the location of the fulfillment provider 270 or the kiosk printer 224 .
• the service provider 280 or the fulfillment provider 270 can create examples of various photo products that can be provided by the fulfillment provider 270 .
• the examples can be communicated to the smart phone 300 or the customer computer 218 , where the examples can be displayed to the user.
• the customer database 288 at the service provider 280 stores user billing information.
• the billing information can include a payment identifier for the user, such as a charge card number, expiration date, user billing address, or any other suitable identifier.
• the customer database 288 also provides long-term storage of the uploaded images for some or all of the users.
• stored user images and digital story content is accessible (e.g., viewable) via the Internet by authorized users.
• the service provider account manager 284 can communicate with a remote financial institution (not shown) to verify that the payment identifier (e.g., credit card or debit card number) provided by the customer is valid, and to debit the account for the purchase.
• the payment identifier e.g., credit card or debit card number
• the price of the photo product can be added to the user's monthly bill paid to the service provider 280 or to their mobile phone operator.
• the functions of the service provider 280 and the fulfillment provider 270 can be combined, for example, by using a common web server for both web server 282 and web server 272 or by combining the functions of the account manager 284 , the commerce manager 274 , and the fulfillment manager 275 . It will be understood that in some embodiments, the customer database 288 or the content database 290 can be distributed over several computers at the same physical site, or at different sites.
• any of various combinations of the components of FIG. 2 may form all or part of the various components of FIG. 1 , according to respective various embodiments of the present invention.
• the system 100 corresponds only to the smart phone 300 A or the smart phone 300 B.
• the system 100 corresponds to the service provider 280 , where the processor 292 may correspond to the data processing device system 110 , the databases 288 and 290 maybe stored in the memory device system 130 , the account manager and web server may be applications stored in the memory device system 130 , and the communication network 250 may interface with the input-output device system 120 .
• the system 100 corresponds to the smart phone 300 A and the service provider 280 , such that, for example, the CPU of the smart phone 300 A and the processor 292 both form part of the data processing device system 110 .
• the system 100 corresponds to the fulfillment provider 270 .
• the system 100 corresponds to the entirety of the system 214 . Accordingly, it can be seen that the present invention is not limited to any particular correspondence configuration between the system of FIG. 1 and the system of FIG. 2 . The same is true with respect to any particular correspondence configuration between the system of FIG. 1 and the system of FIG. 3 , which will now be discussed.
• FIG. 3 depicts a block diagram of a smart phone 300 used in the system of FIG. 2 , according to some embodiments of the present invention. It will be understood that other types of mobile devices, such as tablet computers and wireless digital cameras, can be used in the system described in reference to FIG. 2 .
• the smart phone 300 is a portable, battery operated device, small enough to be easily handheld by a user.
• the smart phone 300 can utilize an operating system such as the iOS operating system developed by Apple Inc, Sunnyvale, Calif. or the Android mobile platform, developed by Google, Mountain View, Calif.
• the operating system can be stored in firmware memory 328 and utilized by digital processor 320 (which may, e.g., form at least part of the data processing device system 110 in FIG. 1 ).
• the smart phone 300 can run applications (i.e. “apps”) which are pre-installed when the smart phone is purchased, or are downloaded from the service provider 280 .
• the digital processor 320 may use, for example, the Android software stack, which includes a Linux-based operating system, middleware, and applications. This permits additional software applications (“apps”) to be downloaded from the service provider 280 , stored in the firmware memory 328 , and used to provide various functions, including the digital story experiences to be described in reference to FIG. 4 .
• the smart phone 300 includes a camera module including a lens 304 which focuses light from a scene (not shown) onto an image sensor array 314 of a CMOS image sensor 310 .
• the image sensor array 314 can provide color image information using the well-known Bayer color filter pattern.
• the image sensor array 314 is controlled by timing generator 312 , which also controls a flash 302 in order to illuminate the scene when the ambient illumination is low.
• the image sensor array 314 can have, for example, 2560 columns ⁇ 1920 rows of pixels.
• the smart phone 300 can also capture video clips by summing multiple pixels of the image sensor array 314 together (e.g. summing pixels of the same color within each 4 column ⁇ 4 row area of the image sensor array 314 ) to create a lower resolution video image frame.
• the video image frames are read from the image sensor array 314 at regular intervals, for example using a 30 frame per second readout rate.
• the analog output signals from the image sensor array 314 are amplified and converted to digital data by the analog-to-digital (A/D) converter circuit 316 in the CMOS image sensor 310 .
• the digital data is stored in a DRAM buffer memory 318 and subsequently processed by a digital processor 320 controlled by the firmware stored in firmware memory 328 , which can be flash EPROM memory.
• the digital processor 320 includes a real-time clock 324 , which keeps the date and time even when the smart phone 300 and digital processor 320 are in their low power state.
• the digital processor 320 produces digital images that are stored as digital image files using image/data memory 330 .
• the phrase “digital image” or “digital image file”, as used herein, refers to any digital image or digital image file, such as a digital still image or a digital video file.
• the processed digital image files are stored in the image/data memory 330 , along with the date/time that the image was captured provided by the real-time clock 324 and the location information provided by a location determination unit, such as GPS receiver 360 .
• the digital processor 320 performs color interpolation followed by color and tone correction, in order to produce rendered sRGB image data. In some embodiments, the digital processor 320 can also provide various image sizes selected by the user. In some embodiments, rendered sRGB image data is then JPEG compressed and stored as a JPEG image file in the image/data memory 330 . In some embodiments, the JPEG file uses the so-called “Exif” image format. This format includes an Exif application segment that stores particular image metadata using various TIFF tags. Separate TIFF tags are used to store the date and time the picture was captured and the GPS co-ordinates, as well as other camera settings such as the lens f/number.
• the CMOS sensor 310 is used to capture QR codes or bar codes which are located at a visitor information center or at an experience location.
• the captured image of the QR code or the bar code can be used, for example, to determine the URL for an app which is downloaded to the smart phone 300 from the service provider 280 in order to implement some or all of the steps which will be described in relation to FIG. 4 , FIG. 5 , and FIG. 12 .
• the captured image of the QR code or the bar code can be used to initiate the purchase of various products or services of interest to the visitor at an experience location.
• the digital processor 320 also creates a low-resolution “thumbnail” size image or “screennail” size image, which can be stored in RAM memory 322 and supplied to a color display 332 , which can be, for example, an active matrix LCD or organic light emitting diode (OLED) touch screen display. After images are captured, they can be reviewed on the color LCD image display 332 by using the thumbnail image data.
• a low-resolution “thumbnail” size image or “screennail” size image can be stored in RAM memory 322 and supplied to a color display 332 , which can be, for example, an active matrix LCD or organic light emitting diode (OLED) touch screen display. After images are captured, they can be reviewed on the color LCD image display 332 by using the thumbnail image data.
• the graphical user interface displayed on the color display 332 is controlled by user controls 334 .
• the graphical user interface enables the user to control the functions of the smart phone 300 , for example, to make phone calls, to launch and control apps, to capture images, and to send and view text messages, email messages and videos.
• User controls 334 can include a touch screen overlay on the color display 332 , as well as buttons, keyboard switches, rocker switches, or joysticks.
• the user controls 334 can include voice recognition or image based gesture recognition.
• An audio codec 340 connected to the digital processor 320 receives an audio signal from a microphone 342 and provides an audio signal to a speaker 344 and a headphone jack (not shown). These components can be used both for telephone conversations and to record and playback digital audio. The digital audio can be played back as part of a digital story experience, to be described later in reference to FIG. 4 .
• a vibration device (not shown) can be used to provide a silent (e.g., non-audible) notification of an incoming phone call or message, or to inform a user that they have entered a location, such as a geofence, where a digital story experience can be provided.
• a digital audio signal can be provided from the digital processor 320 to the wireless modem 350 , which can transmit the digital audio signal over an RF channel 352 using, for example, the well-known Bluetooth protocol.
• the digital audio signal can be received by a wireless modem in a vehicle audio system (not shown), which can amplify and play the audio using speakers installed in the vehicle. This permits the driver and passengers in the vehicle to listen to the audio that is presented as part of the digital story experience.
• a memory (which may, e.g., form at least part of the memory device system 130 in FIG. 1 ) in the smart phone 300 can be used to store a variety of music using standard audio files, such as the well-known MP3 audio format, so that the smart phone 300 serves as a music player.
• music files consistent with the theme of the digital story experience can be automatically downloaded from the service provider 280 and stored in firmware memory 328 . The music files can then be automatically played when the smart phone 300 is not at a digital story experience location, as will be described later in reference to step 890 in FIG. 12 .
• an MP3 audio file for the song “John Brown's body” can be automatically downloaded when the “Fight for rights” theme is selected, as will be described later in reference to FIG. 6A , since the song “John Brown's body” is consistent with the “fight for rights” theme.
• the song “(Get your kicks on) Route 66” is consistent with a digital story experience along historic route 66.
• a dock interface 362 can be used to connect the smart phone 300 to a dock/charger 364 , which is optionally connected to customer computer 218 .
• the dock/recharger 364 can be used to recharge the batteries (not shown) in the smart phone 300 .
• the dock interface 362 can conform to, for example, the well-know USB interface specification.
• the interface between the smart phone 300 and the customer computer 218 can be a wireless interface, such as the well-known Bluetooth wireless interface or the well-know 802.11 wireless interface.
• the dock interface 362 can be used to transfer data for providing a plurality of location-specific digital stories to the camera phone 300 prior to leaving on a vacation trip.
• the digital processor 320 is communicatively connected to a wireless modem 350 , which enables the digital smart phone 300 to transmit and receive information via an RF channel 352 .
• the wireless modem 350 communicates over a radio frequency (e.g. wireless) link with the cellular provider network 240 , described earlier in reference to FIG. 2 , which can utilize, for example, a CDMA network, a 3GSM, a 4 GSM network, or other wireless communication networks.
• the wireless modem 350 also communicates using local area wireless interface standards, such as the well-know 802.11 interface standards or the well-known Bluetooth standard.
• digital processor 320 because it may form at least part of the data processing device system 110 , can be provided using a single programmable processor or by using multiple programmable processors, including one or more digital signal processor (DSP) devices.
• the digital processor 320 can be provided by custom circuitry (e.g., by one or more custom integrated circuits (ICs) designed specifically for use in smart phones), or by a combination of programmable processor(s) and custom circuits, just like the data processing device system 110 .
• communicative connections between the digital processor 320 and some or all of the various components shown in FIG. 3 can be made using a common data bus.
• the connection between the digital processor 320 , the DRAM buffer memory 318 , the image/data memory 330 , and the firmware memory 328 can be made using a common data bus.
• FIG. 4 is a flow diagram depicting steps for providing location-specific digital story experiences related to a common theme at different locations, according to some embodiments of the present invention.
• the steps are performed by the service provider 280 in FIG. 2 .
• some or all of the steps are performed by the smart phone 300 in FIG. 3 .
• step 400 of FIG. 4 data for a plurality of location-specific digital stories related to at least one common theme is stored on a network-accessible storage device system, such as content database 290 in FIG. 2 .
• the digital stories are stored in association with GPS information, such as geofences, which indicate the locations where the digital stories are to be presented.
• GPS information such as geofences
• a number of variations of the digital story for the same theme are stored for each location. This is done because some users at any particular location will have already experienced digital stories for the same theme at one or more other locations, while other users will experience their first digital story for the theme at this particular location.
• location-specific digital stories are stored for a plurality of different themes in the content database 290 .
• the plurality of themes for locations in the Rochester, N.Y. region could include digital stories for a first theme related to the “Fight for Rights”, for a second theme related to “Life along the Erie Canal”, and for a third theme related to “Winemaking in the Finger Lake region”.
• FIG. 6 is an example of a map 530 depicting different experience locations 531 , 532 , and 533 at which location-specific digital story experiences related to a common theme can be provided, according to some embodiments of the present invention.
• the common theme is a “fight for rights” theme.
• the map identifies three locations in upstate New York, including experience location “1” 531 near Seneca Falls, experience location “2” 532 near Skaneateles, and experience location “3” 533 near Cortland.
• profiles are developed for a plurality of users of mobile devices, such as the users of smart phones 300 A, 300 B in FIG. 2 , and stored in customer database 288 .
• the profiles indicate whether each user has been presented with one or more digital stories at one or more digital story experience locations. If a user has been presented with a digital story, the theme, location, and date/time of each digital story presentation are recorded in their user profile.
• the user profile includes information derived from responses given by the user during their digital story experiences. For example, the user may have been asked to select a particular character from a plurality of characters that could be used to present stories.
• the user profile stores data which identifies the user-selected character, so that the same character can automatically be featured in a related digital story experience at another location.
• the user profile is stored in a memory of the smart phone 300 , such as image/data memory 330 or firmware memory 328 .
• the current location of the mobile device for a particular user is determined. This can be done, for example, by using the GPS receiver 360 in the smart phone 300 (see FIG. 3 ) to determine the GPS coordinates of the smart phone 300 , and by using the digital processor 320 in the smart phone 300 to communicate the GPS coordinates to the service provider 280 using the wireless modem 350 . It will be understood that in some embodiments, the GPS coordinates of experience locations can be provided by the service provider 280 and stored in a memory of the smart phone 300 (such as image/data memory 330 or firmware memory 328 ) so that the digital processor 320 in the smart phone 300 can determine if the mobile phone 300 is at an experience location.
• the process proceeds to provide directions step 420 .
• directions step 420 directions are provided in order to direct the user to one or more nearby experience locations where a digital story experience can be provided.
• the map shown in FIG. 6 can be used to provide directions to the user.
• standard mapping programs, such as Google Maps, already installed on the smart phone 300 can be used to provide directions to the user.
• images showing a landmark can be used to provide directions to the user.
• the smart phone 300 provides a menu of themes for location-specific stories that can be provided at nearby experience locations, and the user is permitted to select a specific theme. Once the user selects the specific theme, the user is directed to one or more nearby locations associated with the user-selected theme. For example, the user may select a specific theme using their smart phone 300 before they begin driving their vehicle to a nearby experience location associated with the theme they have selected. As the user drives their vehicle, the smart phone 300 can direct the user to one of the nearby experience locations by displaying a map and providing audio guidance for which roads to take and where to turn.
• the associated digital story can then be automatically provided, for example by presenting an audio signal which plays over the vehicle's stereo audio system using a Bluetooth connection between the smart phone 300 and the vehicle's stereo audio system.
• select location-specific story step 425 one of a plurality of possible location specific digital stories is selected and provided to the user's mobile device, for example by transmitting digital data for the selected digital story from the service provider 280 to the user's smart phone 300 .
• the plurality of possible location specific digital stories is stored in a memory of the smart phone 300 (such as image/data memory 330 or firmware memory 328 ) at an earlier time, and is selected by the digital processor 320 .
• FIG. 5 is a flow diagram depicting steps for the select location-specific story step 425 in FIG. 4 , according to some embodiments of the present invention.
• access user profile step 500 the stored user profile for the user is read from a memory which stores profiles for a plurality of users of mobile devices, such as customer database 288 in FIG. 2 .
• the stored user profile provides the user's history concerning stories that the user viewed at earlier times.
• viewed earlier story test 505 a determination is made as to whether the user profile indicates that the user has already viewed a location-specific digital story at another experience location which relates to the theme of a digital story available at the current experience location.
• first digital story step 510 data for a first digital story which can be presented at the user's current location is provided.
• the data for the first digital story is transmitted from the service provider 280 to the user's mobile device, such as smart phone 300 A.
• the first location-specific story is automatically initiated when the user reaches the location associated with the story, for example when the user enters the geofence for the particular digital story experience location.
• the location-specific story is determined by presenting to the user a menu which permits the user to select one of a plurality of first digital stories that can be provided at the current location.
• the plurality of stories can include stories on the same general theme (e.g. a women's rights theme) which are narrated by different characters, such as a young girl character and an older woman character.
• the plurality of stories can also include stories having different themes (e.g. a first story having a women's rights theme and a second story related to the Erie Canal).
• the first location-specific story is selected responsive to demographic information stored in the user profile.
• the user profile can store the preferred (e.g., native) language of the user, and the user profile can be accessed in order to provide a first digital story which is presented in the preferred language of the user.
• the user profile can store the approximate age of the user, and the user profile can be accessed in order to provide a first digital story which is appropriate for the age of the user. For example, different first digital stories may be provided to children, teenagers, adults, and senior citizens.
• FIG. 7A depicts an example of a user interface screen for selecting a theme for location-specific stories using color display 332 of smart phone 300 , according to some embodiments of the present invention.
• Story greeting window 612 includes a user photo 614 , which can be displayed using image data from the stored user profile for the particular user of the smart phone 300 .
• Story greeting window 612 also includes a message window 616 which asks the user to select one of the stories in story selection window 620 .
• Story selection window 620 permits the user to select a wine story 624 having wineries as the theme, as depicted using a winery story image 622 .
• Story selection window 620 also permits the user to select an Amelia story 634 having the fight for rights as the theme, which is told by a historical figure named Amelia Jenks Bloomer, as depicted using Amelia story image 632 .
• the theme and character of the first digital story are introduced, in order for the user to understand the overall context of the story. For example, if the theme of the story is the women's rights movement, the first digital story can discuss the historic context of the story and provide background information on the character who is narrating the story.
• FIG. 7B depicts a user interface screen that begins to introduce the theme and character of the Amelia fight for rights story, which is one of the themes that can be selected by the user, using the user interface screen depicted in FIG. 7A .
• the user interface screen depicted in FIG. 7B includes the Amelia story image 632 , since the story will be told by the historical figure Amelia Jenks Bloomer.
• the user interface screen depicted in FIG. 7B also includes a story introduction window 640 , which provides text that introduces the theme and the main character of the story, who is named Amelia.
• the digital story told by Amelia can include still and video images, as well as audio narration, sound effects, and music.
• the text in story introduction window 640 could be provided as an audio narration.
• the user interface screen depicted in FIG. 7B also includes a map 642 depicting other locations where the user can view location-specific stories concerning the same theme (e.g. the fight for rights theme).
• the user interface screen depicted in FIG. 7B also includes a “Follow Amelia” icon 646 which the user can select to continue experiencing Amelia's story, and an “Another theme” icon 648 which the user can select in order to view a menu that permits the user to select another story theme or character.
• step 520 data for a second digital story which can be presented at the user's current location is provided.
• the data for the second digital story is transmitted from the service provider 280 to the user's mobile device, such as smart phone 300 A.
• the data for the second digital story is downloaded at an earlier time (e.g. when the data for the first digital story was downloaded at another location) and stored in a memory of the user's mobile device (e.g. image/data memory 330 or firmware memory 328 ) in the smart phone 300 in FIG. 3 ) so that the data for the second digital story is immediately available when the user moves to the experience location associated with the digital story (i.e. the current location).
• the theme and character which were used in the first digital story are continued, so that the digital story provided at the current location builds on the story already provided at the earlier experience location or locations.
• the second digital story can describe how food and materials which were loaded onto the barge at a different location, which was visited by the user at an earlier time, are being unloaded from the same barge at the current location, so that the food and materials can be sold at a store near the current location.
• the location-specific digital story selected in step 425 is presented to the user.
• the digital story can be presented to the user using a variety of story-telling methods, such as audio stories, text-based stories, video stories, and augmented-reality stories.
• the user selects a preferred story-telling method from a menu offering a variety of choices, which is stored in their user profile during store user profiles step 405 .
• the user can select a text based story, rather than a story that includes audio, if they are hearing-impaired or concerned about distracting others.
• the digital story can be told primarily using audio narration, sound effects, and music. However, still and video images could also be provided, for viewing by passengers in the vehicle.
• the presentation of a digital story is initiated when the user's mobile device, such as smart phone 300 , enters a geofence and continues even if the mobile device leaves the geofence, until the presentation is completed (e.g. until a complete audio clip has been played). In some other embodiments, the presentation is terminated when the mobile device leaves the geofence.
• the digital story associated with the geofence can include associated data which indicates whether or not the digital story presentation should continue if the mobile device leaves the geofence.
• the digital story-telling method can be automatically selected by a processor in system 214 (such as processor 292 at service provider 280 or digital processor 320 in smart phone 300 ) based on measurements performed by one of the mobile devices, such as smart phone 300 .
• the digital processor 320 in the smart phone 300 can determine the user's speed from measurements made by the GPS receiver 360 . If the user's average speed is greater than a threshold (e.g. greater than 10 miles per hour), the story-telling method can be automatically switched to an audio mode, since the user is likely in a moving vehicle.
• the digital processor 320 in the smart phone 300 can determine the ambient noise level from measurements made using the mic 342 and audio codec 340 . If the noise level is greater than a threshold (e.g. greater than 90 dB), the story-telling method can be automatically switched to a mode which displays text subtitles, since it may be difficult for the user to hear audio messages.
• FIG. 8A depicts a user interface screen for presenting a first location-specific digital story associated with a first theme at a first geographic location, according to some embodiments of the present invention.
• the user interface screen example shown in FIG. 8A is used to present a first location-specific digital story 660 associated with a particular theme (i.e. the fight for rights) at the Seneca Falls experience location “1” 531 shown in FIG. 6 .
• the first location-specific story is presented when the user selects the “Follow Amelia” icon 646 in FIG. 7B , and begins by assuming that the user has not yet viewed any digital stories associated with the fight for rights theme.
• the digital story 660 can be provided using one or more of audio, text, graphics, still images, video images, and augmented-reality images.
• an augmented reality character is used to present at least a portion of the digital story.
• augmented reality techniques can be used to cause the mobile device to display one or more augmented reality images of Amelia (or some other historical character in other digital stories) along with the image or images captured by the mobile device to make the statue of Amelia 664 appear to “come to life” on the color display 332 of the user's smart phone 300 or other mobile device.
• the augmented reality character can be used to narrate the story, or to perform an action described in the story.
• the augmented reality character can be provided, for example, using the Aurasma augmented reality software provided by HP.
• Aurasma can be utilized by iPhone and Android apps in order to recognize images, symbols and objects captured by the camera in the smart phone.
• the captured images can be paired up with overlaid videos, animation, 3D still images or other date sources, known as “Auras”, and displayed to the user.
• FIG. 8B depicts a user interface screen for presenting a second location-specific digital story associated with the first theme at the first geographic location, according to some embodiments of the present invention.
• the user interface screen example shown in FIG. 8B is used to present a second location-specific digital story 670 associated with the same theme (i.e. the fight for rights) at the same Seneca Falls experience location “1” 531 shown in FIG. 6 .
• the second location-specific story provides a continuation of a digital story that the user had viewed at an earlier time at a different experience location (e.g. the Cortland experience location “3” 533 in FIG. 6 ).
• the second location-specific digital story 670 uses an audio presentation, a video presentation, or a text presentation (which begins “I′m glad you've followed me here to Seneca Falls”) which is different than the first location-specific digital story 660 (which begins “Welcome! Let me begin the story of fighting for rights here in Seneca Falls”) described earlier in reference to FIG. 8A .
• FIG. 9 depicts a user interface screen for presenting a location-specific digital story associated with the first theme at a second geographic location, according to some embodiments of the present invention.
• the user interface screen example shown in FIG. 9 is used to present a location-specific digital story 680 associated with the same theme (i.e. the fight for rights) at a second experience location, which is the Skaneateles experience location “2” 532 in FIG. 6 .
• This location-specific digital story provides a continuation of the digital story that the user began in Seneca Falls experience location “1” 531 .
• the digital story 680 relates to a house 682 which is historically important, since it was part of the underground railroad which allowed slaves to escape from the United States to Canada.
• augmented reality techniques can be used to reveal a virtual interior of the house 682 on the color display 332 of the user's smart phone 300 .
• the virtual interior can be used to help demonstrate the historical importance of the house 682 , by showing rooms where the Fuller Family lived, and revealing secret areas where slaves could be hidden.
• FIG. 10 depicts a user interface screen for presenting a location-specific digital story associated with the first theme at a third geographic location, according to some embodiments of the present invention.
• the user interface screen shown in FIG. 10 is used to present a location-specific digital story 690 associated with the same theme (i.e. the fight for rights) at a third experience location (i.e. the Cortland location “3” 533 in FIG. 6 ).
• the location-specific digital story 690 is presented in Spanish, since the user profile indicates that this user's preferred language is Spanish.
• the user positions the camera lens 304 of their smart phone 300 (see FIG. 3 ) towards the sign 692 the English words on the sign can be recognized.
• the message on the sign can be read to the user in their preferred (e.g. native) language, using speaker 344 in smart phone 300 (see FIG. 3 ).
• a virtual reality sign in the user's native language can be displayed on the color display 332 of the user's smart phone 300 .
• the user profile is updated based on the user's digital story experience.
• the user profile can be updated to indicate that the user has been presented with the first digital story of a particular theme (e.g. the fight for rights theme) at the first location (e.g. the Seneca Falls experience location “1” 531 in FIG. 6 ).
• the user is asked to respond to questions as a digital story is presented (for example, whether they would like to hear more about particular topics), and their answers are used to update their stored user profile (for example, to indicate their interest in the particular topics).
• the approximate period of time that the user spends in the location where they have experienced the digital story is recorded, to indicate the user's level of interest in the story location.
• This information can be used to help select future location-specific digital stories, for example by providing shorter or longer versions of a digital story based on whether the user spent a relatively long time, or a relatively short time, experiencing the current digital story or participating in other activities at the location.
• a suggested next digital story experience location is provided to the user's mobile device, such as smart phone 300 in FIG. 2 .
• the processor 292 in the computer system 286 at the service provider 280 determines the next suggested experience location, based on the user profile which has been updated in step 440 .
• the suggested next experience location (after the user has been presented with the digital story at Seneca Falls experience location “1” 531 ) could be the Skaneateles experience location “2” 532 or the Cortland experience location “3” 533 .
• the user of the smart phone 300 can reject the next suggested experience location.
• the service provider 280 can determine and suggest an alternative next experience location.
• the user can be presented with the option of being presented with a digital story on a different theme at the current experience location, or at a nearby experience location.
• the user could be presented with the option of visiting a nearby experience location associated with the Seneca Wine Trail.
• directions are provided in order to direct the user to the suggested next experience location where a digital story can be provided.
• the map shown in FIG. 6 can be used to provide directions to the suggested next experience location.
• the directions are provided by the character chosen by the user (e.g. Amelia) who can describe, in a historic context, the directions to the suggested next experience location.
• the account manager 284 and the customer database 288 in the computer system 286 are used to determine user specific information related to the history of the user's interactions with the system, as well as any previously captured or determined information about the user's experience. For example, in a “vacation trip” scenario, the user may be known to be traveling from a starting location (e.g. their home town) to a particular vacation destination. Further, it may be known that the user has already visited several digital story experience locations and is interested in following a route that will take the user closer to their vacation destination.
• the suggested next experience location can be made based on responses or answers the user conveyed to questions provided by smart phone 300 (e.g., during a digital story). For example, the user can respond to questions about whether they are interested in a next experience related to a different theme, or whether they are interested in visiting specific areas, or are interested in obtaining a meal or lodging in a specific area, or at a specific restaurant or hotel. In some embodiments, the suggested next experience location can be stored and recalled at a later date.
• the suggested next experience location can be based on ambient conditions, such as the current weather, the time of day, or safety related ambient condition information.
• ambient condition information (such as whether it is a rainy day) is used to automatically suggest an indoor location from the set of possible next locations.
• the time of day can be used, in combination with the operating hours of some experience locations, to avoid suggesting locations that may be closed, or otherwise inaccessible, at the time the user is likely to arrive at the location.
• the suggested experience location can be based on avoiding a severe weather storm in the area, or avoiding any fire, crime, or other safety related incident which may have occurred in the vicinity of one or more experience locations.
• the user is asked to capture one or more images of themselves, or their group, during present story step 435 .
• the processor 292 in the computer system 286 at the service provider 280 determines the next possible image capture location based on the result of analyzing the pixel data of one or more of these user captured images. For example, the captured images can be analyzed to determine whether there are any children depicted in the captured digital image.
• the service provider 280 provides a downloadable software application (“app”) over the communication network 250 to the smart phone 300 , in order to provide the location-based digital stories.
• the smart phone 300 is one example of a mobile device that includes a memory, such as image/data memory 330 , which serves as a memory for storing digital story content, output devices including a color display 332 and a speaker 344 for outputting digital story content, a GPS receiver 360 which serves as a location determination unit, a digital processor 320 which serves as a data processing system, and a firmware memory 328 which serves as a program memory.
• the digital processor 320 is communicatively connected to the image/data memory 330 , the color display 332 , the speaker 344 via the audio codec 340 , and the firmware memory 328 .
• the instructions provided in the app can control the digital processor 320 in order to store data for providing a plurality of location-specific digital stories related to a common theme at a plurality of locations in the image/data memory 330 .
• the instructions provided in the app can also be used by the digital processor 320 to determine if the current location of the mobile phone 300 , provided by GPS receiver 360 , corresponds to one of the plurality of locations for the location-specific digital stories.
• the instructions provided in the app can also be used by the digital processor 320 to determine if the user of the mobile device has already viewed one of the plurality of location-specific digital stories at a different one of the plurality of locations.
• the instructions provided in the app can also be used by the digital processor 320 to read digital story content data for a first digital story from the image/data memory 330 and to provide the first digital story content data to one or more of the output devices in the smart phone 300 , such as color display 332 and speaker 344 , if it is determined that the smart phone 300 has not been used to present one of the plurality of location-specific digital stories at a different one of the plurality of locations.
• the instructions provided in the app can also be used by the digital processor 320 to read digital story content data for a second digital story from image/data memory 330 and to provide the second digital story content data to one or more of the output devices in the smart phone 300 , if it is determined that the smart phone 300 has been used to present one of the plurality of location-specific digital stories at a different one of the plurality of locations.
• FIG. 11 depicts a photo postcard product which includes a user-captured image and pre-stored information, according to some embodiments of the present invention.
• FIG. 11 depicts a photo postcard 700 , which is one type of printed photo product which can be provided by fulfillment provider 270 .
• the photo postcard 700 includes a title section 705 which includes a historical character image 710 and the title “Pathways Through History”. Title section 705 is provided using pre-stored images and other information stored in content database 290 at the service provider 280 in FIG. 2 .
• the photo postcard 700 also includes a main image 715 , which was captured by the user during the digital story presentation, as a result of instructions given to the user during the digital story presentation.
• the main image 715 depicts a modified user character 720 , which includes the user's head but which has been clothed in period clothing using augmented reality techniques.
• the main image 715 also depicts historical figures 722 from the digital story presentation, who have been added to the main image 715 using augmented reality techniques.
• the photo postcard 700 also includes an unmodified user photo 730 , along with customized text 735 “Andrea's Fight for Rights”.
• Customized text 735 provides the user's name, which has been automatically added by using the name or nickname in the user profile.
• the back view 700 B of the photo postcard 700 includes a postage section 740 .
• a postal stamp is affixed to the postage section 740 .
• a custom stamp providing an image associated with the theme of the digital story experience is printed in the postage section 740 , as part of a customized postage stamp.
• the back view 700 B also includes an address section 745 , which provides the mailing address of the recipient. In some embodiments, the address section 745 is automatically filled out when the user selects a recipient from the address book stored in their smart phone 300 , or from a list of friends addresses stored as part of their user profile.
• the back view 700 B of the photo postcard 700 also includes a message section 750 .
• the text message in the message section 750 is automatically derived from pre-stored information and user responses provided by the user during the digital story presentation.
• a portion of the text message in the message section 750 is provided by speech to text conversion of the user's spoken comments which have been converted to digital audio signals by mic 342 and audio codec 340 in smart phone 300 , and converted to text by digital processor 320 in smart phone 300 or by processor 292 after the digital audio signals have been uploaded to service provider 280 .
• one or more user captured images can be modified and composited with pre-stored information.
• the processor 292 in the computer system 286 can process a user captured image in order to crop out a face of a person depicted in the image, convert the face from a color to a monochrome image, and composite the image of the face into one of a plurality of pre-stored newspaper templates, so that the user captured image appears to be a photograph in a historic newspaper related to the theme of the digital story.
• the newspaper text can be modified based on text entered by the user of the smart phone 300 . For example, the headline of the newspaper can read “Andrea and Declan fight for rights”
• the service provider 280 provides advertisements or coupons specific to the digital story over the communication network 250 to the smart phone 300 .
• one or more user captured images can be modified and composited with pre-stored information in order to create the advertisements or coupons.
• a particular advertisement is selected from a plurality of possible advertisements based on various criteria.
• the criteria can include, for example, demographic information such as the approximate age of the user, as stored in the user profile, or the approximate age of one or more of the persons depicted in the captured digital image. For example, if the captured digital image includes one or more children, the particular advertisement can be for an age-appropriate book or toy related to the theme of the digital story.
• the criteria can also include travel route related information, so that the advertisements relate to businesses the user is likely to pass on their trip to the next experience location, or to their vacation destination.
• the criteria can also include weather related information such as the current temperature. For example, on warm days the advertisement can provide an offer related to a discount on an ice cream cone at a first nearby merchant along the travel route, and on cold days the advertisement can provide an offer related to a discount on a hot drink at second nearby merchant.
• the coupons can be for a limited time period, based on the date and time ambient condition information.
• the coupons can customized so that they can only be used by the particular user of the smart phone 300 . This can be done, for example, by including one of the digital images captured by the user, as part of the coupon.
• the processor 292 analyzes metadata associated with the user captured digital images, to determine whether the analyzed images were captured within predetermined areas associated with particular location-specific digital stories.
• the processor can analyze the pixel data of the user captured digital images to determine if the images also include a particular object (e.g. a certain building, or a certain type of signpost).
• a particular object e.g. a certain building, or a certain type of signpost.
• the processor 282 performs additional analysis on the pixel data of the user captured images, in order to determine the quality of the images. For example, a number of user captured images can be evaluated to select a subset of images which contain the best composition or pose (e.g. the best looking smile), or which provide the best exposed or focused images.
• the pre-stored information can include images, graphics, text, or templates. If the photo product to be produced is a digital photo product, such as a video slide show or digital video clip, the pre-stored information can include audio information such as voice narration tracks or music tracks, or video information such as video clips describing the historic site, or video special effects templates or tracks.
• the user of mobile phone 300 can be the driver or passenger in a vehicle which is driving along a route.
• the route can be, for example, a scenic or historic route, such as historic Route 66 in California, the scenic Seaway Trail along Lake Ontario in upstate New York, or Routes 5 and 20 along the Finger Lakes in upstate New York.
• Vehicles can begin their journeys at various points along the route, and can drive in at least two alternate directions (e.g. west to east, or east to west). Therefore, system 214 is designed to provide digital stories which are appropriate for the user's route, no matter where they begin along the route, or which direction they follow.
• FIG. 12 is a flow diagram depicting steps for providing travel direction-dependent digital stories at a plurality of different locations, according to some embodiments of the present invention.
• the steps are performed by the service provider 280 in FIG. 2 .
• some or all of the steps are performed by smart phone 300 in FIG. 3 .
• data for a plurality of direction-dependent and location-specific digital stories are stored on a network-accessible storage device system, such as content database 290 in FIG. 2 .
• the digital stories are stored in association with GPS information, such as geofences, which indicate the locations where the digital stories are to be presented as well as one or more travel directions associated with particular digital stories.
• GPS information such as geofences
• At least some of the digital stories provide messages that are travel direction-dependent and need to be presented at the appropriate time, and with the appropriate content, for the travel direction.
• the message “coming up on your right is Naked Dove Brewing Company, the perfect place to learn about beer” is appropriate for east to west travelers, if it presented starting about 1 ⁇ 4 mile east of the Naked Dove Brewing Company location.
• this message is not suitable, and a different message (e.g. “coming up on your left is Naked Dove Brewing Company, the perfect place to learn about beer” needs to be presented starting at a location which is about 1 ⁇ 4 mile west of the Naked Dove Brewing Company location.
• direction-dependent, location-specific digital stories are stored for a plurality of different themes or categories in the content database 290 .
• the plurality of themes or categories for users in vehicles driving along Route 5 and 20 could include themes related to the “Fight for Rights” and “Wineries in the Finger Lake region” and categories such as “Best places to eat” and “Fun stops for kids”.
• the location-dependent digital stories are stored in a memory of smart phone 300 , such as image/data memory 330 or firmware memory 328 , by downloading an app from the service provider 280 . The app can then be selected by the user of smart phone 300 , and the instructions provided by the app can be executed by digital processor 320 , in order to perform the steps depicted in FIG. 12 .
• preferences are developed for a plurality of users of mobile devices, such as the users of smart phones 300 A, 300 B in FIG. 2 , and stored in customer database 288 .
• the preferences can indicate an interest in specific topics, such as history or art, or in specific types of visitor attractions, such as antique shops, wineries or microbreweries.
• user profiles are also stored, as described earlier in reference to step 405 of FIG. 4 .
• the user preferences indicate whether the user has already been presented with one or more digital stories. If a user has been presented with a digital story, the theme, location, and date/time can be recorded in their user profile.
• the user can also indicate a current need, such as the need to locate a relatively nearby restaurant, gas station, or rest room.
• the current location of the mobile device for a particular user is determined, as was described earlier in reference to step 410 of FIG. 4 . This can be done, for example, by using the GPS receiver 360 in the smart phone 300 (see FIG. 3 ) to determine the GPS coordinates of the smart phone 300 , and by using the digital processor 320 in the smart phone to communicate the GPS coordinates to the service provider 280 using the wireless modem 350 .
• an experience location test 415 a determination is made as to whether the user's current location corresponds to one of the plurality of locations at which location-based digital stories can be provided by system 214 (yes to test 415 ) or is outside this plurality of experience locations (no to test 415 ), as described earlier in reference to test 415 in FIG. 4 . This can be tested by determining, for example, if the user's smart phone 300 has entered into the geofence for any of the experience locations.
• FIG. 13 is an example of a map 800 depicting a plurality of different experience locations and travel directions at which travel direction-dependent digital stories can be provided.
• four different geofences, 810 , 820 , 830 , and 840 are positioned at different locations in the Canandaigua, N.Y. area.
• Geofence 810 is located in the central downtown area, and is associated with a digital story related to the history of Ontario County, which does not depend on the direction of travel.
• the other three geofences 820 , 830 , and 840 are associated with direction-dependent digital stories.
• geofence 840 is associated with different digital stories that correspond to southern travel direction 842 , western travel direction 844 , and eastern travel direction 846 .
• One particular digital story associated with southern travel direction 842 can relate, for example, to the CMAC performing arts center which the vehicle will soon approach on its left side, or with the Canandaigua Country Club which the vehicle will pass on its right side.
• One particular digital story associated with western travel direction 844 can relate, for example, to the history of Canandaigua Lake, which the vehicle will soon approach on its left side.
• One particular digital story associated with eastern travel direction 846 can relate, for example, to festivals or other events which are taking place in Geneva, N.Y., which is the next major community along Route 5 and 20 to the East.
• the digital stories describing these festivals and other events are stored in association with information defining the particular time period (e.g. dates and times) of these events, and is only presented during the particular time period that the events are taking place.
• the digital stories describing these events, and the information defining the particular time period of these events is managed and updated by content curators responsible for the events, using computer 218 in FIG. 3 , so that up-to-date information for the events is stored in content database 290 .
• Geofence 820 is associated with different digital stories that correspond to northern travel direction 822 , soiled travel direction 826 , and eastern travel direction 824 .
• One particular digital story associated with northern travel direction 822 can relate, for example, to a business which matches the user's preferences stored in the user profile, as described earlier in relation to step 855 . For example, if the user has indicated an interest in antiques, the digital story presented to this user can relate to a particular antique shop located along Main Street in downtown Canandaigua. If the vehicle is following southwestern travel direction 826 and the user has indicated a current need for a gas station, the digital story can relate to one or more nearby gas stations that the user will pass while traveling west along Route 5 and 20.
• One particular digital story associated with eastern travel direction 824 can relate, for example, to the history of Canandaigua Lake, which the vehicle is passing on the right.
• the particular digital story associated with eastern travel direction 824 can be similar to the digital story associated with western travel direction 844 , described earlier in relation to geofence 840 .
• Geofence 830 is associated with different digital stories that correspond to northeastern travel direction 832 , soiled travel direction 836 , and southern travel direction 834 .
• the particular digital stories associated with northeastern travel direction 832 can include, for example, two or more different digital stories related to the same venue which is located along the current travel route.
• the stored direction-dependent digital stories for the New York Wine and Culinary Center can include a first story related to the wine tastings offered at the Center, a second story related to the restaurant located at the Center, and a third story related to the rest room facilities located at the Center.
• One or more of these three digital stories for the New York Wine and Culinary Center can be presented to users in vehicles headed in the northeastern travel direction 832 , depending on the user's preferences and needs, as described earlier in relation to step 855 .
• One of the digital stories associated with southwestern travel direction 836 can be, for example, a general story describing the history of Route 5 and 20, which started as foot trails established by Native Americans thousands of years ago, and later became part of the transcontinental federal highway between Boston and Newport, Oreg.
• this particular digital story can be associated with many different geofences along Route 5 and 20, and can be presented only once, when the user's vehicle first enters one of the geofences associated with this general story. This permits the user to learn about the general history of Route 5 and 20 soon after they begin their journey, but during a time when there are no other attractions or traffic stops to interrupt the story.
• the general story will not be repeated when the user's vehicle enters the other geofences associated with the same general story during the same trip.
• the digital stories associated with travel direction 834 can include, for example, two different digital stories related to the 1837 Cobblestone Cottage Bed and Breakfast.
• the first digital story can describe the general history of the 1837 Cobblestone Cottage
• the second digital story can describe specific accommodations, such as a room type and room rate.
• the second digital story is presented if the user has indicated a user preference for bed and breakfast types of accommodations and if the 1837 Cobblestone Cottage Bed and Breakfast currently has a vacant guest room. If not, the first digital story is presented.
• this vacancy information is updated by a content curator responsible for the 1837 Cobblestone Cottage Bed and Breakfast venue, using computer 218 , so that up-to-date information is stored in content database 290 .
• a digital story could be presented only if the travel direction is determined to be a particular travel direction (e.g. Northern travel direction 822 ), otherwise a digital story would not be presented. It will also be understood that in some embodiments, at some experience locations a particular digital story could be presented only if it was determined that the travel direction at a specified location prior to entering the experience location was determined to be a particular direction.
• a particular travel direction e.g. Northern travel direction 822
• the process proceeds to provide general content step 890 .
• the content is music (e.g. mp3 files) previously stored by the user on their smart phone 300 , or provided by a music streaming service such as PandoraTM Internet Radio.
• the music is muted or paused when digital stories are presented in present story step 435 , and automatically resumed when the digital story presentation is completed.
• the general content can include a digital map showing the vehicle's current location.
• standard mapping programs such as Google Maps, already installed on the smart phone 300 can be used to provide general map content.
• the process proceeds to determine travel direction step 860 .
• the travel direction is determined by comparing recent GPS readings from GPS receiver 360 in smart phone 300 , in order to determine, for example, whether the travel direction for a vehicle which has entered geofence 820 in FIG. 13 is northern travel direction 822 , southwestern travel direction 826 , or eastern travel direction 824 .
• the travel direction is determined, at least in part, by determining which other geofences the vehicle has recently exited. For example, if the vehicle has recently exited geofence 830 , the current travel direction cannot be southwestern travel direction 826 .
• FIG. 14 is an example of a map 880 depicting a plurality of adjacent geofences 870 , 872 , and 874 which can be used to determine a travel direction. For example, if the current location of the mobile device 300 is within the geofence 870 associated with a location-specific digital story, the travel direction can be determined to be an eastern travel direction 876 if the mobile device has recently been located within geofence 874 , which is just west of geofence 870 .
• the travel direction can be determined to be a western travel direction 878 if the mobile device has very recently been located within geofence 872 , which is just east of geofence 870 .
• the travel direction can be determined to be a western travel direction 878 , since the only possible travel directions are eastern travel direction 876 and western travel direction 878 .
• one of a plurality of possible digital stories is selected based on the travel direction.
• the digital story can be selected responsive to stored user preferences and current user needs.
• the selection is performed using the processor 292 at the service provider 280 , and the selected digital story is transferred to the smart phone 300 over the communication network 250 .
• the selection is performed using the digital processor 320 in smart phone 300 , which selects one of the location-dependent digital stories previously stored in image/data memory 330 or firmware memory 328 .
• the location-dependent digital stories are stored in image/data memory 330 when an app is downloaded from the service provider 280 to the firmware memory 328 , as described earlier in reference to store direction-dependent stories step 850 .
• the direction-dependent digital story selected in step 865 is presented to the user.
• the digital story can be presented to the user using a variety of story-telling methods, such as audio stories, text-based stories, video stories, and augmented-reality stories.
• the user selects a preferred story-telling method from a menu offering a variety of choices, in store user preferences step 855 . For example, if the driver of the vehicle is interested in the digital story, the digital story can be presented using audio narration, sound effects, and music.
• the digital story can be presented using text and images, which can be read and viewed by the passenger without disturbing the driver of the vehicle.
• the smart phone 300 has been presenting general content, such as music, as described earlier in relation to provide general content step 890 , the general content is stopped, muted or paused while the story is presented in present story step 435 , and then automatically resumed after the story is presented.
• the user profile is updated based on the digital story presented to the user, as described earlier in relation to update user profile step 440 of FIG. 4 .
• the user profile can be updated to indicate that the user has been presented with a specific direction-dependent digital story.
• the system 214 determines if the user stopped at the venue, and if the user did stop, the system 214 determines the approximate period of time that the user spent at the venue.
• the GPS receiver 360 in the mobile phone 300 is used in determining if the user stopped at the venue, and the approximate time period of the stop. This can be done, for example, by determining the time period during which the GPS location of the mobile phone 300 was approximately equal to the GPS location of the venue.
• a computer program product can include one or more non-transitory storage mediums, for example; magnetic storage media such as magnetic disk (such as a floppy disk) or magnetic tape; optical storage media such as optical disk, optical tape, or machine readable bar code; solid-state electronic storage devices such as random access memory (RAM), flash EPROM memory, or read-only memory (ROM); or any other physical device or media employed to store a computer program having instructions for controlling one or more computers to practice any of the methods according to any embodiment of the present invention.
• magnetic storage media such as magnetic disk (such as a floppy disk) or magnetic tape
• optical storage media such as optical disk, optical tape, or machine readable bar code
• solid-state electronic storage devices such as random access memory (RAM), flash EPROM memory, or read-only memory (ROM); or any other physical device or media employed to store a computer program having instructions for controlling one or more computers to practice any of the methods according to any embodiment of the present invention.

Landscapes

• Engineering & Computer Science (AREA)
• Computer Networks & Wireless Communication (AREA)
• Signal Processing (AREA)
• Information Transfer Between Computers (AREA)

Abstract

Description

Claims (20)

Priority Applications (2)

Applications Claiming Priority (2)

Related Child Applications (1)

Publications (1)

Family

ID=51569513

Family Applications (2)

Family Applications After (1)

Country Status (1)

Cited By (172)

Families Citing this family (10)

Citations (7)

Family Cites Families (13)

• 2014
  • 2014-03-19 US US14/219,901 patent/US20140287779A1/en not_active Abandoned
• 2016
  • 2016-05-10 US US15/151,448 patent/US10136260B2/en active Active

Patent Citations (7)