CN104850563B - Destination image compare retrieval device, destination image compares searching system and destination image compares search method - Google Patents

The present invention relates to a kind of destination image compare retrieval device, destination image compares search method and destination image compares searching system.The destination image, which compares retrieval device and external storage, has the live-action map database of real scene image data to wirelessly communicate, and includes: input operation part, receives the input of user, and generates the instruction that retrieval is compared in starting；Navigation portion detects destination locations and current location on the electronic map and marks respectively；Control unit controls following portion: shoot part, obtains multiframe and continuously shoots image；Acquisition unit obtains reference picture from the live-action map database；Storage unit stores the shooting image and the reference picture；Comparing section continuously shoots image to the multiframe and reference picture is compared, when the two similarity is higher than preset ratio, it is determined that for the two matching；Display unit, shows the frame shooting image of successful match, and identifies destination on it.

Destination image compares retrieval device, destination image compares searching system and mesh Ground image compare search method

Technical field

The present invention relates to a kind of destination images to compare retrieval device, destination image compares searching system and purpose Ground image compares search method.

Background technique

Navigation feature in the portable equipments such as on-vehicle navigation apparatus or mobile phone now, can be in positioning systems such as GPS systems In electronic map in destination and present position are identified, and provide driving or Walking Route.

But if encountered, road is narrow or have the obstacles such as stair to make vehicle impassable, and vehicle just can only Near arriving at the destination.Alternatively, when user is come near destination by the route that navigation feature provides, and near destination Building stands in great numbers, then due to the limitation of two-dimensional electronic map diagram, can all cause can not find exact destination sometimes is built It builds.

JP2005-221285 provides a kind of side of vehicle is shown on map detail image towards destination direction Case.But image can not be provided according to the practical streetscape state used when navigation, and it can not be clearly by purpose terrestrial reference Knowledge comes out.

Summary of the invention

To solve the above-mentioned problems, inventor of the invention provides one kind and by image compares retrieval to determine with reference to figure Picture, and to user prepare indicative purpose ground scheme.

One aspect of the present invention provides a kind of destination image and compares retrieval device, is stored with real scene image number with external According to live-action map database carry out wireless communication, comprising: input operation part can receive the input of user, and according to The operation at family generates the instruction that retrieval is compared in starting；Navigation portion, on the electronic map according to the destination information of user's input It detects destination locations and current location and marks respectively；Control unit receives opening from the input operation part After the dynamic relatively instruction of retrieval, control following portion: shoot part, the control unit compare retrieval according to the starting and refer to It enables and opens the shoot part, so that the shoot part is by the current location in electronic map towards on the basis of the direction of destination locations It is scanned shooting in neighbouring a certain range, multiframe is obtained and continuously shoots image；Acquisition unit, the control unit make the acquirement Portion is according to the current location from the navigation portion at a distance from destination locations and current location is towards destination locations Direction obtains reference picture from the live-action map database；Storage unit, the control unit make the storage unit store the bat Take the photograph image and the reference picture；Comparing section, the control unit make the comparing section will be from the described more of the storage unit Frame continuously shoots image and reference picture is compared, when the similarity of the shooting image and the reference picture is higher than in advance The ratio first set, it is determined that for the two matching；Display unit, the control unit enable to the display unit show it is described electronically Figure or shooting image, a frame and the reference picture successful match in the shooting image described in the comparing section, the display Portion shows that the frame of successful match shoots image, and identifies destination on it.

Another aspect of the present invention provides a kind of destination image and compares searching system comprising: ustomer premises access equipment and net Network server, the ustomer premises access equipment are carried out wireless communication with network server, which compares searching system and outer The live-action map database for storing real scene image in portion carries out wireless communication, and the ustomer premises access equipment includes: input operation Portion can receive the input of user, and generate the instruction that retrieval is compared in starting depending on the user's operation；Navigation portion, basis The destination information of user's input detects destination locations and current location on the electronic map and is marked；Control Portion controls following portion after receiving the instruction that retrieval is compared in the starting from the input operation part: shooting Portion, the control unit start the shoot part according to described instruction, so that the shoot part is with the current location court in electronic map On the basis of the direction of destination locations near be scanned shooting in a certain range, obtain multiframe and continuously shoot image； Display unit, the control unit enable to the display unit to show the electronic map or shooting image；The network server packet It includes: acquisition unit, according to the current location from the ustomer premises access equipment at a distance from destination locations and the court of current location The direction of destination locations obtains reference picture from the live-action map database；Storage unit, storage come from the user terminal The shooting image and the reference picture of the shoot part shooting of equipment；Comparing section, will be from described in the storage unit Multiframe continuously shoots image and reference picture is compared, when the similarity of the shooting image and the reference picture is higher than When preset ratio, it is determined that for the two matching；Shooting image and the reference picture described in the comparing section With success, the control unit of the ustomer premises access equipment makes the display unit show the shooting image of the successful match, and on it Identify destination.

Another aspect of the present invention provides a kind of destination image and compares search method, comprising: input operating procedure is received and used The input at family, and the instruction that retrieval is compared in starting is generated depending on the user's operation；Navigation step, according to the input of user in electricity Destination locations and current location are detected on sub- map and are marked；Step is shot, inspection is compared according to the starting The instruction of rope by current location towards the direction of destination locations on the basis of near be scanned shooting in a certain range, take It obtains multiframe and continuously shoots image；Obtaining step, according to current location at a distance from destination locations and current location with The direction of destination locations obtains reference picture from the live-action map database；Storing step stores the shooting step The reference picture that the acquired shooting image and the obtaining step obtain；Comparison step, will be from described Multiframe continuously shoots image and reference picture is compared, when the similarity of the shooting image and the reference picture is higher than Preset ratio, it is determined that for the two matching；It shows step, shows the electronic map or shooting image, in the middle institute Shooting image and the reference picture successful match described in comparison step are stated, then shows the shooting image of the successful match, and Destination out is known in the shooting image subscript.

Detailed description of the invention

Fig. 1 is to show that the destination image of first embodiment of the invention compares the composition figure of retrieval device.

Fig. 2 is to show that the destination image of first embodiment of the invention compares the flow chart of search method.

Fig. 3 is an example of electronic map shown by display unit, and current location and destination have been marked in electronic map Position.

Fig. 4 is an example of the shooting image of successful match shown by display unit, in the shooting image of the successful match Destination destination building in other words is marked.

Fig. 5 shows that the destination image of second embodiment of the invention compares the composition figure of searching system.

Specific embodiment

Fig. 1 be show first embodiment of the invention destination image compare retrieval device 100 composition figure.Destination Image compares retrieval device 100 and is wirelessly communicated by network and the external realization of live-action map database 200.Live-action map data Library 200 can be such as GoogleStreetView(Google streetscape) external data base, wherein the detail image number of storage streetscape According to the live-action map database can be the image data base for capableing of real-time update.

It includes following several functional units that destination image, which compares retrieval device 100 mainly: navigation portion 101, input operation Portion 102, control unit 103, shoot part 104, acquisition unit 105, storage unit 106, comparing section 107, display unit 108.Wherein, navigation portion 101 destination informations inputted according to input operation part 102, show electronic map and on the electronic map on display unit 108 Current location and destination locations are marked, and driving or Walking Route from current location to destination locations.Input operation Portion 102 can realize the input of user by screen touch-control or voice input.Navigation portion 101 can be used navigation in the prior art and set It is standby, such as vehicle mounted guidance or Mobile Telephone Gps etc..

After user arrives at the destination nearby according to the navigation in navigation portion 101, if still can not determine specific Which destination is actually, then can generate the instruction that retrieval is compared in starting by input operation part 102.Control unit 103 is connecing After receiving the instruction that retrieval is compared in the starting, start shoot part 104, so that the shoot part is with the current location in electronic map Shooting is scanned near on the basis of towards the direction of destination locations in a certain range, obtains the continuous shooting figure of multiframe Picture.The continuity degree that the multiframe continuously shoots image can be set as needed, such as 10 frame per second.So-called current location court Destination locations direction can by user by observe electronic map judge, be also possible to be detected according to navigation portion Obtained current location is towards the direction of destination locations.The so-called current location in electronic map is towards the side of destination locations A certain range can be as shown in figure 3, refer to the direction for determining current location in electronic map towards destination near on the basis of Afterwards, a certain range nearby determined at left and right sides of it, it is a certain range of the reason is that in order to enable the choosing of coverage to select this It selects and is unlikely to excessively wide in range with certain Objective, but also there is certain amplitude to be unlikely to excessively narrow.Certainly this one Even determine range be also towards even 360 ° of the range of 180 ° on the basis of the direction of destination locations by current location can be with , the frame number for the shooting image that only such scanning shoot obtains is more, correspondingly requires higher processing capacity.

The shooting head of portable unit such as mobile phone can also be used in shoot part 104 using vehicle-mounted shooting head.Pass through shoot part The multiframe shooting image of 104 shootings is stored in storage unit 106 for comparison later.

Meanwhile control unit 103 is after receiving the starting and comparing the instruction of retrieval, according to carrying out working as auto-navigation portion 101 Front position is at a distance from destination locations and current location is towards the direction of destination locations, so that acquisition unit 105 is from described Live-action map database 200 obtains reference picture.Theoretically, according to current location at a distance from destination locations and present bit It is unique for setting towards reference picture acquired by the two parameters of the direction of destination locations.But actual conditions are, due to The difference (such as Various Seasonal, different period among one day) for the period that reference picture itself obtains, the reference picture Itself have some differences, such as shooting when the image that is blocked to building of summer wooded and withered winter trees Image be different, such as image captured by dusk and high noon also can be different.In addition, due to live-action map database 200 The maintenance and operating condition of itself, image update situation is also different, such as can be shared etc. by the data cloud of online friend Mode real-time update, consequently, it is possible to storing the image data at a large amount of same visual angles.Therefore, reference picture also can be for one It is multiple.

Then, continuous to the multiframe from the storage unit by comparing section 107 according to the control of control unit 103 Shooting image and reference picture be compared, when shooting image and reference picture similarity be higher than preset ratio, then It is determined as the two matching.Various manner of comparison in the prior art can be used as the method for specific image comparison, such as take turns Wide manner of comparison, binary conversion treatment manner of comparison, division block manner of comparison etc., this will not be detailed here.When comparing section 107 is looked for To when being higher than preset ratio (such as 90% similarity) with the similarity of reference picture, control unit 103 makes display unit 108 show the shooting image of the successful match, and according to the cartographic information in live-action map database on frame shooting image Mark destination, such as destination gone out with thick circle, or in different colors or bloom show destination, as long as be convenient for user It identifies and finds destination accordingly.As shown in figure 4, in figure 1300 indicate successful match shooting image, 1301 indicate quilts The destination (or destination building) marked.If comparing section 107 does not find to be higher than with the similarity of reference picture and set in advance The shooting image of fixed ratio can also then show similar " no matching image " such prompt by display unit 108.In addition, also Matching result (successful match or without matching) can be notified by auditory tone cues portion 109.Certainly, auditory tone cues portion 109 is optional Ground is configured, and can also be omitted.

In addition, when comparing section 107 does not find the shooting image with the similarity of reference picture higher than preset ratio, Also the scanning shoot range of shoot part 104 can be made to expand by control unit 103, and re-shoot.Then by comparing portion 107 Compare once again.

Fig. 2 is the flow chart for showing the destination image search method of first embodiment of the invention.

In step S201, according to the destination information that user inputs, shows electronic map and mark purpose status on it It sets and current location, that is, the movement that navigation portion is carried out.In step S202, starting is generated depending on the user's operation and is compared The instruction of retrieval.Then, in step S203, the instruction of retrieval is compared according to above-mentioned starting, by the shoot parts such as camera into Row scanning shoot, the range of scanning shoot can be using the current location in electronic map towards the direction of destination locations as base A certain range near standard continuously shoots image thus to obtain multiframe, at the same according to current location and destination locations away from From and current location towards the direction of destination locations from live-action map database obtain reference picture, and store above-mentioned shooting figure Picture and reference picture.

Then, step S204 is entered, image comparison is carried out to shooting image and reference picture.

Then judge that whether shoot image and reference picture matches, and can usually preset a ratio threshold in step S205 Value then determines that the two matches when shooting image is greater than the proportion threshold value with the similarity of reference picture, enters step S206, i.e., It shows the frame and the matched shooting image of reference picture, and on it marks destination.If step S205 judges shooting figure As being mismatched with reference picture, then in step S207, by unmatched result notice to user.

Above destination image, which compares retrieval device and corresponding destination image search method, can carry out according to practical feelings Variation is made in condition and requirement, and several change case are given below.

Change case 1

Multiframe captured by shoot part 104, which continuously shoots image, can respectively contain such as shooting time, shooting direction Deng image information, such as the image for shooting and storing with Exif format.In this way, 107 pairs of shooting images of comparing section with reference to figure As when being compared, first comparing the shooting direction of shooting image and the shooting direction of reference picture, when the two is consistent, then compare The content of the image of reference picture and shooting image itself.The processing time of comparing section 107 can be saved in this way.Above-mentioned shooting The shooting direction of image and the shooting direction of reference picture it is consistent both refer to it is substantially the same, that is, the error both allowed exists In predetermined angular range.The predetermined angular range can be set as needed, when the consistency to shooting direction It is required that the angular range is set as smaller when high.Such as the angular range may be configured as 1 °.

Change case 2

As described above, control unit can compare the instruction of retrieval by the starting that input operation part generates to make according to user It obtains other each portions' startings and compares retrieval.But it alternatively, can also be by navigation portion 101 to current location and destination locations The detection of distance when above-mentioned current location is less than predetermined distance at a distance from destination locations, such as at 200 meters, that is, shows to use When family is had come near destination, prompting the user with control unit 103 by display unit 108 or auditory tone cues portion 109 etc. is It is no to need to issue the instruction that retrieval is compared in starting.User can generate starting to input operation part 102 according to the prompt and compare retrieval Instruction.

Change case 3

As noted previously, as acquisition unit 105 is according to current location at a distance from destination locations and current location is towards mesh The reference picture that is obtained from live-action map database of direction of position may be one or more.When reference picture is more When a, compared with comparing section 107 carries out one by one multiple reference pictures with shooting image.In addition, alternatively, can also first determine Then best reference picture is compared by best reference picture with shooting image again.The selection of best reference picture can basis Different situations are carried out with different standards.For example, the multiframe as captured by shoot part 104 continuously shoot image can be respective Including, for example, the image information of shooting time, shooting direction etc., therefore can be according to the shooting time of shooting image from multiple ginsengs It examines and selects best reference picture in image.For example, if being selected, being drawn according to 1 year season difference with season section Then sectional, such as be divided into four season sections of spring, summer, autumn and winter compares the shooting time of shooting image and multiple with reference to figure Season section locating for the acquirement time of which of picture is identical or closest, then comparing section 107 is identical by the season section Or immediate reference picture is as best reference picture.Or to divide time section at the time of one, such as divide For 07:00~11:00,11:00~13:00,13:00~18:00,18:00~next day 07:00 this four time sections, work as institute The shooting time for stating shooting image is identical as time section locating for the acquirement time of one in multiple reference pictures or most connect Closely, then the comparing section 107 using the reference picture as best reference picture.Certain above two selection mode can also be tied mutually It closes and uses, to select best reference picture.The divisions of various time sections and combination are there are also very much, different an example herein It lifts.

Change case 4

It as described in above-mentioned change case 3, in the case that reference picture is multiple, can be divided by time section, with selection Best reference picture.But the best reference picture chosen in this way may also be multiple, such as in same season section, If being stored with multiple reference pictures in live-action map database, it can all be chosen as best reference picture.At this point it is possible to Further in more multiple best reference pictures obtain the time and shoot image shooting time it is immediate that, as Final reference image.

It is that the purpose of the present invention image compares retrieval device and its adoptable various change of corresponding method above Example, those skilled in the art can carry out various modifications in optimum range, combination to it.

In addition, the destination image of first embodiment of the invention compare retrieval device in actual implementation, do not need for Completely new device, each function part therein is available or is equipped in existing various equipment.Such as navigation portion, shooting Portion, display unit can utilize mobile unit or navigation portion and shoot part on portable equipment such as smart phone, other each function parts Also it is equipped on existing mobile unit or portable equipment.

Fig. 5 shows that the destination image of second embodiment of the invention compares the composition figure of searching system.

Destination image in second embodiment compares searching system compared with the destination image of first embodiment The difference of retrieval device is, the public server in the configuration of some of which function part on network.This have the advantage that, The workload for needing the comparing section of higher position reason ability can be placed on the higher server of process performance, thus can be reduced The workload of ustomer premises access equipment (such as portable telephone, mobile unit etc.) improves integral retrieval speed.Therefore in addition to function part is matched Seated position is different, and the working principle of other each function parts is identical with first embodiment.In the following, comparing inspection to the destination image Cable system carries out simple illustration.

As shown in figure 5, it includes ustomer premises access equipment 31 and network server 32 that destination image, which compares searching system 300, it is somebody's turn to do Destination image compares searching system 300 and carries out wireless communication with live-action map database 400.Wherein, 31 He of ustomer premises access equipment Network server 32 also carries out wireless communication.Live-action map database 400 can be such as GoogleStreetView(Google street Scape) etc. external data bases, wherein storage streetscape detail image data

Ustomer premises access equipment 31 includes: input operation part 311, control unit 312, navigation portion 313, shoot part 314, display unit 315.Network server 32 includes: storage unit 321, acquisition unit 322, comparing section 323.Ustomer premises access equipment 31 and network server 32 The corresponding first embodiment of movement that carries out of each function part in destination image compare each function in retrieval device 100 Portion.

In addition, each portion in ustomer premises access equipment 31 can be also arranged respectively in mobile unit or intelligent portable objects or benefit With the existing function part in mobile unit or intelligent and portable equipment.

Above several embodiments of the invention are described, but these embodiments are only used as an example, and Without the intention for limiting invention scope.These embodiments can be implemented by other various forms, lead without departing from invention Various omissions, displacement, change are carried out in the range of purport.These embodiments and its deformation are included in invention scope and master While in purport, it is also contained in the invention recorded in claims and the range impartial with it.