CN112509039A - Bottled liquid level detection method and system and storage medium - Google Patents

The application discloses a method, a system and a storage medium for detecting the liquid level of bottled liquid, wherein the method comprises the steps of collecting an image to be detected, acquiring a template image and a measuring rectangle; searching and matching the image to be detected by using the template image to obtain a template matching object; acquiring a center coordinate of a template matching object; moving the measuring rectangle according to the central coordinate; performing edge detection on the liquid level image in the measuring rectangle to obtain the liquid level edge of the liquid level image; and calculating the liquid level of the bottled liquid according to the liquid level edge. Compared with the existing liquid level detection method, the liquid level detection method has the advantages that template matching and rectangular measurement matching are adopted, extraction of a single target in the multi-target image to be detected is achieved, and detection efficiency of liquid level detection of the bottled liquid is improved. The application can be widely applied to the technical field of machine vision.

Bottled liquid level detection method and system and storage medium

Technical Field

The application relates to the technical field of machine vision, in particular to a method, a system and a storage medium for detecting the liquid level of bottled liquid.

Background

Various problems can occur in the production process of bottled liquid such as bottled water, beverage, beer and the like, so that the liquid level in the bottled liquid can not reach the factory standard. At present, most factories adopt a manual detection method for detection, manual detection of the liquid level of bottled liquid not only consumes labor time, but also cannot ensure the reliability of detection. A few factories adopt the mode of image detection to carry out the detection of bottled liquid level, but the mode through image detection can only detect a bottled liquid once, leads to liquid level detection's efficiency to be lower.

Disclosure of Invention

In view of the above, an object of the present application is to provide a method, a system and a storage medium for detecting a liquid level of a bottled liquid, so as to improve detection efficiency of detecting the liquid level of the bottled liquid.

The first technical scheme adopted by the application is as follows:

a method for detecting the liquid level of bottled liquid comprises the following steps:

acquiring an image to be measured, and acquiring a template image and a measuring rectangle;

searching and matching the to-be-detected image by using the template image to obtain a template matching object;

acquiring a central coordinate of the template matching object, wherein the central coordinate is an abscissa and an ordinate of the center of the template matching object in the image to be detected;

moving the measuring rectangle according to the central coordinates;

performing edge detection on the liquid level image in the measuring rectangle to obtain the liquid level edge of the liquid level image;

calculating the liquid level of the bottled liquid according to the liquid level edge;

wherein the template image is a pre-created template image of the bottled liquid from which the measurement rectangle was created.

Further, the method for detecting the liquid level of the bottled liquid further comprises the following steps:

calculating the liquid level error of the bottled liquid, wherein the liquid level error is the absolute value of the difference value of the liquid level of the bottled liquid and the standard liquid level;

and determining that the liquid level error is smaller than a set error, and marking the bottled liquid as a qualified product.

Further, the step of moving the measurement rectangle according to the center coordinates includes:

calculating the row spacing of the bottled liquid according to the ordinate;

and moving the measuring rectangle according to the line spacing.

Further, the step of performing search matching using the template image in the image to be detected to obtain a template matching object includes:

zooming the image to be detected to obtain a zoomed image to be detected;

and searching and matching the zoomed image to be detected by using the template image to obtain a template matching object.

Further, the step of performing search matching using the template image in the image to be detected to obtain a template matching object includes:

searching and matching the to-be-screened image by using the template image to obtain a template matching object to be screened;

calculating the similarity between the template matching object to be screened and the template image;

and determining that the similarity is greater than a similarity threshold value, and taking the template matching object to be screened as a template matching object.

Further, the measuring rectangle is located inside the bottled liquid after moving.

Further, the template image is a bottleneck template image.

The second technical scheme adopted by the application is as follows:

a bottled liquid level detection system, comprising:

the acquisition module is used for acquiring an image to be measured, and acquiring a template image and a measurement rectangle;

the matching module is used for searching and matching the to-be-detected image by using the template image to obtain a template matching object;

the coordinate module is used for acquiring the central coordinate of the template matching object, wherein the central coordinate is the abscissa and the ordinate of the center of the template matching object in the image to be detected;

the moving module is used for moving the measuring rectangle according to the central coordinate;

the detection module is used for carrying out edge detection on the liquid level image in the measurement rectangle to obtain the liquid level edge of the liquid level image;

the calculation module is used for calculating the liquid level of the bottled liquid according to the liquid level edge;

wherein the template image is a pre-created template image of the bottled liquid from which the measurement rectangle was created.

The third technical scheme adopted by the application is as follows:

a bottled liquid level detection system, comprising:

at least one processor;

at least one memory for storing at least one program;

when the at least one program is executed by the at least one processor, the at least one processor is caused to implement the bottled liquid level detection method.

The fourth technical scheme adopted by the application is as follows:

a computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, implements the bottled liquid level detection method.

The method and the device for detecting the liquid level of the bottled liquid have the advantages that the template image is used for matching the template matching object in the image to be detected, meanwhile, the measuring rectangle is adopted to move according to the center coordinate of the template matching object in the image to be detected to extract the liquid level image, edge detection is carried out on the liquid level image to extract the liquid level edge, and finally the liquid level of the bottled liquid is obtained through calculation. Compared with the existing liquid level detection method, the method has the advantages that the template image and the measuring rectangle are matched, extraction of a single target in the multi-target image to be detected is achieved, and the detection efficiency of the liquid level detection of the bottled liquid is improved.

Drawings

Fig. 1 is a flowchart of a method for detecting a liquid level of a bottled liquid according to an embodiment of the present disclosure.

Detailed Description

The conception, specific structure and technical effects of the present application will be described clearly and completely with reference to the following embodiments and the accompanying drawings, so that the purpose, scheme and effects of the present application can be fully understood.

The present application will now be described in further detail with reference to the accompanying drawings and specific examples. The step numbers in the following embodiments are provided only for convenience of illustration, the order between the steps is not limited at all, and the execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art. Further, for several described in the following embodiments, it is denoted as at least one.

It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature or indirectly fixed or connected to the other feature. Furthermore, the descriptions of upper, lower, left, right, etc. used in the present disclosure are only relative to the mutual positional relationship of the constituent parts of the present disclosure in the drawings. As used in this disclosure, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and/or" includes any combination of one or more of the associated listed items.

With the continuous development of socioeconomic, the package of transparent bottled liquid is applied more and more, and the liquid level detection is a necessary inspection step in the production and packaging process. At present, manual visual inspection methods are still used in many domestic production lines, along with the expansion of production scale and the continuous improvement of technical level, the trend of industrial development is achieved by replacing manual work with machines for intelligent production detection, but at present, the liquid level of bottled liquid can only be detected for one time, and the efficiency of bottled liquid detection is low.

As shown in fig. 1, an embodiment of the present application provides a method for detecting a liquid level of a bottled liquid, including:

s100, collecting an image to be measured, and acquiring a template image and a measurement rectangle;

s200, searching and matching the to-be-detected image by using the template image to obtain a template matching object;

s300, obtaining the center coordinate of the template matching object;

s400, moving the measuring rectangle according to the central coordinate;

s500, performing edge detection on the liquid level image in the measuring rectangle to obtain the liquid level edge of the liquid level image;

s600, calculating the liquid level of the bottled liquid according to the liquid level edge;

in the process of detecting the liquid level of the bottled liquid, a template image and a measuring rectangle need to be created in advance, wherein the template image is a part or all image of the single bottled liquid to be detected, the template image is used for obtaining a template matching image in the image to be detected in a matching mode so as to determine the position of the single bottled liquid, and the template image can be created by shooting the image of the bottled liquid to be detected and cutting the image; the measuring rectangle is used for extracting a liquid level image of a single bottled liquid, and the measuring rectangle is adjusted according to the size of the bottled liquid to be measured, for example: the width of the measuring rectangle is set to 1/4 of the bottom of the liquid to be measured, and the height of the measuring rectangle is set to 2/3 of the distance from the bottom of the liquid to be measured to the bottle neck. The determination of the position of single bottled liquid can be realized through the template image, and the extraction of the bottled liquid level image is realized by using the measuring rectangle.

After the template image and the measurement rectangle are created, an industrial camera can be used to acquire an image of the bottled liquid on the production line, i.e., an image to be measured. Each image to be detected comprises a plurality of bottled liquid to be detected, in order to ensure that the image formation of the bottled liquid to be detected is clear, namely the contour of the water line in the bottled liquid is clear, the number of the bottled liquid to be detected in each image needs to be controlled, for example, in specific detection, the number of the bottled liquid to be detected is limited to be below 10, and the image formation can be ensured to be clear. And after obtaining the image to be detected, performing global search matching in the image to be detected by using a pre-established template image, wherein the obtained matching result is the template matching object. The center coordinates of the template matching object can reflect the coordinates of the bottled liquid to be detected to a certain degree, so that the measuring rectangle can be moved according to the center coordinates of the template matching object, namely the abscissa and the ordinate of the center of the template matching object, the measuring rectangle is moved to the position of the liquid level image, and the liquid level image is intercepted. After the liquid level image is obtained, edge detection can be carried out on the liquid level image to obtain a liquid level edge, namely a liquid level line, and the liquid level height of the bottled liquid can be obtained through deduction and calculation according to the liquid level line.

In the process of edge detection, a measurement mode of single-edge measurement can be adopted, and the single-edge measurement mode is to output the result of each detected edge of the measurement rectangle. The edge type selects all types of edges to measure, namely, the edges of positive and negative are measured. positive represents finding all positive edges, i.e. the edges that change from black to white transition in the finding direction; negative represents finding all negative edges, i.e. the edges that transition from white to black in the direction of the finding.

In the process of moving the measuring rectangle, the measuring rectangle can be moved according to the obtained abscissa and ordinate of the bottled liquid to be measured, for example, when the whole bottled liquid image is selected as the template object, the obtained center coordinate is the center coordinate of the area where the bottled liquid is located, at this time, the abscissa of the center of the measuring rectangle can be moved to the abscissa of the template matching object, and the ordinate of the measuring rectangle is moved to the corresponding position of the template matching object according to the position of the preset measuring rectangle in the template image, for example: the set measuring rectangle is located 2/3 from the bottom of the bottle to the neck of the bottle, and the ordinate of the measuring rectangle is moved to the corresponding position of the template matching object.

After calculating the liquid level of the single bottled liquid, whether the bottled liquid is qualified or not can be judged according to the liquid level of the bottled liquid. In some embodiments, a liquid level error is also calculated based on the liquid level of the bottled liquid and a set standard liquid level, and the liquid level error is a difference between the measured liquid level and the standard liquid level, i.e., an absolute value of the difference between the liquid level of the bottled liquid and the standard liquid level. Whether bottled liquid is qualified products or not can be judged according to the liquid level error, and the bottled liquid is marked as qualified products only when the liquid level error is smaller than a set error.

In the process of moving the measuring rectangle, the measuring rectangle can be moved according to the vertical coordinate of the template matching object, namely, the difference value of the vertical coordinates of the template matching objects in different rows is the value of the movement of the measuring rectangle on the vertical coordinate; similarly, the measurement rectangle may be moved according to the abscissa of the template matching object, that is, the abscissa difference value of the template matching objects in different columns is the value of the movement of the measurement rectangle on the abscissa.

In some embodiments, the image to be detected is zoomed first, then the zoomed image to be detected is matched with the template image, so as to obtain the position of the template matching object in the image to be detected, and after the position of the template matching object in the image to be detected is obtained, the zoomed image to be detected is amplified and restored, so as to facilitate subsequent steps. Compared with the mode that the images to be detected with the original proportion are directly used for matching, the zoomed images to be detected are used for matching, so that the matching speed of the template matching object can be increased, and the efficiency of liquid level measurement of the bottled liquid is improved.

In the template image matching process, a matching error may occur, and the matching error may cause an erroneous template matching object, thereby causing an error in subsequent liquid level calculation. Therefore, in some embodiments, in order to improve the accuracy of template image matching, after an unscreened template matching object is obtained by matching, the similarity between the unscreened template matching object and the template image is calculated, only when the similarity is greater than a set similarity threshold, the unscreened template matching object is used as the template matching object, and the unscreened template matching image is screened by setting the similarity threshold, so that the accuracy of template image matching can be improved, and the accuracy of bottled liquid level measurement can be improved.

In the edge identification process of the liquid level image, a large amount of noise signals are always accompanied, so that the detection difficulty of the edge detection of the liquid level image is increased. In some embodiments, in order to reduce the noise signal of the liquid level image, the size of the measurement rectangle may be limited, and the measurement rectangle may be limited to the bottled liquid to be measured, so that the obtained liquid level image is also limited to the bottled liquid to be measured, and thus the liquid level image does not include the contour information of the bottled liquid, and only the edge information of the water level line is identified when the edge identification is performed, and the contour information of the bottled liquid is not identified. Through injecing the liquid level image in the bottled liquid that awaits measuring, reduced the degree of difficulty of carrying out edge identification to the liquid level image.

In the process of template image matching, if the whole bottled liquid is used as a template image, the characteristics of the whole bottled liquid need to be extracted, but the difference between certain characteristics in the bottled liquid and the background is small, so that the matching error is easy to occur in the matching process. Therefore, in some embodiments, the bottle opening template image is used as the template image, the bottle opening is the most specific part in the bottled liquid, and the difference between the bottle opening template image and the background is larger, compared with the bottle liquid template image, the bottle opening template image has larger difference between the bottle opening template image and the background and fewer features, and the accuracy of template image matching is improved while the template image matching efficiency is improved by using the bottle opening template image as the template image.

The embodiment of the present application further provides a bottled liquid level detection system, include:

the acquisition module is used for acquiring an image to be measured, and acquiring a template image and a measurement rectangle;

the matching module is used for searching and matching the to-be-detected image by using the template image to obtain a template matching object;

the coordinate module is used for acquiring the central coordinate of the template matching object, wherein the central coordinate is the abscissa and the ordinate of the center of the template matching object in the image to be detected;

the moving module is used for moving the measuring rectangle according to the central coordinate;

the detection module is used for carrying out edge detection on the liquid level image in the measurement rectangle to obtain the liquid level edge of the liquid level image;

the calculation module is used for calculating the liquid level of the bottled liquid according to the liquid level edge;

wherein the template image is a pre-created template image of the bottled liquid from which the measurement rectangle was created.

The contents in the above method embodiments are all applicable to the present system embodiment, the functions specifically implemented by the present system embodiment are the same as those in the above method embodiment, and the beneficial effects achieved by the present system embodiment are also the same as those achieved by the above method embodiment.

The embodiment of the present application further provides a bottled liquid level detection system, include:

at least one processor;

at least one memory for storing at least one program;

when the at least one program is executed by the at least one processor, the at least one processor is caused to implement the bottled liquid level detection method.

The embodiment of the present application further provides a storage medium, in which processor-executable instructions are stored, and when the processor-executable instructions are executed by a processor, the processor-executable instructions are configured to perform the steps of the method for processing mutual information according to any one of the above-mentioned method embodiments. For the storage medium, it may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. It can be seen that the contents in the foregoing method embodiments are all applicable to this storage medium embodiment, the functions specifically implemented by this storage medium embodiment are the same as those in the foregoing method embodiments, and the advantageous effects achieved by this storage medium embodiment are also the same as those achieved by the foregoing method embodiments.

It should be appreciated that the layers, modules, units, platforms, and/or the like included in an embodiment system of the application may be implemented or embodied by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer readable memory. The methods may be implemented in a computer program using standard programming techniques, including a non-transitory computer-readable storage medium configured with the computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner, according to the methods and figures described in the detailed description. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.

Moreover, the data processing flows performed by the layers, modules, units, and/or platforms included in the system embodiments of the present application may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The data processing flows correspondingly performed by the layers, modules, units and/or platforms included in the system of embodiments of the present application may be performed under the control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) collectively executed on one or more processors, by hardware, or a combination thereof. The computer program includes a plurality of instructions executable by one or more processors.

Further, the system may be implemented in any type of computing platform operatively connected to a suitable connection, including but not limited to a personal computer, mini computer, mainframe, workstation, networked or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and the like. The data processing flows correspondingly executed by the layers, modules, units and/or platforms included in the system of the present application may be implemented in machine readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, an optical read and/or write storage medium, a RAM, a ROM, etc., so that it may be read by a programmable computer, and when the storage medium or device is read by a computer, may be used to configure and operate the computer to perform the processes described herein. Further, the machine-readable code, or portions thereof, may be transmitted over a wired or wireless network. The invention described herein includes these and other different types of non-transitory computer-readable storage media when such media include instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. The present application also includes the computer itself when programmed according to the methods and techniques described herein.

The above description is only a preferred embodiment of the present application, and the present application is not limited to the above embodiment, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present application should be included in the protection scope of the present application as long as the technical effects of the present application are achieved by the same means. Various modifications and variations of the technical solution and/or embodiments thereof are possible within the protective scope of the present application.