CN103268567A - Efficient large-scale event detection and processing method for manufacturing industry management system - Google Patents

The invention provides a manufacturing management system-oriented high-efficiency large-scale event detection and handling method. An event triggering way comprises multiple modes including detection message-based event triggering, detection equipment parameter-based event triggering and the like. Events are handled according to specified logics after being triggered, and the handling results of the events are issued to event subscription ends. According to the manufacturing management system-oriented high-efficiency large-scale event detection and handling method provided by the invention, by adopting the distributed software technology, event detection and handling modules are deployed by multiple nodes; all nodes bear different event handling tasks, and thus, loads of all the nodes can be effectively balanced, the real-time and high-efficiency detection and handling of large-scale concurrent events are realized, and the events are ensured to be at a millisecond level from production to response, so that a production manager knows the information of alarm, a material status and an equipment status during production in time, the production efficiency is effectively improved, and the production cost is reduced.

面向制造行业管理系统的高效大规模事件侦测与处理方法Efficient large-scale event detection and processing method for manufacturing industry management system

技术领域technical field

本发明涉及制造行业的管理软件系统领域，采用计算机分布式技术，特别涉及一种高效、大规模的并发事件侦测与处理方法。The invention relates to the field of management software systems in the manufacturing industry, adopts computer distributed technology, and particularly relates to an efficient and large-scale concurrent event detection and processing method.

背景技术Background technique

目前，在制造行业生产过程中，制品数量巨大，且需要进行严格的批次、过程跟踪管理，整个生产线的活动（可抽象为一系列事件）具有较高的并发密度和逻辑复杂度。这就要求系统具有高效的事件侦测和处理能力。At present, in the production process of the manufacturing industry, the number of products is huge, and strict batch and process tracking management is required. The activities of the entire production line (which can be abstracted into a series of events) have high concurrency density and logic complexity. This requires the system to have efficient event detection and processing capabilities.

在传统的方法中，事件的侦测与处理作为一个操作逻辑，顺序进行处理，会造成事件的阻塞，影响了系统的实时性。In the traditional method, the detection and processing of events is regarded as an operation logic, which is processed sequentially, which will cause blocking of events and affect the real-time performance of the system.

发明内容Contents of the invention

针对制造行业管理系统中事件的侦测与处理实时性不强、顺序处理造成的处理速度慢等问题，本发明提出了一种采用多线程并发侦测事件，以异步委托的方式并行处理已触发的事件的大规模事件侦测与处理方法。Aiming at the problems that the detection and processing of events in the management system of the manufacturing industry is not real-time, and the processing speed caused by sequential processing is slow, the present invention proposes a method that uses multi-threaded concurrent detection of events and processes triggered events in parallel in the form of asynchronous delegation. A large-scale event detection and processing method for events.

本发明为实现上述目的所采用的技术方案是：一种面向制造行业管理系统的大规模事件侦测与处理方法，包括以下步骤：The technical solution adopted by the present invention to achieve the above object is: a large-scale event detection and processing method for manufacturing industry management systems, including the following steps:

将生产活动抽象为若干生产事件，每个生产事件由一个侦测线程负责侦测，所述侦测线程具有不同的周期和与其对应生产事件相关联的参数属性；The production activities are abstracted into several production events, each production event is detected by a detection thread, and the detection thread has different cycles and parameter attributes associated with its corresponding production event;

当侦测的生产事件满足事件触发条件时，侦测线程以异步委托的方式将生产事件委托给事件处理线程进行处理，并维护与客户端的连接通道，所述侦测的生产事件由客户端订阅或发送消息来启动触发进程；When the detected production event satisfies the event triggering condition, the detection thread entrusts the production event to the event processing thread for processing in the form of asynchronous delegation, and maintains the connection channel with the client. The detected production event is subscribed by the client or send a message to start the triggering process;

按照指定的逻辑对生产事件进行处理，将生产事件处理结果通过已维护的对应连接通道通知客户端。Process the production event according to the specified logic, and notify the client of the production event processing result through the corresponding connection channel that has been maintained.

所述客户端订阅的生产事件保存到客户端的事件处理记录表中。The production events subscribed by the client are saved in the event processing record table of the client.

所述事件处理记录表中的生产事件分为四类：侦测中、待处理、处理中、处理完毕，在系统启动时搜索处于待处理和处理中的生产事件，并进行相应的处理。The production events in the event processing record table are divided into four categories: detecting, pending, processing, and processed. When the system is started, the production events pending and processing are searched for and processed accordingly.

所述事件处理记录表在更新时先缓冲到内存中，再由内存定期写入到服务器的数据库中。When the event processing record table is updated, it is first buffered into the memory, and then periodically written into the database of the server by the memory.

所述事件的处理由服务器集群中的多个服务节点承担，每个服务节点承担不同的生产事件处理任务。The event processing is undertaken by multiple service nodes in the server cluster, and each service node undertakes different production event processing tasks.

本发明具有以下优点：在本方法中将事件侦测和处理分割成两个处理单元，事件的侦测与处理互不干扰，从而增强了系统的性能。采用多线程侦测事件，事件触发以后利用异步委托技术进行事件处理，以回调的方式通知生产管理者，事件从产生到发送到订阅者控制在毫秒级，从而提高事件的侦测规模与处理效率，能够进行大规模、并发事件侦测与处理，有效提高生产效率；采用本方法侦测事件以后，可替换现有的人工监测方式，从而降低了生产成本。The invention has the following advantages: In the method, the event detection and processing are divided into two processing units, and the event detection and processing do not interfere with each other, thereby enhancing the performance of the system. Multi-threaded detection is used to detect events. After the event is triggered, the asynchronous delegation technology is used to process the event, and the production manager is notified in the form of a callback. The event is controlled at the millisecond level from generation to sending to the subscriber, thereby improving the detection scale and processing efficiency of the event. , can carry out large-scale, concurrent event detection and processing, and effectively improve production efficiency; after using this method to detect events, the existing manual monitoring method can be replaced, thereby reducing production costs.

附图说明Description of drawings

图1为本发明应用的系统框架图；Fig. 1 is a system frame diagram of the application of the present invention;

图2为每个服务节点的事件处理流程图。Figure 2 is a flow chart of event processing for each service node.

具体实施方式Detailed ways

下面结合附图及实施例对本发明做进一步的详细说明。The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

图1示出了本发明应用的系统框架图，系统由服务端和客户端组成，客户端通过网络和服务端通信。Fig. 1 shows a system frame diagram of the application of the present invention. The system is composed of a server and a client, and the client communicates with the server through a network.

服务端对客户端是透明的，客户端向服务端订阅事件，根据需要将事件消息发送到服务端。服务端处理已触发的事件，事件被处理完之后以回调的方式将处理结果返回给客户端。系统采用面向服务的架构（SOA-service orientedarchitecture），服务端为多节点构成的服务器群集系统。在群集内，各服务节点运行事件侦测与处理程序，每个服务节点承担不同的事件侦测与处理任务。客户端通过WCF（Windows Communication Foundation）技术向服务端订阅事件，服务端会维护这个WCF通道连接。客户端将事件消息发送到服务端某个服务节点，该服务节点将此条消息转发到群集内的所有服务节点。此消息事件会被承担该事件任务的服务节点处理，然后将处理结果通过WCF回调给客户端。本发明能有效运用于制造行业生产过程中大规模事件的侦测与处理系统中。The server is transparent to the client, and the client subscribes to events from the server, and sends event messages to the server as needed. The server processes the triggered event, and returns the processing result to the client in the form of a callback after the event is processed. The system adopts a service-oriented architecture (SOA-service oriented architecture), and the server is a server cluster system composed of multiple nodes. In the cluster, each service node runs an event detection and processing program, and each service node undertakes different event detection and processing tasks. The client subscribes events to the server through WCF (Windows Communication Foundation) technology, and the server will maintain the WCF channel connection. The client sends the event message to a service node on the server side, and the service node forwards the message to all service nodes in the cluster. This message event will be processed by the service node responsible for the event task, and then the processing result will be called back to the client through WCF. The invention can be effectively used in the detection and processing system of large-scale events in the production process of the manufacturing industry.

图2所示为每个服务节点的事件处理流程图。客户端与服务端的交互过程以及每个服务节点的执行流程如下：Figure 2 shows the event processing flow chart of each service node. The interaction process between the client and the server and the execution process of each service node are as follows:

生产管理者可通过客户端自由订阅或取消订阅其所关注的事件，事件侦测与处理模块会维护一个事件订阅列表，及时添加新的订阅者，移除取消的订阅者；事件侦测与处理模块将事件的处理状态分为四类：侦测中、待处理、处理中、处理完毕。事件侦测与处理模块可能由于计算机断电等原因，未能正常处理某些已经触发的事件。因此，在事件侦测与处理模块启动时需检查事件处理记录表，将那些处于待处理或处理中的事件重新处理，正常处理后将状态更新为处理完毕。事件侦测与处理模块启动后，按照与事件关联的参数属性，启动不同周期的事件侦测线程，每个线程负责侦测不同的事件任务。当侦测的事件参数满足事件触发条件时，侦测线程会以异步委托的方式将事件的处理委托到事件处理线程。利用委托的异步处理特性，实现了大规模、并发事件的处理。生产管理者也可通过发送消息触发事件，事件的处理过程及回调过程与基于侦测参数触发的事件处理过程相同。Production managers can freely subscribe or unsubscribe the events they care about through the client. The event detection and processing module will maintain an event subscription list, add new subscribers in time, and remove canceled subscribers; event detection and processing The module divides the event processing status into four categories: detecting, pending, processing, and processing completed. The event detection and processing module may fail to process certain triggered events normally due to reasons such as power failure of the computer. Therefore, when the event detection and processing module is started, it is necessary to check the event processing record table, reprocess those events that are pending or being processed, and update the status to processed after normal processing. After the event detection and processing module is started, according to the parameter attributes associated with the event, different cycle event detection threads are started, and each thread is responsible for detecting different event tasks. When the detected event parameters meet the event triggering conditions, the detection thread will delegate the processing of the event to the event processing thread in the form of asynchronous delegation. Using the asynchronous processing feature of delegation, it realizes the processing of large-scale and concurrent events. The production manager can also trigger an event by sending a message. The event processing process and callback process are the same as the event processing process triggered based on detection parameters.

生产管理者订阅事件后，事件侦测与处理模块会维护与订阅者之间的连接通道，当产生某个事件后通过此通道回调订阅者。After the production manager subscribes to the event, the event detection and processing module will maintain the connection channel with the subscriber, and call back the subscriber through this channel when an event is generated.

事件的侦测、事件的处理以及回调订阅者是并发执行的。Event detection, event processing, and callback subscribers are executed concurrently.

事件侦测与处理模块启动时检查事件处理记录表，重新处理之前未能正确处理的事件，然后启动多线程按照不同的周期侦测事件，事件触发后利用.NET的委托技术，并发处理事件，并更新事件处理记录表；When the event detection and processing module is started, it checks the event processing record table, reprocesses the events that were not correctly processed before, and then starts multi-threading to detect events according to different cycles. After the event is triggered, it uses the .NET delegation technology to process the event concurrently. And update the event processing record table;

生产管理者通过客户端订阅事件，同时可以通过发送消息触发事件，事件侦测与处理模块处理完事件后以回调的方式通知生产管理者，生产管理者根据事件类型进行处理。The production manager subscribes to the event through the client, and can trigger the event by sending a message. The event detection and processing module notifies the production manager by callback after processing the event, and the production manager handles it according to the event type.

所述检查事件处理记录表包括以下步骤：事件侦测与处理模块将事件的处理状态分为四类：侦测中、待处理、处理中、处理完毕，事件侦测与处理模块可能由于计算机断电等原因，未能正常处理某些已经触发的事件，因此，在事件侦测与处理模块启动时需检查事件处理记录表，将那些处于待处理或处理中的事件重新处理，正常处理后将状态更新为处理完毕，此过程也称为故障事件恢复。The inspection event processing record table includes the following steps: the event detection and processing module divides the processing status of the event into four categories: detecting, pending, processing, and processing completed. The event detection and processing module may be interrupted by the computer Some triggered events cannot be processed normally due to electrical or other reasons. Therefore, when the event detection and processing module is started, it is necessary to check the event processing record table, and reprocess those events that are pending or being processed. After normal processing, the The status is updated to Process Complete, a process also known as failure event recovery.

所述启动多线程侦测与处理事件包括以下步骤：事件侦测与处理模块启动后，按照与事件关联的参数属性，启动不同周期的事件侦测线程，每个线程负责侦测不同的事件任务，当侦测的事件参数满足事件触发条件时，侦测线程会以异步委托的方式将事件的处理委托到事件处理线程，利用委托的异步处理特性，实现了大规模、并发事件的处理。The described starting multi-thread detection and processing event comprises the following steps: after the event detection and processing module starts, according to the parameter attribute associated with the event, start the event detection threads of different cycles, and each thread is responsible for detecting different event tasks , when the detected event parameters meet the event triggering conditions, the detection thread will delegate the processing of the event to the event processing thread in the form of asynchronous delegation, and use the asynchronous processing characteristics of the delegation to realize the processing of large-scale and concurrent events.

所述更新事件处理记录表包括以下步骤：事件侦测与处理模块在内存中和数据库中同时维护事件处理的记录表，事件处理记录首先缓存到内存是为了提高处理速度，内存中的数据定期写入数据库中；事件侦测过程中事件的状态为侦测中，满足事件触发条件后，事件的状态更新为待处理，事件委托到处理线程开始处理后，事件的状态为处理中，当事件被成功处理后，事件的状态为处理完毕。The update event processing record table includes the following steps: the event detection and processing module maintains the event processing record table in the memory and the database, the event processing record is first cached in the memory to improve the processing speed, and the data in the memory is written regularly In the process of event detection, the state of the event is detecting. After the event trigger condition is met, the state of the event is updated as pending. After the event is delegated to the processing thread to start processing, the state of the event is processing. When the event is triggered When successfully processed, the event's status is Processed.

所述生产管理者订阅事件步骤如下：生产管理者可通过客户端自由订阅或取消订阅其所关注的事件，事件侦测与处理模块会维护一个事件订阅列表，及时添加新的订阅者，移除取消的订阅者。The production manager subscribes to events as follows: the production manager can freely subscribe or unsubscribe the events he cares about through the client, the event detection and processing module will maintain an event subscription list, add new subscribers in time, remove Canceled subscribers.

所述生产管理者发送消息触发事件的步骤如下：生产管理者可通过发送消息触发事件，事件的处理过程及回调过程与基于侦测参数触发的事件处理过程相同。The steps of the production manager sending a message to trigger an event are as follows: the production manager can trigger an event by sending a message, and the event processing and callback process are the same as the event processing process triggered based on detection parameters.

所述事件侦测与处理模块回调订阅者的步骤如下：订阅者首先需要实现回调接口的方法，此方法用于事件侦测与处理模块通知订阅者，生产管理者订阅事件后，事件侦测与处理模块会维护与订阅者之间的连接通道，当产生某个事件后通过此通道回调订阅者。The steps for the event detection and processing module to call back the subscriber are as follows: the subscriber first needs to implement the method of the callback interface, which is used by the event detection and processing module to notify the subscriber. After the production manager subscribes to the event, the event detection and The processing module maintains a connection channel with the subscriber, and when an event is generated, the subscriber is called back through this channel.