CN110347461A - Aircraft cockpit man-machine interface message scheduling system and method based on Migrating Workflow - Google Patents

The present invention proposes a kind of aircraft cockpit man-machine interface message scheduling system and method based on Migrating Workflow: the system includes migrating workflow management system, man-machine Task Scheduling Model, man-machine integration decision model, knowledge base, man-machine function allocation model, migration example；By workflow schedule, adjustment migration intelligent body circulation path and functional requirement for man-machine cognitive features distribution Study on Man-Machine Function and determine function priority, establish man-machine information requirement and feedback scheduling queue.The present invention has many advantages, such as that strong real-time, man-machine load balancing, work efficiency is high.

基于迁移工作流的飞机驾驶舱人机界面信息调度系统及方法Aircraft cockpit man-machine interface information scheduling system and method based on migration workflow

技术领域technical field

本发明属于航空系统技术领域，具体涉及一种基于迁移工作流的飞机驾驶舱人机界面信息调度系统及方法。The invention belongs to the technical field of aviation systems, and in particular relates to an aircraft cockpit man-machine interface information scheduling system and method based on migration workflow.

背景技术Background technique

人机显示界面(Human Machine Interface,HMI)是人与机器发生交互的人机接口，在飞行过程中，飞行员通过人机显示界面获取信息，并对信息加工处理，最终决策反馈实现人机交互过程。人机显示界面集合了飞行系统的所有参数和状态信息，如飞行高度、速度、航向、迎角、航路点、发动机转速、油箱油量等实时飞行信息。设计良好的驾驶舱人机显示界面可帮助飞行员快速获取信息，减轻飞行员认知负荷。Human Machine Interface (HMI) is a human-machine interface for human-machine interaction. During the flight, the pilot obtains information through the HMI interface, processes the information, and finally makes a decision feedback to realize the human-machine interaction process. . The man-machine display interface integrates all the parameters and status information of the flight system, such as flight altitude, speed, heading, angle of attack, waypoint, engine speed, fuel tank and other real-time flight information. A well-designed cockpit man-machine display interface can help pilots quickly obtain information and reduce the pilot's cognitive load.

新一代的智能化驾驶舱中飞行控制系统具有很强的操作飞机能力，也擅长智能化调整任务分配，在人机界面中合理调度执行任务所需的信息，帮助飞行员处于更好的工作状态。The new generation of intelligent flight control system in the cockpit has a strong ability to operate the aircraft, and is also good at intelligently adjusting task assignments, reasonably dispatching the information required to perform tasks in the man-machine interface, and helping pilots to be in a better working state.

传统的驾驶舱设计理念是以“技术的集成”为中心，显示器的屏幕较小，界面中显示的信息有限，需要多个小屏显示器显示不同系统的信息，飞行员不得不在几个显示屏中反复寻找。现代驾驶舱人机显示界面的设计还是以增加显示器的功能为主，飞行员获取的信息过多，导致飞行员容易疲劳，工作负荷较大。The traditional cockpit design concept is centered on "integration of technology". The screen of the monitor is small, and the information displayed in the interface is limited. Multiple small screen monitors are required to display the information of different systems, and the pilot has to repeatedly check the information on several screens. Look for. The design of the human-machine display interface in the modern cockpit is mainly to increase the function of the display. Pilots get too much information, which leads to fatigue and heavy workload.

研究表明，人在高压、工作负荷较大的情况下认知能力降低，发生误读、误操纵的机率大大增加。由此可见，以“技术的集成”为中心的设计理念已不再适用，需要转变思路以“飞行员认知为中心”的设计理念，提供一个良好的人机显示界面，可增强飞行员的认知能力，降低飞行员的疲劳程度，减少飞行员的认知负荷。Studies have shown that people's cognitive ability is reduced under high pressure and heavy workload, and the probability of misreading and mismanipulation is greatly increased. It can be seen that the design concept centered on "technology integration" is no longer applicable, and it is necessary to change the design concept centered on "pilot cognition" to provide a good man-machine display interface, which can enhance the pilot's cognition ability, reduce pilot fatigue, and reduce pilot cognitive load.

发明内容Contents of the invention

发明的目的是提供一种基于迁移工作流的飞机驾驶舱人机界面信息调度系统及方法，以降低飞行员的疲劳程度，减少飞行员的认知负荷。The purpose of the invention is to provide an aircraft cockpit man-machine interface information scheduling system and method based on migration workflow, so as to reduce the pilot's fatigue and reduce the pilot's cognitive load.

为实现上述目的，本发明采用以下技术方案：To achieve the above object, the present invention adopts the following technical solutions:

一种基于迁移工作流的飞机驾驶舱人机界面信息调度系统，包括迁移工作流管理系统、人机任务调度模型、人机一体化决策模型、知识库、人机功能分配模型、迁移实例；其中，An aircraft cockpit human-machine interface information scheduling system based on migration workflow, including migration workflow management system, human-machine task scheduling model, human-machine integrated decision-making model, knowledge base, human-machine function allocation model, and migration examples; ,

所述迁移工作流管理系统用于定义飞行任务执行的工作流、分解工作流过程、创建迁移实例和任务指派、生成初始迁移路径、启动工作流、工作流状态监控；The migration workflow management system is used to define the workflow of flight task execution, decompose the workflow process, create migration instances and task assignments, generate initial migration paths, start workflows, and monitor workflow status;

所述人机任务调度模型用于建立人机工作任务队列、建立人机工作任务执行信息流需求表、根据优先级调度人机当前执行任务，发送任务执行后更新的新信息给人机一体化决策模型；The man-machine task scheduling model is used to establish a man-machine work task queue, establish a man-machine work task execution information flow demand table, schedule the current execution tasks of the man-machine according to the priority, and send updated new information to the machine-machine integration after task execution decision model;

所述人机一体化决策模型用于读取飞机飞行数据信息，根据任务需求加工信息建立决策模型，把决策的结果提交给人机功能分配模型；The human-machine integrated decision-making model is used to read aircraft flight data information, process information according to task requirements to establish a decision-making model, and submit decision-making results to the machine-machine function allocation model;

所述知识库包括信息调度系统相关知识库；The knowledge base includes information dispatching system-related knowledge bases;

所述人机功能分配模型提供人机界面接口，以决策结果、信息显示需求作为调整功能情景、功能界面的依据，形成最新的人机功能分配列表以及相关操作界面。The man-machine function allocation model provides a man-machine interface, and uses decision-making results and information display requirements as the basis for adjusting function scenarios and function interfaces to form the latest man-machine function allocation list and related operation interfaces.

所述迁移实例具有独立的智能，根据任务执行的状况进行任务分解并反馈工作流引擎调度。The migration instance has independent intelligence, decomposes tasks according to the status of task execution and feeds back the scheduling of the workflow engine.

所述人机信息知识库以面向对象、一阶谓词建立，包括飞行数据信息、人机界面信息、人机任务队列调度算法、人机决策算法。The man-machine information knowledge base is established with object-oriented and first-order predicates, including flight data information, man-machine interface information, man-machine task queue scheduling algorithm, and man-machine decision-making algorithm.

获取迁移实例执行过程中的时间、性能、准确率工效指标，设置阈值，均衡人机工作负荷，建立人机功能分配模型。Obtain time, performance, accuracy and ergonomics indicators during the execution of the migration instance, set thresholds, balance human-machine workloads, and establish a human-machine function allocation model.

一种基于迁移工作流的飞机驾驶舱人机界面信息调度方法，步骤如下：A method for scheduling human-machine interface information in an aircraft cockpit based on a migration workflow, the steps are as follows:

步骤一，根据人机界面设计方案和飞行任务需求，建立任务调度队列、人机信息存储Cache以及知识库，其中调整任务队列中的任务的状态为初始状态，人机信息存储Cache为空；Step 1, according to the man-machine interface design scheme and flight mission requirements, establish a task scheduling queue, a man-machine information storage Cache and a knowledge base, wherein the state of the task in the task queue is adjusted to be the initial state, and the man-machine information storage Cache is empty;

步骤二，根据迁移工作流引擎模型调度动态任务，修改任务调度队列，获取感知信息填充人机信息存储Cache，模拟任务调度过程，循环判断信息需求内容，直至满足某任务驱动要求，激活此任务为等待状态，等待飞行员执行任务；Step 2: Scheduling dynamic tasks according to the migration workflow engine model, modifying the task scheduling queue, obtaining perceptual information to fill the HMI information storage cache, simulating the task scheduling process, cyclically judging the content of information requirements, until a certain task driving requirement is met, and activating the task as Waiting state, waiting for the pilot to perform the task;

步骤三，调整当前人机界面，显示当前已满足激活任务执行充分条件的信息内容，对于同时满足激活条件的多条任务，根据优先级先后显示相关信息；Step 3, adjust the current man-machine interface to display the information content that currently satisfies the sufficient conditions for the execution of the activation task, and for multiple tasks that meet the activation conditions at the same time, display relevant information according to the priority;

步骤四、飞行员执行任务以后，根据任务执行状态的变化调整人机界面信息内容，修改任务调度队列，删除已完成任务。Step 4. After the pilot executes the mission, he adjusts the information content of the man-machine interface according to the change of the mission execution state, modifies the mission scheduling queue, and deletes the completed mission.

步骤一中，任务队列中的任务的状态包括初始、等待、执行、挂起、结束；状态的变化根据信息调度的状态、以及飞行员的执行反馈决定。In step 1, the status of the task in the task queue includes initial, waiting, execution, suspension, and end; the change of the status is determined according to the status of information scheduling and the execution feedback of the pilot.

步骤二中，人机信息存储Cache中信息需求队列根据任务规划建立，信息值是动态变化的不稳定状态。In step 2, the information demand queue in the man-machine information storage Cache is established according to the task plan, and the information value is in a dynamic and unstable state.

步骤二中，所述任务调度队列采用的算法如下：In step 2, the algorithm adopted by the task scheduling queue is as follows:

(1)信息满足充分条件的任务在进入待调度的队列等待时，进入对应的优先级的任务队列，相同优先级的任务根据先后等待；(1) When a task whose information satisfies the sufficient condition enters the queue to be scheduled and waits, it enters the task queue of the corresponding priority, and tasks of the same priority wait in sequence;

(2)首先调度优先级高的队列中的任务，分配相应的信息资源，若高优先级中队列中已没有调度的任务，则调度次优先级队列中的任务；(2) First schedule tasks in the queue with high priority, and allocate corresponding information resources, if there is no task scheduled in the queue with high priority, then schedule tasks in the queue with secondary priority;

(3)对于同一个队列中的各个任务，按照先入先出方法调度；(3) For each task in the same queue, schedule according to the first-in-first-out method;

(4)在低优先级的队列中的任务在运行时，又有新激活的任务，那么系统马上分(4) When the tasks in the low-priority queue are running, there are new activated tasks, then the system will immediately assign

配信息给新到达的任务；Assign information to newly arrived tasks;

(5)同优先级的任务连续执行，直至因为信息资源缺乏、或者人机没有即使动作(5) Tasks with the same priority are executed continuously until there is no immediate action due to lack of information resources or man-machine

反馈信息而挂起，退出等待队列，进入后备队列；Feedback information is suspended, exit the waiting queue, and enter the backup queue;

(6)后备队列的任务当满足信息资源充分条件时进入等待队列。(6) The task in the backup queue enters the waiting queue when it meets the sufficient condition of information resources.

步骤三中，人机界面随任务执行显示信息的需求调整，并根据人及功能分配模型调整人机功能分配。In step three, the man-machine interface is adjusted according to the needs of the task execution display information, and the man-machine function allocation is adjusted according to the man-machine and function allocation model.

有益效果：本发明通过工作流调度调整迁移智能体流转路径与功能需求，针对人机认知特性分配人机功能与确定功能优先级，建立人机信息需求与反馈调度队列，为飞机驾驶舱人机交互界面需求提供最优的信息内容。Beneficial effects: the present invention adjusts the transfer paths and functional requirements of migrating agents through workflow scheduling, assigns human-machine functions and determines function priorities according to human-machine cognitive characteristics, establishes human-machine information requirements and feedback scheduling queues, and provides information for aircraft cockpit personnel. The computer interface needs to provide the optimal information content.

本发明通过迁移工作流对飞行任务调度模式建模，更优地体现了复杂任务下任务执行场景，更精确地对飞行员需求信息进行调度，为人机界面信息现实优先级提供依据。The invention models the flight task scheduling mode by migrating the workflow, better embodies the task execution scene under complex tasks, more accurately schedules the pilot demand information, and provides a basis for the actual priority of the man-machine interface information.

本发明具有实时性强、人机负荷均衡、工作效率高等优点。本发明能够增强飞行员的认知能力，降低飞行员的疲劳程度，减少飞行员的认知负荷。The invention has the advantages of strong real-time performance, man-machine load balance, high work efficiency and the like. The invention can enhance the cognitive ability of the pilot, reduce the fatigue degree of the pilot, and reduce the cognitive load of the pilot.

附图说明Description of drawings

图1为本发明的系统的架构图；Fig. 1 is the architecture diagram of the system of the present invention;

图2为本发明的方法的流程图。Figure 2 is a flow chart of the method of the present invention.

具体实施方式Detailed ways

下面结合附图对本发明做更进一步的解释。The present invention will be further explained below in conjunction with the accompanying drawings.

如图1所示，一种基于迁移工作流的飞机驾驶舱人机界面信息调度系统，包括迁移工作流管理系统、人机任务调度模型、人机一体化决策模型、知识库、人机功能分配模型、迁移实例、自适应调度算法；其中，As shown in Figure 1, an aircraft cockpit human-machine interface information scheduling system based on migration workflow, including migration workflow management system, human-machine task scheduling model, human-machine integrated decision-making model, knowledge base, human-machine function allocation Model, migration instance, adaptive scheduling algorithm; among them,

迁移工作流管理系统集中驱动任务的执行，这个引擎根据预定义的典型飞行任务的工作流程、流转规则作为任务执行的逻辑，包括具有柔性处理多个工作流运行的互相干扰、临界资源引起的约束等能力。The migration workflow management system centrally drives the execution of tasks. This engine is based on the predefined workflow and flow rules of typical flight tasks as the logic of task execution, including the ability to flexibly handle the mutual interference of multiple workflow operations and the constraints caused by critical resources. and other capabilities.

定义1(迁移工作流管理系统)迁移工作流管理系统是一个四元组(MIS，WP，Engine，TS)，其中：Definition 1 (Migration Workflow Management System) A migration workflow management system is a quadruple (MIS, WP, Engine, TS) where:

MIS＝{MI₁，MI₂，…MI_n}是系统中迁移实例的集合，迁移实例的数量取决于典型飞行任务的子任务的数量；MIS={MI ₁ , MI ₂ ,...MI _n } is the collection of migration instances in the system, and the number of migration instances depends on the number of subtasks of a typical flight mission;

WP＝{wp₁，wp₂,…wp_m}是系统中已建立互信关系的工作位置的集合，每个工作位置之间的通信通过共享存储空间Cache来进行，工作位置的数量取决于任务执行的可行节点数量；WP={wp ₁ , wp ₂ ,...wp _m } is the set of working positions that have established mutual trust relationship in the system, the communication between each working position is carried out through the shared storage space Cache, the number of working positions depends on the task execution the number of feasible nodes;

Engine为迁移工作流引擎，用于辅助工作流管理者对业务过程的分析与分解，生成迁移实例、任务委派、监督以及评价迁移实例的执行过程等。Engine is a migration workflow engine, which is used to assist workflow managers in analyzing and decomposing business processes, generating migration instances, assigning tasks, supervising and evaluating the execution process of migration instances, etc.

TS为工作任务队列及相关信息，用于表示人机工作任务队列基本信息、优先级、以及信息需求表等内容。TS is the work task queue and related information, which is used to represent the basic information, priority, and information demand table of the man-machine work task queue.

人机任务调度模型建立人机工作任务队列，建立人机工作任务执行信息流需求表、根据优先级调度人机当前执行任务，发送任务执行后更新的新信息给人机一体化决策模型。对于调度模型对应的任务调度过程，需首先定义初始为空的任务队列。The man-machine task scheduling model establishes the man-machine task queue, establishes the man-machine work task execution information flow demand table, schedules the man-machine current execution tasks according to the priority, and sends the updated new information after task execution to the machine-machine integrated decision-making model. For the task scheduling process corresponding to the scheduling model, it is necessary to first define an initially empty task queue.

定义2设有N个任务队列(Q₁,Q₂....Q_N)，其中优先级Priority(Q₁)>Priority(Q₂)>...>Priority(Q_N)，任务队列的数量取决于典型飞行任务分割后的子任务的优先级的数量；Definition 2 sets up N task queues (Q ₁ , Q ₂ ....Q _N ), where the priority Priority(Q ₁ )>Priority(Q ₂ )>...>Priority(Q _N ), the task queue The number depends on the number of priority levels of subtasks divided into typical flight missions;

人机一体化决策模型读取飞机飞行数据，根据任务需求加工信息建立决策模型，每次决策需要迁移实例智能发送信息给飞行员或飞机控制系统进行后续处理，主要的原则是感知信息已经满足人机执行的充分条件。The man-machine integrated decision-making model reads the flight data of the aircraft, and processes the information according to the task requirements to establish a decision-making model. Every time a decision needs to be migrated, the instance is intelligently sent to the pilot or the aircraft control system for subsequent processing. The main principle is that the perceived information has satisfied the man-machine Sufficient conditions for execution.

人机信息知识库包括信息调度系统相关知识库，以面向对象、一阶谓词建立，包括飞行数据信息、人机界面信息、人机任务队列调度算法、人机决策算法等。其中调度的人机界面信息内容如附图2所示。The human-machine information knowledge base includes information scheduling system-related knowledge base, which is established with object-oriented and first-order predicates, including flight data information, man-machine interface information, man-machine task queue scheduling algorithm, man-machine decision-making algorithm, etc. The content of the dispatched man-machine interface information is shown in Figure 2.

人机功能分配模型提供人机界面接口，以决策结果、信息显示需求作为调整功能情景、功能界面的依据，形成最新的人机功能分配列表以及相关操作界面，人机功能是工作流节点信息发送方向的主要依据。The man-machine function allocation model provides a man-machine interface interface, and uses decision-making results and information display requirements as the basis for adjusting function scenarios and function interfaces to form the latest man-machine function allocation list and related operation interfaces. Man-machine functions are workflow node information transmission The main basis for the direction.

迁移实例具有独立的智能，根据任务执行的状况，进行任务分解并反馈工作流引擎调度。获取迁移实例执行过程中的时间、性能、准确率等指标，通过自适应调度算法建立人机功能分配模型。The migration instance has independent intelligence, and according to the status of task execution, it decomposes tasks and feeds back the workflow engine scheduling. Obtain indicators such as time, performance, and accuracy during the execution of the migration instance, and establish a human-machine function allocation model through an adaptive scheduling algorithm.

表1为本发明的一个实施方式中的界面编码示例Table 1 is an example of interface coding in an embodiment of the present invention

表1界面编码示例Table 1 interface coding example

如图2所示，一种基于迁移工作流的飞机驾驶舱人机界面信息调度方法，其步骤如下：As shown in Figure 2, a method for scheduling human-machine interface information in the aircraft cockpit based on migration workflow, the steps are as follows:

步骤一，根据人机功能分配模型提供的人机界面设计方案和飞行任务需求，建立任务调度队列、人机信息存储Cache以及决策知识库，其中任务队列中的任务为初始状态，人机信息存储Cache为空；其中，任务的状态包括初始、等待、执行、挂起、结束。状态的变化根据信息调度的状态、以及飞行员的执行反馈决定；Step 1. According to the man-machine interface design scheme provided by the man-machine function allocation model and the flight task requirements, establish a task scheduling queue, a man-machine information storage cache, and a decision-making knowledge base. The tasks in the task queue are the initial state, and the man-machine information storage Cache is empty; wherein, the state of the task includes initial, waiting, execution, suspension, and end. The change of state is determined according to the state of information scheduling and the pilot's execution feedback;

步骤二，根据人机任务调度模型调度动态任务，修改任务调度队列，获取感知信息填充人机信息存储Cache，模拟任务调度过程，循环判断信息需求内容，直至满足某任务驱动要求，激活此任务为等待状态，等待飞行员执行任务；Step 2: Scheduling dynamic tasks according to the human-machine task scheduling model, modifying the task scheduling queue, obtaining perceptual information to fill the HMI information storage cache, simulating the task scheduling process, and cyclically judging the content of information requirements until a certain task-driven requirement is met, and activating the task as Waiting state, waiting for the pilot to perform the task;

其中，人机信息存储Cache中信息需求队列根据任务规划建立，信息值是动态变化的不稳定状态。Among them, the information demand queue in the man-machine information storage Cache is established according to the task plan, and the information value is in an unstable state that changes dynamically.

其中任务队列调度算法如下：The task queue scheduling algorithm is as follows:

1、信息满足充分条件的任务在进入待调度的队列等待时，进入对应的优先级的任务队列，相同优先级的任务根据先后等待。1. When a task whose information satisfies sufficient conditions enters the queue to be scheduled and waits, it enters the task queue of the corresponding priority, and tasks of the same priority wait in sequence.

2、首先调度优先级高的队列中的任务，分配相应的信息资源。若高优先级队列中已没有调度的任务，则调度次优先级队列中的任务。例如：Q₁,Q₂,Q₃三个队列，只有在Q₁中没有进程等待时才去调度Q₂，同理，只有Q₁,Q₂都为空时才会去调度Q₃。2. First schedule tasks in the queue with high priority, and allocate corresponding information resources. If there are no scheduled tasks in the high-priority queue, the tasks in the sub-priority queue are scheduled. For example: Q ₁ , Q ₂ , Q ₃ are three queues, Q ₂ will be scheduled only when there is no process waiting in Q ₁ , similarly, Q ₃ will be scheduled only when Q ₁ and Q ₂ are empty.

3、对于同一个队列中的各个任务，按照先入先出方法调度。3. For each task in the same queue, schedule according to the first-in-first-out method.

4、在低优先级的队列中的任务在运行时，又有新激活的任务，那么系统立即分配信息给新到达的任务(抢占式)。4. When the tasks in the low-priority queue are running, there are new activated tasks, then the system immediately assigns information to the newly arrived tasks (preemptive).

5、同优先级的任务依次执行，直至因为信息资源缺乏、或者人机在设定时间内没有动作反馈而挂起，退出等待队列，进入后备队列。5. Tasks with the same priority are executed sequentially until they are suspended due to lack of information resources or the HMI has no action feedback within the set time, then exit the waiting queue and enter the backup queue.

6、后备队列的任务当满足信息资源充分条件时进入等待队列。6. The task in the backup queue enters the waiting queue when the sufficient condition of information resources is satisfied.

步骤三，调整当前人机界面，显示当前已满足激活任务执行充分条件的信息内容，对于同时满足激活条件的多项任务，根据优先级先后显示相关信息。任务执行过程中的信息资源需根据人机功能分配的要求来调整发送方向，并等待反馈。飞行员的反馈信息是迁移工作流感知工作位置的主要依据，也是任务从挂起到等待执行状态的主要触发条件；其中，人机界面随任务执行显示信息的需求调整，并根据人机功能分配模型调整人机功能分配；Step 3: adjust the current man-machine interface to display the information content that currently satisfies the sufficient conditions for the execution of the activation task, and for multiple tasks that meet the activation conditions at the same time, display relevant information in sequence according to the priority. Information resources in the process of task execution need to adjust the sending direction according to the requirements of man-machine function allocation, and wait for feedback. The pilot's feedback information is the main basis for the migration workflow to perceive the work position, and it is also the main trigger condition for the task to wait for execution from suspension; among them, the man-machine interface is adjusted according to the needs of the task execution display information, and according to the man-machine function allocation model Adjust the allocation of man-machine functions;

步骤四，飞行员执行任务以后，根据任务执行状态的变化调整人机界面信息内容，修改任务调度队列，删除已完成任务。Step 4: After the pilot executes the mission, he adjusts the information content of the man-machine interface according to the change of the mission execution state, modifies the mission scheduling queue, and deletes the completed mission.

以上所述仅是本发明的优选实施方式，应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明原理的前提下，还可以做出若干改进和润饰，这些改进和润饰也应视为本发明的保护范围。The above is only a preferred embodiment of the present invention, it should be pointed out that, for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, and these improvements and modifications can also be made. It should be regarded as the protection scope of the present invention.