Brain Computer Interface (BCI) for Shared Controls of Unmanned Aerial Vehicles (UAVs)

To control an intelligent system in an unstructured environment, it is desirable to synergize human's and machine's intelligence to deal with changes and uncertainty cost-effectively. A shared control takes the advantages of human's and computers' strengths in decision-making supports, and this helps to improve adaptability, agility, reliability, responsiveness, and resilience of system. Since the decision spaces for human's thinking and machine intelligence are quite different, challenges occur to fuse human intelligence and machine intelligence effectively. A Brain Computer Interface (BCI) can bridge human and machine intelligence; while traditional BCIs are unidirectional that supports an interaction in one of two scenarios: (1) human or machine takes effect at different control layers and (2) either of human or machine takes effect at a time. There is an emerging need to close the loop of BCI-based control to alleviate adverse effects by a machine's error or a human's mistake. In this paper, available technologies for acquisition, processing and mining of brain signals are reviewed, the needs of integrating human's capability to control a Unmanned Aerial Vehicles (UAV) are elaborated, and research challenges in advancing BCI for a shared human and machine control are discussed at the aspects of data acquisition, mapping of human's and machine's decision spaces, and the fusion of human's and machine's intelligence in automated controls. To address unsolved problems in aforementioned aspects, we proposed a new platform of using BCI for Human Machine Interactions (HMIs) and three innovations are (1) an advanced BCI to acquire multi-modal brain signals and extract features related to (i) the intentions of motion and (ii) the quantified human's affection, (2) an arbitrating mechanism in system control to determine the weight of human's decisions based on quantified human's affection, and (3) a decision support system that is capable of fusing human's and machine's decisions from different decision spaces seamlessly in controlling a UAV for real-time performance in application.