Multi-Modal Immersive Intelligent Interface for Remote Operation

Period of Performance: 04/03/1998 - 04/03/2000

$750K

Phase 2 SBIR

Recipient Firm

Infoage Technologies
10501 Kinnard Avenue
Los Angeles, CA 90024
Principal Investigator

Research Topics

Abstract

This research will develop an operator interface, the Multi-Modal Immersive Intelligent Interface for Remote Operation (MIIIRO), for the planning and control of unmanned aerial vehicles (UAVs), unmanned tactical aircrafts (UTAs) and other remote systems. MIIIRO consists of (1) a set of intelligent agents which aims for reducing work and information overload, (2) a virtual environment which induces a sense of presence in the engagement area, and (3) multi-modal inputs which facilitate efficient interactions. An innovative three-layer architecture, consisting of the distributed, component, and multi-agent layers, enables distributed collaboration, heterogeneous information access, software reconfigurability and expandability, and agent cooperation. The resulting MIIIro has capabilities of reducing bandwidth and crew size, enabling mission planning and data dissemination over the Internet, controlling multiple UAVs/UTAs and payloads by a single operator, and collaboration among multiple operators towards a common mission goal. These capabilities will be developed through a synergistic integration of (1) platform-independent and interoperable technologies of Java, Virtual Reality Modeling Language, and CORBA, and (2) a multitude of diverse disciplines of artificial intelligence, virtual reality, remote operation, cognitive engineering, image processing and sensor fusion.