THIS PREPROPOSAL IS SUBMITTED PURSUANT TO THE RESEARCH ANNOUNCEMENT-- RA00-14

"FUNDAMENTAL RESEARCH AT THE [BIO:INFO:MICRO] INTERFACE" PUBLISHED IN THE COMMERCE BUSINESS DAILY 23 DECEMBER 1999

TITLE: Physio Info Tronic Couplers

An Anthrotronic interface to the emerging BIOTIC matrix.

INSTITUTION:

Syracuse University

PRINCIPAL INVESTIGATOR:

Dave Warner MD PhD

Mailing Address:

CRNR

500 University Place

Syracuse NY

13210

Phone:315 443 5654

Fax: 315 443 1973

Email: davew@well.com

Physio Info Tronics

An Anthrotronic interface to the emerging BIOTIC matrix.

Submitted by: Dave Warner MD PhD

Advanced research in the area of BIOTICS (Bio-Info-Opto-Tronic-Integrative-Coupler-Systems) continue to produce an ever emerging array of technologies. We propose to develop the matrix architecture that will allow all bio/info/micro systems to connect to a network through which human communication is facilitated. This paradigm of interface technology is based on new theories of human-computer interaction, which are physiologically and cognitively oriented. This paradigm of human interaction with BIOTIC systems incorporates multi-sense rendering technologies, giving sustained perceptual effects, and natural user interface devices which measure multiple physiological parameters simultaneously and use them as inputs. Biologically optimized interactive information technology has the potential to facilitate effective communication. This increase in effectiveness will impact both human-computer and human-human

communication, "enhanced expressivity ". and extends perceptual dimensionality.

We propose to research, design, develop, prototype and demonstrate an integrative interface matrix which couples the emerging bio-sensors and micro informatic technologies to the human nervous system in ways which increase the perceptual dimensionality and expressive capacity. We propose to develop an Anthrotronic (human scale instrumentation system) matrix which will allow for the exploitation of the human nervous system in ways which increase the humans ability to “grok” and communicate the information being generated and transmitted by a BIOTIC System. We will research, design, develop, prototype and demonstrate technologies that enable Controllability and Exploitability of the multichannel, multifunction concurrence of dynamically interconnectable micro-neuro-infocom bio-coupler based hybrids.

Exploiting Natural systems of human information processing through developing

“Physiologically oriented interface systems”.

Knowledge of sensory physiology and perceptual psychophysics is being used to optimize our future interactions with the bio info tronic systems. An understanding of the human neurophysiology allows for exploitation of predictable adaptive capabilities. The assertion is that the information flow between external sources and direct experience is biased/restrained/constrained/limited/enhanced/facilitated in understandable and predictable ways by the physiological mechanisms of human information processing.

By increasing the number and variation of simultaneous sensory inputs, we can make the body an integral part of the information system, "a sensorial combinetric integrator". We will identify the optimal perceptual state space parameters in which information can best be rendered. That is what types of information are best rendered to each specific sense modality, "a sense specific optimization of rendered information.

Research in human sensory physiology, specifically sensory transduction mechanisms, shows us that there are designs in our nervous systems optimized for feature extraction of spatially rendered data, temporally rendered data, and textures. Models of information processing based on the capacity of these Neurophysiological structures to process information will help our efforts to enhance perception of complex relationships by integrating visual, binaural, and tactile modalities. Then by using the natural bio-modulated energy as a signal source for input; we can generate highly interactive systems in which these biological signals initiate specific events. Such a real-time analysis enables multi-modal feedback and closed-loop interactions. ERGO = Controllability and Exploitability of the multichannel, multifunction concurrence of dynamically interconnectable micro-neuro-infocom bio-coupler based hybrids.

This research effort is concerned with developing a "reference architecture" (a formalized conceptual framework for thinking and technology development) for designing Physio-informatically robust interactive human computer interface systems to the bio-info-com systems. The purpose of the reference architecture will be to provide insight into the various components of the system in the context of how they might affect the flow of information as information is passed through them. The primary focus will be to consider the flow of information between the human and the com-system in a sustained, iterative, experiential interaction. The intent of developing this reference architecture is to map the information flow during/caused by the intentional /volitional interaction with information between a conscious human and a bio-info-com system. An exchange of information between the an experienced perceptual state and an external physical state is mediated by a biologic / physiologic information transporter system .

We will assume that interface systems that support Human com-system interaction can be modeled and developed as systems where information flows between various components of the system in a specific manner. Emergent technology for coupling biologic systems to informatic systems is enhanced by knowledge/acknowledgement of physioinformatics restraints/constraints/capacities in the design and iterative refinement of the physicality/functionality of the technology. Our adaptive control strategy will be to develop technology systems which are coupled to the distributed -concurrently multi functional - neuro info matrix which conveys perceptible and expressible information streams.

We propose to develop an Anthrotronic interface to informatic systems which are either biologically/physiologically based (primarily neurologic i.e. neuro informatic) information systems and/or informatic systems which are designed to support interaction (dynamic exchange of information) with such systems. The intent of this work is to develop a systems based, physiologically robust, technology matrix that will exploit the various technologies being developed for the Bio-Info-Micro program.

The basis for this work comes from the researchers extensive experience in developing interface technologies for persons with severe disabilities and from the DARPA programs for instrumenting humans for controlling distributed robotics.

LINKS TO OTHER EFFORTS

Physioinformatics

http://www.quasar.org/memes/phd-meme-mill/2llu4phd/phd-please-1-31-00.htm

Distributed Robotics

http://www.pulsar.org/febweb/proposals/botmstrsabst.html

PI’s Research Site

www.pulsar.org

PI’s CV

http://www.pulsar.org/febweb/history/djwarner.htm

Budget Estimate

We are seeking $875,000 pre year for 3 years in direct costs

This will include all labor, facilities, travel, material costs.

Dave Warner MD PhD

Medical Neuroscientist

Dir. Medical Intelligence

MindTel /Syracuse University

davew@well.com -- www.pulsar.org

Warner, a medical neuroscientist, has an MD/PhD from Loma Linda University and is the director of the Institute for Interventional Informatics and has gained international recognition for pioneering new methods of physiologically based human-computer interaction. Warner's research efforts have focused on advanced instrumentation and new methods of analysis which can be applied to evaluating various aspects of human function as it relates to human-computer interaction, this effort was to identify methods and techniques which optimize information flow between humans and computers. Warner's work has indicated an optimal mapping of interactive interface technologies to the human nervous system's capacity to transduce, assimilate and respond intelligently to information in an integrative-multisensory interaction will fundamentally change the way that humans interact with information systems. Application areas for this work include quantitative assessment of human performance, augmentative communication systems, environmental controls for the disabled, medical communications and integrated interactive educational systems. Warner is particularly active in technology transfer of aerospace and other defense derived technologies to the fields of health care and education. Specific areas of interest are: advanced instrumentation for the acquisition and analysis of medically relevant biological signals; intelligent informatic systems which augment both the general flow of medical information and provide decision support for the health care professional; public accesses health information databases designed to empower the average citizen to become more involved in their own health care; and advanced training technologies which will adaptively optimize interactive educational systems to the capacity of the user. Selected Publications are:

1. Warner D, Rusovick R, Balch D (1998) The Globalization of Interventional Informatics Through Internet Mediated Distributed Medical Intelligence, New Medicine

2. Warner D, Tichenor J.M, Balch D.C. (1996) Telemedicine and Distributed Medical Intelligence, Telemedicine Journal 2: 295-301.

3. Warner, D., Anderson, T., and Joh Johannsen. (1994). Bio-Cybernetics: A Biologically Responsive Interactive Interface, in Medicine Meets Virtual Reality II: Interactive Technology & Healthcare: Visionary Applications for Simulation Visualization Robotics. (pp. 237-241). San Diego, CA, USA: Aligned Management Associates.

4. Warner, D., Sale, J., Price, S. and Will, D. (1992). Remapping the Human-Computer Interface for Optimized Perceptualization of Medical Information, in Proceedings of Medicine Meets Virtual Reality. San Diego, CA: Aligned Management Associates.

5. Warner, D., Sale, J. and Price, S. (1991). The Neurorehabilitation Workstation: A Clinical Application for Machine-Resident Intelligence, in Proceedings of the 13th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. ( pp. 1266-1267). Los Alamos, CA: IEEE Computer

Society Press.

Basic neuroscience

The following abstracts demonstrate the application of dynamical analysis to physiological signals and show that it is possible to characterize abnormal electrophysiological rhythms as low dimensional attractors.

n Sale EJ, Warner DJ, Price S, Will AD. Compressed complexity parameter. Proceedings of the 2^nd International Brain Topography Conference., Toronto, Ontario. 1991

n Warner DJ, Price SH, Sale EJ, Will AD. Chaotropic dynamical analysis of the EEG. Brain Topography. 1990.

n Warner DJ, Price SH, Sale EJ, Will AD. Chaotropic Dynamical Analysis of the EEG. Electroencephalography and Clinical Neurophysiology. 1990.

n Warner D, Will AD. Dynamical analysis of EEG: evidence for a low-dimensional attractor in absence epilepsy. Neurology. 1990 April;40(1):351.

The following abstract introduces the possibility of quantitatively correlating movement related potentials recorded over the scalp with complex motor tasks using human-computer interface technology

Warner DJ, Will AD, Peterson GW, Price SH, Sale EJ, Turley SM. Quantitative motion analysis instrumentation for movement related potentials. Electroencephalography and Clinical Neurophysiology. 1991;79:29-30.

Clinical neuroscience

The basic problem being addressed by the following abstracts is that clinical research involving neurological disorders is severely limited by the inability to objectively and quantitatively measure complex motor performance. Large double-blind randomized controlled trials of novel therapies continue to rely on clinical rating scales that are merely ordinal and subjective. In addition, research on the basic neuroscience of motor control is greatly impeded by the lack of quantitative measurement of motor performance.

n Will AD, Sale EJ, Price S, Warner DJ, Peterson GW. Quantitative measurement of the “milkmaid” sign in Huntington’s disease. Annals of Neurology. 1991;30:320

n Warner DJ, Will AD, Peterson GW, Price SH, Sale EJ. The VPL data glove as an instrument for quantitative motion analysis. Brain Topography. 1990.

n Will AD, Warner DJ, Peterson GW, Price SH, Sale EJ. Quantitative motion analysis of the hand using the data glove. Muscle and Nerve. 1990.

n Will AD, Warner DJ, Peterson GW, Sale EJ, Price SH. The data glove for precise quantitative measurement of upper motor neuron (UMN) function in amyotrophic lateral sclerosis (ALS). Annals of Neurology. 1990;28:210.

n Will AD, Warner DJ, Peterson GW, Price SH, Sale EJ. Quantitative analysis of tremor and chorea using the VPL data glove. Annals of Neurology. 1990;28:299.

Therapeutic potential of human computer interface

Warner DJ, Will AD, Peterson GW, Price SH, Sale EJ. The VPL data glove as a tool for hand rehabilitation and communication. Annals of Neurology. 1990;28:272.