physiologically based informatic systems
Title Page: Physioinformatic Systems -
Abstract "The physiologic basis of a reference architecture for designing interactive human-computer interface systems"
Table of Contents ... for dissertation
Introduction ... incl. background
Theoretical Framework ... optional
Materials and Methods (or just Methods)
Results
Discussion
Conclusions ... optional
Acknowledgments ... usually up front in a dissertation
References
Figures ... distributed throughout dissertation (include a number, title and
caption for each figure)
Tables ... distributed throughout dissertation (include a number title for
each table, and footnotes as needed)
Introduction
The intent of this work was to research the physiological basis for volitional/intentional interaction with
human-computer interface systems
Initial motivation
To link the mind to cyberspace
To understand the physiologic processes of human information processing systems. Specifically those systems supporting the volitional, intentional and meaningful interaction with informatic systems.
To develop a reference architecture for designing and refining interactive systems in ways which increase operational throughput of information.
This increased throughput is achieved by extending the perceptual dimensionality of information presented to the human and enhancing the expressional capacity of the human to convey intent to the informatic system.
background
process
Theoretical Framework ... optional
Materials and Methods (or just Methods)
A series of experiences leading to experimental basis for formal study
Results
Discussion
Conclusions ...
Acknowledgments ... usually up front in a dissertation
References
Figures ... distributed throughout dissertation (include a number, title and caption for each figure)
Tables ... distributed throughout dissertation (include a number title for each table, and footnotes as needed)
develop a, reference architecture for designing and refining interactive
systems in ways which increase operational throughput of information. This increased throughput is achieved by extending the perceptual dimensionality of information presented to the human and enhancing the expressional capacity of the human to convey intent to the informatic system.
The following topics, considered to be the basis for the work, will be discussed
The context and initial motivation for this effort
An overview of the field of interactive
Intentional interaction through the human-computer interface systems
interface systems for Intentional human-computer interaction
What is a system
A linked group of sets dynamically interacting as a whole
What is an interface
The transitional boundary where information or energy is exchanged
What is ment by term… interactive
A system which iteratively responds in a way which is influenced by both the current state of the system
A descriptive review of key elements of each component involved in such a system
Boundaries and energy flux
-The physiology of information processing
the physicality
information and energy
the bio-chemical-electro-magnetic-phono-mechanic dynamics
the dynamicity –
flux of information conveying energy
the sensory systems
afferent information
the transmission-filtering-integrating- “ structuralizing ” systems
the neuro-psycho interface…
structural correlates and their measure of energetic dynamic interaction
dynamic flux patterns of energy which correspond with intentional interaction
the effector systems
-The human to computer interface components
physio-modulated energy flux dynamics
concurrent
-The computer to human interface system
primary modalities
visual
aural
haptic
olfactory
General Methodology
Activity-Dependent Regulation of Neuronal
Conductances i.e. Active Vision
Adaptive Filtering
Adaptive Control
Command Neurons and Command Systems
Collective Behavior of Coupled Oscillators
Cooperative Behavior in Networks of Chaotic Elements
Adaptive Signal Processing
Chaos in Neural Systems
Chaos in Axons
Associative Networks
Chains of Coupled Oscillators
Auditory Cortex
Auditory Periphery and Cochlear Nucleus
Basal Ganglia
Cerebellum and Conditioning
Cerebellum and Motor Control
Cognitive Maps
Cognitive Modeling:
Collicular Visuomotor Transformations for Saccades
Color Perception
Competitive Learning
Conditioning
Symbolic Representations
Consciousness,
Constrained
Optimization
Convolutional Networks for Images, Speech, and Time Series
Cooperative Phenomena Corollary Discharge in
Visuomotor Coordination
Cortical Columns, Modules, and Hebbian Cell Assemblies
Coulomb Potential Learning
Stomatosonic rendering System
Data Clustering and Learning
Dendritic Processing
Dendritic Spines
Developmental Disorders
Development and Regeneration of Eye-Brain Maps
Diffusion Models of Neuron Activity
Digital VLSI for Neural Networks
Directional Selectivity in the Cortex
Directional Selectivity in the Retina
Disease: Neural Network Models
Dissociation’s Between Visual Processing Modes
Distortions in Human Memory Distributed Artificial
Intelligence
Dynamic Clamp: Computer-Neural Hybrids
Echolocation: Creating Computational Maps
EEG Analysis
Electrolocation
Emotion and Computational Neuroscience
Emotion-Cognition Interactions
Energy Functions for Neural Networks
Epilepsy: Network
Models of Generation
Expert Systems and Decision Systems Using Neural
Networks
Exploration in Active Learning
Eye-Hand Coordination in
Reaching Movements
Face Recognition
Fault Tolerance
Figure-Ground Separation
Forecasting
Fractal Strategies for Neural Network Scaling
Reflexes
Fuzzy Logic Systems and Qualitative Knowledge
Pattern Recognition
Gait Transitions
Gaze Coding in the Posterior Parietal Cortex
Generalization and Regularization in Nonlinear Systems
Geometrical Principles
in Motor Control
Grasping Movements: Visuomotor Transformations
Habituation Half-Center Oscillators
Underlying Rhythmic Movements
Head Movements: Multidimensional Modeling
Hebbian Synaptic Plasticity
Hebbian Synaptic Plasticity: Comparative and
Developmental Aspects
Hippocampus:
Spatial Models
Human Movement: A System-Level Approach
Identification and Control
Illusory Contour Formation
Information Theory
and
Visual Plasticity
Channels: Keys to Neuronal Specialization
Language Change
Language Processing
Layered Computation in Neural Networks
Theoretical Bounds
Learning and Generalization:
Learning and Statistical Inference
Learning as Adaptive Control of Synaptic Matrices
Symbolic and Neural Methods
Quantization
Lesioned Attractor Networks as Models of
Neuropsychological Deficits
: Neural Control
Linguistic Morphology
Localized Versus Distributed Representations
Components and Mechanisms
Mental Arithmetic
Minimum Description Length Analysis
Model-Reference Adaptive Control
Modular and Hierarchical Systems
Modular Neural Systems,
Motion Perception
Motion Perception: Self-Organization
Motivation Motoneuron Recruitment
Motor Control, Biological and Theoretical S Motor Pattern
Generation
Multiprocessor Simulation of Neural Networks
Muscle Models
A Model for Visual Pattern Recognition
Neural Optimization
Neuroanatomy in a Computational Perspective
Neuromodulation Systems
Neurosimulators
Neurosmithing: Improving Neural Network Learning
NMDA Receptors: Synaptic, Cellular, and Network Models
Noise Canceling and Channel Equalization
Object Recognition
Ocular Dominance and Orientation Columns
Olfactory Bulb
Olfactory Cortex
Optical Architectures for Neural Network Implementations
Optical Components for Neural Network Implementations
Optimization Principles in Motor Control
Oscillatory and Bursting Properties of Neurons
Oscillatory Associative Memories
Neural Networks
Parallel Computational Models
Pattern Formation, Biological
Pattern Recognition
Perception of Three-Dimensional Structure
Perceptual Grouping
Perspective on Neuron Model Complexity
Analysis of Neural Activity
Philosophical Issues in Brain Theory
Potential Fields and Neural Networks
Pursuit Eye Movements
Radial Basis Function Networks
Reaching: Coding in Motor Cortex
Reaching Movements: Implications of
Recurrent
Reactive Systems
Respiratory Rhythm Generation
Retina
Robot Control
Reactive Robotic Systems
Routing Networks in Visual Cortex
Selective Visual Attention
Self-Organization and the Brain
Self-Organization in the Time Domain
Self-Organizing
Self-Reproducing
Sensor Fusion
Sensorimotor Learning
Single-Cell Models
Sensory Coding and Information Theory
Short-Term Memory
Annealing
Somatosensory System
Somatotopy: Plasticity of Sensory Maps
Sound Localization and Binaural Processing Sparse
Coding in the Cortex
Sparsely Coded Neural Networks
Spatiotemporal Association in Neural Networks
Speaker Identification
Speech Recognition: A Hybrid Approach
Speech Recognition: Feature Extraction
Speech Recognition: Pattern Matching
Spinal Cord : Generation of Locomotor Patterns
Statistical Mechanics of Generalization
Stereo Correspondence and Neural Networks
Stochastic Approximation and Neural Network Learning
Structural Complexity and Discrete Neural Networks
Synaptic Coding of Spike Trains
Synaptic Currents, Neuromodulation, and Kinetic Models
Synchronization of
Neuronal Responses as a Putative Binding
Mechanism
Telecommunications
Temporal Pattern Processing
Textured Images:
Modeling and Segmentation
Thalamocortical Oscillations in Sleep and Wakefulness
Thalamus Time
Complexity of Learning
Time Perception:
Problems of Representation and Processing
Topology-Modifying Neural
Traveling Activity Waves
Unsupervised Learning with
Global Objective Functions
Dimension of Neural Networks
Vestibulo-Ocular Reflex: Performance and Plasticity
Vision: Hyperacuity
Visual Coding, Redundancy, and "Feature Detection"
Visual Cortex Cell Types and Connections
Visual Processing of Object Form and Environment Layout
Visual Scene Perception: Neurophysiology
Visual Schemas in Object Recognition and Scene Analysis
Visuomotor Coordination
Coordination
Visuomotor Coordination
Wavelet Dynamics
Wave Propagation in Cardiac Muscle and in Nerve Networks
Perception and performance
Analysis of objects and events
Overview
Strategy for optimization in human information linkages with informatic systems
Theoretical approach to optimize human performance
Concurrent tasking
Compound tasking
Attentional limits
Resource sharing
Reaction times and speeds and accuracy trade offs
Strategies for resource allocation
Control dynamics and supervisory control
Effects of control on performance
Monitoring behavior
Examination of data
Assessment of methodology
Capacity for vigulance and monitoring and searching
Changes in operator efficiency
Psycho physical measurement and theory
Approach
Notion
Notation
Extensive measurement
Representation of phenomena of flux
Utility
Models of discrimination
Parallel psychometric families
Psychophysical methods
Limits
Adjustments
Adaptive
Generalizations and alternatives
Signal detection
Psychophysics with weveral variables or channels
Common types of scales
Unidimensional scaling
Absolute identification
Magnitude estimation
Production and matching
Functional measurement
Physiometric systems
Structure of initial thoughts
First principles and derivational methods
Core concepts
Boundary transition flux capacity
Universe of discourse
What am I claiming
Why am I claiming it
How is it validated
Phenomenological
Experiential
Significance
The state of the art
The experience
The contributing effort
The methods
The analysis
The assessment
The interpretation
Summary
11111111111111111
Physiometric systems
Structure of thoughts
The change of information in the experiential zone is related to the zone of the external by a zone of bio-transmittal
The probability of effective transmissive
First principles and derivational methods
Derivational bias
Ontologic—epistemologic- phenomenologic
Ontologic—---empiric—epistemologic –theoretic--- phenomenologic
The necessary and sufficient conditions for the existence of information is to have non-zero significance
The state of detection
The state of preparation
The state of operation
Information is differential from the energy which conveys it
Observation –
Description
Abstraction
Notation
Model
System
Observation --
An exchange of information between the an experienced perceptual state and an external physical state is mediated by a biologic / physiologic information transporter system
This system is multi modal – multi scale – concurrent hetero-purpose poly-dyno- morphic simul-tasking
Core concepts
Humans and computers exchange information
The exchange of that information can be abstracted
Instance – data
Difference –information
Significance - knowledge
Context- understanding
Experience- belief
The flow of information can be parameterized by temporal, spatial, ergo-dyno-morphic flux
Any state of information is characterized by a specific state-space parameter set.
The flow of information and its temporal spatial ergo-dyno-morphic flux can be can be parsed into three fundamental prime state-spaces
Directly experienced
Biologically mediated
Externally apparent
Diagrammatic info – flow
An ordering of the of the flow of information between the apparent principle subspaces can be represented in a way which is consistent with observations
Information state-spaces and their subspaces are defined by the “state-space” specific / subspace specific modalities of information flow
Any state of information can be represented as a point in a complex hyper-dimensional state-space
Expressional formulation
Derivational symbology
Notational examples
Inter-state-space flow
Intra state-space flow
Transproduction
The nature of the field of intentional interaction with the computer for the purpose if instigating the emergence of a desired future state
Concurrent multi-stream info-flux
Concurrent poly
Universe of discourse
What am I claiming
Why am I claiming it
How is it validated
The nature of the field
Phenomenological
Experiential
Significance
The state of the art
The experience
EEG
Chaos
Visualization
Interface devices
The contributing effort
In the context of The Clinical need
Established existence proof of utility of concept and implementation
Developed experimental systems of instrumentation and software
Designed operational method of application assessment and iterative refinement for case specific interface systems
Perceptual
Expressional
Rendering
Sensing
Computing
Communication
Computer graphics
Spatial audio
Somato sensory stimulation
EEG
Gloves
Pressure sensors
Voice input
Bio sensors
Mechanical sensors
Photo-electri sensors
TNGS
NEATTOOLS
Neuro rehab workstation
Smart desk
Grokbox
Bot masters
Intermental net
DMI
The methods
Assessment of neurologic function
Psychomotor function
Intra operative monitoring
Function recovery
Therapeutic effect
Cognitive function
Skill acquisition
Knowledge acquisition
Track performance
The analysis
Assess the
The assessment
Mental modulation of physio informatic systems can be monitored and tracked in a iteratively refining way
The interpretation
Intermental net
Summary
Basic sensory process
stimulus
Light
Sound
Time
Space
Spatial configuration and contrast
Supportability separate ability
Physiology
Olfactory
Optical
Visual information processing
Spatial filtering
Properties parts and objects
Spectral sensitivity
Spatial temporal factors
Threshold variability
Adaptation and changes in sensitivity
Symbology and sequence
Auditory
Aural
Loudness
Pitch
Localization
Auditory information processing
Auditory pattern recognition
Speech perception
Vestibular
Proprioceptive
Motor control
Haptic
Kinesthesia
Intersensory interactions
Experentiality
Perception organization and cognition
The development of a descriptive mathematical model that can map the transformation of information as it is exchanged between various components of the
interactive human-computer interface system.
descriptive mathematical model -- a formal symbol system
universe of discourse – experience
definition
derivation of the notation
Symbology
methodology
-
geometry
graphic
The development of hardware and software systems based on principles derived from the reference architecture,
Neat software, in its four
generations:
Neat Software
Introduction -- incl. overall design philosophy
Needed to develop a tool to link emergent hardware to emergent software
Software ---
QSI-AVS-
Link-modeler
Glove talker
Neat DOS -- first generation
JOJO
BEC
NEAT
Neat Java – transitional
NPAC-JAVA-
JOJO
GUO
Neat Win – transitional
Really neat
JOJO
NeatTools -- fourth generation
COM
EJ
Mouse
representative ntl files and application areas
and similarly one on hardware:
Hardware:
TNGs and widgits
Intro -- design philosophy; microcontroller technology; ...
TNG-1 -- EMG
TNG-2 -- 4 analog input channels
TNG-3 -- 16 input channels (first production version)
TNG-4 -- ~32 channels bi-directional
Widgits -- sensors and transducers
Representative Applications
Basic neuroscience
The following abstracts demonstrate the application of dynamical analysis to physiological signals and show that it is possible to characterize abnormal electrophysiological rhythms as low dimensional attractors.
n Sale EJ, Warner DJ, Price S, Will AD. Compressed complexity parameter. Preceedings of the 2nd International Brain Topograpy Conference., Toronto, Ontario. 1991
n Warner DJ, Price SH, Sale EJ, Will AD. Chaotropic dynamical analysis of the EEG. Brain Topography. 1990.
n Warner DJ, Price SH, Sale EJ, Will AD. Chaotropic Dynamical Analysis of the EEG. Electroecephalography and Clinical Neurophysiology. 1990.
n Warner D, Will AD. Dynamical analysis of EEG: evidence for a low-dimensional attractor in absence epilepsy. Neurology. 1990 April;40(1):351.
The following abstract introduces the possibility of quantitatively correlating movement related potentials recorded over the scalp with complex motor tasks using human-computer interface technology
n Warner DJ, Will AD, Peterson GW, Price SH, Sale EJ, Turley SM. Quantitative motion analysis instrumentation for movement related potentials. Electroencephalography and Clinical Neurophysiology. 1991;79:29-30.