Mar 11, 2012

Augmenting cognition: old concept, new tools

The increasing miniaturization and computing power of information technology devices allow new ways of interaction between human brains and computers, progressively blurring the boundaries between man and machine. An example is provided by brain-computer interface systems, which allow users to use their brain to control the behavior of a computer or of an external device such as a robotic arm (in this latter case, we speak of “neuroprostetics”).

 

The idea of using information technologies to augment cognition, however, is not new, dating back in 1950’s and 1960’s. One of the first to write about this concept was british psychiatrist William Ross Ashby.

In his Introduction to Cybernetics (1956), he described intelligence as the “power of appropriate selection,” which could be amplified by means of technologies in the same way that physical power is amplified. A second major conceptual contribution towards the development of cognitive augmentation was provided few years later by computer scientist and Internet pioneer Joseph Licklider, in a paper entitled Man-Computer Symbiosis (1960).

In this article, Licklider envisions the development of computer technologies that will enable users “to think in interaction with a computer in the same way that you think with a colleague whose competence supplements your own.” According to his vision, the raise of computer networks would allow to connect together millions of human minds, within a “'thinking center' that will incorporate the functions of present-day libraries together with anticipated advances in information storage and retrieval.” This view represent a departure from the prevailing Artificial Intelligence approach of that time: instead of creating an artificial brain, Licklider focused on the possibility of developing new forms of interaction between human and information technologies, with the aim of extending human intelligence.

A similar view was proposed in the same years by another computer visionnaire, Douglas Engelbart, in its famous 1962 article entitled Augmenting Human Intellect: A Conceptual Framework.

In this report, Engelbart defines the goal of intelligence augmentation as “increasing the capability of a man to approach a complex problem situation, to gain comprehension to suit his particular needs, and to derive solutions to problems. Increased capability in this respect is taken to mean a mixture of the following: more-rapid comprehension, better comprehension, the possibility of gaining a useful degree of comprehension in a situation that previously was too complex, speedier solutions, better solutions, and the possibility of finding solutions to problems that before seemed insoluble (…) We do not speak of isolated clever tricks that help in particular situations.We refer to away of life in an integrated domain where hunches, cut-and-try, intangibles, and the human ‘feel for a situation’ usefully co-exist with powerful concepts, streamlined terminology and notation, sophisticated methods, and high-powered electronic aids.”

These “electronic aids” nowdays include any kind of harware and software computing devices used i.e. to store information in external memories, to process complex data, to perform routine tasks and to support decision making. However, today the concept of cognitive augmentation is not limited to the amplification of human intellectual abilities through external hardware. As recently noted by Nick Bostrom and Anders Sandberg (Sci Eng Ethics 15:311–341, 2009), “What is new is the growing interest in creating intimate links between the external systems and the human user through better interaction. The software becomes less an external tool and more of a mediating ‘‘exoself’’. This can be achieved through mediation, embedding the human within an augmenting ‘‘shell’’ such as wearable computers (…) or virtual reality, or through smart environments in which objects are given extended capabilities” (p. 320).

At the forefront of this trend is neurotechnology, an emerging research and development field which includes technologies that are specifically designed with the aim of improving brain function. Examples of neurotechnologies include brain training games such as BrainAge and programs like Fast ForWord, but also neurodevices used to monitor or regulate brain activity, such as deep brain stimulators (DBS), and smart prosthetics for the replacement of impaired sensory systems (i.e. cochlear or retinal implants).

Clearly, the vision of neurotechnology is not free of issues. The more they become powerful and sophisticated, the more attention should be dedicated to understand the socio-economic, legal and ethical implications of their applications in various field, from medicine to neuromarketing.


 

Jan 27, 2012

A combined robotic and cognitive training for locomotor rehabilitation

A combined robotic and cognitive training for locomotor rehabilitation: evidences of cerebral functional reorganization in two chronic traumatic brain injured patients.

Front Hum Neurosci. 2011;5:146

Authors: Sacco K, Cauda F, D'Agata F, Duca S, Zettin M, Virgilio R, Nascimbeni A, Belforte G, Eula G, Gastaldi L, Appendino S, Geminiani G

Abstract. It has been demonstrated that automated locomotor training can improve walking capabilities in spinal cord-injured subjects but its effectiveness on brain damaged patients has not been well established. A possible explanation of the discordant results on the efficacy of robotic training in patients with cerebral lesions could be that these patients, besides stimulation of physiological motor patterns through passive leg movements, also need to train the cognitive aspects of motor control. Indeed, another way to stimulate cerebral motor areas in paretic patients is to use the cognitive function of motor imagery. A promising possibility is thus to combine sensorimotor training with the use of motor imagery. The aim of this paper is to assess changes in brain activations after a combined sensorimotor and cognitive training for gait rehabilitation. The protocol consisted of the integrated use of a robotic gait orthosis prototype with locomotor imagery tasks. Assessment was conducted on two patients with chronic traumatic brain injury and major gait impairments, using functional magnetic resonance imaging. Physiatric functional scales were used to assess clinical outcomes. Results showed greater activation post-training in the sensorimotor and supplementary motor cortices, as well as enhanced functional connectivity within the motor network. Improvements in balance and, to a lesser extent, in gait outcomes were also found.

Jun 05, 2011

Human Computer Confluence

Human Computer Confluence (HC-CO) is an ambitious initiative recently launched by the European Commission under the Future and Emerging Technologies (FET) program, which fosters projects that investigate and demonstrate new possibilities “emerging at the confluence between the human and technological realms” (source: HC-CO website, EU Commission).

Such projects will examine new modalities for individual and group perception, actions and experience in augmented, virtual spaces. In particular, such virtual spaces would span the virtual reality continuum, also extending to purely synthetic but believable representation of massive, complex and dynamic data. HC-CO also fosters inter-disciplinary research (such as Presence, neuroscience, psychophysics, prosthetics, machine learning, computer science and engineering) towards delivering unified experiences and inventing radically new forms of perception/action.

HC-CO brings together ideas stemming from two series of Presence projects (the complete list is available here) with a vision of new forms of interaction and of new types of information spaces to interact with. It will develop the science and technologies necessary to ensure an effective, even transparent, bidirectional communication between humans and computers, which will in turn deliver a huge set of applications: from today's Presence concepts to new senses, to new perceptive capabilities dealing with more abstract information spaces to the social impact of such communication enabling technologies. Inevitably, these technologies question the notion of interface between the human and the technological realm, and thus, also in a fundamental way, put into question the nature of both.

The long-term implications can be profound and need to be considered from an ethical/societal point of view. HC-CO is, however, not a programme on human augmentation. It does not aim to create a super-human. The idea of confluence is to study what can be done by bringing new types of technologically enabled interaction modalities in between the human and a range of virtual (not necessarily naturalistic) realms. Its ambition is to bring our best understanding from human sciences into future and emerging technologies for a new and purposeful human computer symbiosis.

HC-CO is conceptually broken down into the following themes:

  • HC-CO Data. On-line perception and interaction with massive volumes of data: new methods to stimulate and use human sensory perception and cognition to interpret massive volumes of data in real time to enable assimilation, understanding and interaction with informational spaces. Research should find new ways to exploit human factors (sensory, perceptual and cognitive aspects), including the selection of the most effective sensory modalities, for data exploration. Although not explicitly mentioned, non-sensorial pathways, i.e., direct brain to computer and computer to brain communication could be explored.
  • HC-CO Transit. Unified experience, emerging from the unnoticeable transition from physical to augmented or virtual reality: new methods and concepts towards unobtrusive mixed or virtual reality environment (multi-modal displays, tracking systems, virtual representations...), and scenarios to support entirely unobtrusive interaction. Unobtrusiveness also applies to virtual representations, their dynamics, and the feedback received. Here the challenge is both technological and scientific, spanning human cognition, human machine interaction and machine intelligence disciplines.
  • HC-CO Sense. New forms of perception and action: invent and demonstrate new forms of interaction with the real world, virtual models or abstract information by provoking a mapping from an artificial medium to appropriate sensory modalities or brain regions. This research should reinforce data perception and unified experience by augmenting the human interaction capabilities and awareness in virtual spaces.

In sum, HC-CO is an emerging r&d field that holds the potential to revolutionize the way we interact with computers. Standing at the crossroad between cognitive science, computer science and artificial intelligence, HC-CO can provide the cyberpsychology and cybertherapy community with fresh concepts and interesting new tools to apply in both research and clinical domains.

More to explore:

  • HC-CO initiative: The official EU website the HC-CO initiative, which describes the broad objectives of this emerging research field. 
  • HC2 Project: The horizontal character of HC-CO makes it a fascinating and fertile interdisciplinary field, but it can also compromise its growth, with researchers scattered across disciplines and groups worldwide. For this reason a coordination activity promoting discipline connect, identity building and integration while defining future research, education and policy directions at the regional, national, European and international level has been created. This project is HC2, a three-year Coordination Action funded by the FP7 FET Proactive scheme. The consortium will draw on a wide network of researchers and stakeholders to achieve four key objectives: a) stimulate, structure and support the research community, promoting identity building; b) to consolidate research agendas with special attention to the interdisciplinary aspects of HC-CO; c) enhance the Public Understanding of HC-CO and foster the early contact of researchers with high-tech SMEs and other industry players; d) establish guidelines for the definition of new educational curricula to prepare the next generation of HC-CO researchers.
  • CEED Project: Funded by the HC-CO initiative, the Collective Experience of Empathic Data Systems (CEEDs) project aims to develop “novel, integrated technologies to support human experience, analysis and understanding of very large datasets”. CEEDS will develop innovative tools to exploit theories showing that discovery is the identification of patterns in complex data sets by the implicit information processing capabilities of the human brain. Implicit human responses will be identified by the CEEDs system’s analysis of its sensing systems, tuned to users’ bio-signals and non-verbal behaviours. By associating these implicit responses with different features of massive datasets, the CEEDs system will guide users’ discovery of patterns and meaning within the datasets.
  • VERE Project: VERE - Virtual Embodiment and Robotic Re-Embodiment – is another large project funded by the HC-CO initiative, which aims at “dissolving the boundary between the human body and surrogate representations in immersive virtual reality and physical reality”. Dissolving the boundary means that people have the illusion that their surrogate representation is their own body, and act and have thoughts that correspond to this. The work in VERE may be thought of as applied presence research and applied cognitive neuroscience.

May 21, 2011

Brain-controlled bionic hand for ‘elective amputation’ patient

Source: BBC News — May 18, 2011

An Austrian man has voluntarily had his hand amputated so he can be fitted with a bionic hand, which will be controlled by nerve signals in his own arm. The bionic hands, manufactured by the German prosthetics company Otto Bock, can pinch and grasp in response to signals from the brain. The wrist of the prosthesis can be rotated manually using the patient’s other functioning hand.

The patient will control the hand using the same brain signals that previously powered similar movements in the real hand and that will now be picked up by two sensors placed over the skin above nerves in the forearm.

Pioneering epidural treatment helps paraplegic man stand

A team of scientists at the University of Louisville, UCLA and the California Institute of Technology has developed a new treatment involving continual direct electrical stimulation of the spinal cord. The treatment was successfully tested on a 25-years-old paraplegic man, Rob Summers, who was completely paralysed below the chest in a car accident. The stimulation enabled the man to achieve full weight-bearing standing with assistance provided only for balance for 4·25 min. These breakthrough findings were reported May 20 in the Lancet (early online publication).

 

Oct 17, 2010

Growing neurons on silicon chips

Via Robots.net

Researchers at University of Calgary have developed neurochips capable of capable of interfacing to and sensing activity of biological neurons in very high resolution. The new chips are automated so it's now easy to connect multiple brain cells eliminating the years of training it once required. While researchers say this technology could be used for new diagnostic methods and treatments for a variety of neuro-degenerative diseases, this advancement could ultimately lead to the use of biological neurons in the central or sub-processing units of computers and automated machinery.

 

 

Jul 30, 2010

Sniff-activated sensor may return active lifestyles to paralyzed and disabled

Disabled persons, quadriplegics and others suffering from paralysis may be able to regain movement with a sniff-activated sensor, according to a study by Israeli researchers.

The technology works by translating changes in nasal air pressure into electrical signals that are passed to a computer. Patients can sniff in certain patterns to select letters or numbers to compose text, or on the computer, to control the mouse. For getting around, sniffing controls the direction of the wheelchair, Bloomberg reports.

Quadriplegic patients were able to use the device to navigate wheelchairs as well as healthy people. Two participants who were completely paralyzed but with intact mental function used the technology to communicate by choosing letters on a computer screen to write. The study appears in the Proceedings of the National Academy of Sciences.

Full Story

Feb 04, 2010

Hybrid nanoparticle-organic transistor mimics a synapse

Via MilTech

Nanotechnology researchers in France have developed a hybrid transistor called NOMFET (Nanoparticle Organic Memory Field-Effect Transistor) that shows the main behavior of a biological spiking synapse and can lead to a new generation of neuro-inspired computers, capable of responding in a manner similar to the nervous system. The organic device is made of a molecule called pentacene (an organic semiconductor) and gold nano-particles.

“Basically, we have demonstrated that electric charges flowing through a mixture of an organic semiconductor and metallic nanoparticles can behave the same way as neurotransmitters through a synaptic connection in the brain,” Dominique Vuillaume, a research director at CNRS and head of the Molecular Nanostructures & Devices group at the Institute for Electronics Microelectronics and Nanotechnology (IEMN) tells Nanowerk.

The study is published in the 22 January 2010 issue of the journal Advanced Functional Materials, and can be accessed on Scribd.

Credit: Mil-Tech.com

Dec 08, 2009

Smart Sensors Help Improve Prostheses Personalization

Press release: Sensitive fitting process for leg prostheses

When fitting a leg prosthesis on a patient, clinicians typically have to use a gait laboratory to analyze patient's natural steps. The problem is that only one or two steps can be recorded by the lab, which provides too little information for a comprehensive fitting. Now researchers at the Fraunhofer Institute for Surface Engineering and Thin Films IST in Braunschweig, Germany have developed a sensor system that fits into a prosthesis for a more long term analysis.

The adapter measures 4 x 4 x 3 centimeters and sits at the ankle joint or above the knee. It measure the applied forces in three spatial dimensions and three torque moments. A miniature data logger near the sensor reads out the data and stores them. “This adapter makes it possible to continuously measure the load on a leg prosthesis during different routine activities throughout an entire day,” says IST team leader Dr. Ralf Bandorf. The adapter has eight measuring bridges, each with four strain gauges. These consist of a sputtered insulating layer covered with a metal film. When the patient walks, the layer stretches according to the type of movement performed, and this changes the electrical resistance of the metal film. The 32 strain gauges are placed at a number of different points and in different orientations, so the data provide a complete picture of the load acting on the prosthesis. Strain gauges used in sensor systems normally consist of adhesive films, but in this case the layers are sputtered directly onto the surface. This means they can also be applied to the complex geometries of the adapter, for instance its edges, which would be difficult in the case of adhesive films. Moreover, the film is insensitive to moisture and does not require the use of adhesives.

“The main challenge was to design a suitable geometry for the adapter,” says Dr. Ralf Bandorf. It mustn’t be too large, as there is only limited space available inside the prosthesis, but it has to be large enough to accommodate the strain gauges. The developers are already testing a prototype of the adapter on the first patients, and will present it at the Hannover Messe from April 20 to 24.

Oct 20, 2009

Tweaking Your Neurons

This interesting article, recently appeared in hplusmagazine, reviews the emerging trends in "neuroenhancement"

http://hplusmagazine.com/articles/neuro/tweaking-your-neu...

Neurons

 

Jul 10, 2009

Neuroscience and the military: ethical implications of war neurotechnologies

Super soldiers equipped with neural implants, suits that contain biosensors, and thought scans of detainees may become reality sooner than you think.

In this video taken from the show "Conversations from Penn State", Jonathan Moreno discusses the ethical implications of the applications of neuroscience in modern warfare.

Moreno is David and Lyn Silfen professor and professor of medical ethics and the history and sociology of science at the University of Pennsylvania and was formerly the director of the Center for Ethics at the University of Virginia. He has served as senior staff member for two presidential commissions and is an elected member of the Institute of Medicine of the National Academies.

Jul 06, 2009

Thought-controlled wheelchairs

Via Sentient Development

The BSI-Toyota Collaboration Center (BTCC) is developing a wheelchair that can be navigated in real-time with brain waves. The brain-controlled device can adjust itself to the characteristics of each individual user, thereby improving the efficiency with which it senses the driver's commands. That way, the driver is able to get the system to learn his/her commands (forward/right/left) quickly and efficiently; the system boasts an accuracy rate of 95%.

Feb 16, 2009

The development of personalised cognitive prosthetics

The development of personalised cognitive prosthetics.

Conf Proc IEEE Eng Med Biol Soc. 2008;1:787-90

Authors: Nugent CD, Davies RJ, Donnelly MP, Hallberg J, Hariz M, Craig D, Meiland F, Moelaert F, Bengtsson JE, Savenstedt S, Mulvenna M, Droes RM

Persons suffering from mild dementia can benefit from a form of cognitive prosthetic which can be used to assist them with their day to day activities. Within our current work we are aiming to develop a successful user-validated cognitive prosthetic for persons with mild dementia. We have devised a three phased waterfall methodology to support our developments. Based on the evaluation of the first of these phases which involved the processes of user requirements gathering, prototype development and evaluation of in situ deployment of the technology we have been able to guide the technical development within the second phase of our work. Within this paper we provide an overview of the first phase of our methodology and demonstrate how we have used the results from this to guide the second phase of our work, especially with regards to the notion of personalisation.

Apr 08, 2008

The development of brain-machine interface neuroprosthetic devices

The development of brain-machine interface neuroprosthetic devices.

Neurotherapeutics. 2008 Jan;5(1):137-46

Authors: Patil PG, Turner DA

The development of brain-machine interface technology is a logical next step in the overall direction of neuroprosthetics. Many of the required technological advances that will be required for clinical translation of brain-machine interfaces are already under development, including a new generation of recording electrodes, the decoding and interpretation of signals underlying intention and planning, actuators for implementation of mental plans in virtual or real contexts, direct somatosensory feedback to the nervous system to refine actions, and training to encourage plasticity in neural circuits. Although pre-clinical studies in nonhuman primates demonstrate high efficacy in a realistic motor task with motor cortical recordings, there are many challenges in the clinical translation of even simple tasks and devices. Foremost among these challenges is the development of biocompatible electrodes capable of long-term, stable recording of brain activity and implantable amplifiers and signal processors that are sufficiently resistant to noise and artifact to faithfully transmit recorded signals to the external environment. Whether there is a suitable market for such new technology depends on its efficacy in restoring and enhancing neural function, its risks of implantation, and its long-term efficacy and usefulness. Now is a critical time in brain-machine interface development because most ongoing studies are science-based and noncommercial, allowing new approaches to be included in commercial schemes under development.

Mar 10, 2008

IEEE Spectrum Online reports on prosthethic arm development

Via SentientDevelopment

IEEE Spectrum Online has a special report on the current state of prosthethic arm development, including the latest on Dean Kamen's "Luke Arm" which is being funded by DARPA. There's also an amazing video showing the arm in action.





Dec 04, 2007

Prosthetic Limbs That Can Feel

Via KurzweilAI.net

Researchers at Northwestern University, in Chicago, have shown that transplanting the nerves from an amputated hand to the chest allows patients to feel hand sensation there.

The findings are the first step toward prosthetic arms with sensors on the fingers that will transfer tactile information from the device to the chest, making the wearer feel as though he or she has a real hand.

Full article here 

Oct 22, 2007

DARPA next generation prosthetic arm

The Boston Globe has an article by Scott Kirsner about the next generation of prosthetic limbs under development at DARPA


caf3bcb3064af02420aec0fb0c067cdd.jpg

From the article: 

Without any covering to emulate human skin - what those in the prosthetics field call a "cosmesis" - the arm is distinctly robotic, all metal cylinders and dark gray carbon fiber. I held out my index finger, and Van Der Merwe manipulated the arm so that the index finger and thumb grabbed my fingertip and squeezed lightly. Suddenly, there was a buzzing sound. "That's a sensor in the fingers letting me know how hard I'm squeezing," Van Der Merwe explained. A few minutes later, when I shook hands, the grip was firm (if not warm), and Van Der Merwe chided me for not shaking more vigorously. I didn't want to break the hand and get on the Pentagon's bad side

 

Check the video 

Oct 17, 2007

Intraspinal stimulation for bladder voiding in cats

Neural engineers at Huntington Medical Research Institutes were able to use chronically implanted neuroprosthetic device inside the spinal cord. The device, consisting of an array of micrometer-sized spiny electrodes, was used to treat bladder paralysis in spinal cord-injured animals. The electrodes were located throughout the spinal cord tissue, and stimulation near the middle of the cord in the area called the dorsal gray commissure was most effective in inducing a bladder voiding reflex. Unlike the previously-used approaches of stimulating spinal roots or nerves which contain mixed fibers innervating multiple organs, the intraspinal stimulation was shown to be very specific and induced near-complete bladder emptying.

The article is coming out in the December issue of Journal of Neural Engineering and is available online at http://www.iop.org/EJ/abstract/1741-2552/4/4/002/

 

Oct 10, 2007

Brain radiator

Via New Scientist Invention Blog 

 

 

 

 

 

 

 

 

 

 

 


Researchers at Yamaguchi University in Japan have applied for a patent describing a heat pipe installed over the brain that would allow it to be cooled and prevent epileptic fits in susceptible people.  

read full brain radiator patent

Oct 08, 2007

MIT develops new algorithm to help create prosthetic devices

MIT researchers have developed an algorithmic framework for building prosthetic devices that are controlled by neural signal detectors such as EEG.
 
 
Neural prosthetic devices represent an engineer's approach to treating paralysis and amputation. Here, electronics are used to monitor the neural signals that reflect an individual's intentions for the prosthesis or computer they are trying to use. Algorithms form the link between neural signals that are recorded, and the user's intentions that are decoded to drive the prosthetic device.

Over the past decade, efforts at prototyping these devices have divided along various boundaries related to brain regions, recording modalities, and applications. The MIT technique provides a common framework that underlies all these various efforts.

The research uses a method called graphical models that has been widely applied to problems in computer science like speech-to-text or automated video analysis. The graphical models used by the MIT team are diagrams composed of circles and arrows that represent how neural activity results from a person's intentions for the prosthetic device they are using.

The diagrams represent the mathematical relationship between the person's intentions and the neural manifestation of that intention, whether the intention is measured by an electoencephalography (EEG), intracranial electrode arrays or optical imaging. These signals could come from a number of brain regions, including cortical or subcortical structures.

Until now, researchers working on brain prosthetics have used different algorithms depending on what method they were using to measure brain activity. The new model is applicable no matter what measurement technique is used, according to Srinivasan. "We don't need to reinvent a new paradigm for each modality or brain region," he said.

 
 
1 2 3 4 Next