The Age of Bionics: Merging Man & machine

Rage

DFI TEAM
Senior Member
Joined
Feb 23, 2009
Messages
5,419
Likes
1,001
Bionics​

bi-on-ics

Etymology: from bi (as in “life”) + onics (as in “electronics”); the study of
mechanical systems that function like living organisms or parts
of living organisms


From: The National Geographic


By Josh Fischman
Photograph by Mark Thiessen



Amanda Kitts is mobbed by four- and five-year-olds as she enters the classroom at the Kiddie Kottage Learning Center near Knoxville, Tennessee. "Hey kids, how're my babies today?" she says, patting shoulders and ruffling hair. Slender and energetic, she has operated this day-care center and two others for almost 20 years. She crouches down to talk to a small girl, putting her hands on her knees.

"The robot arm!" several kids cry.

"Make it do something silly!" one girl says.

"Silly? Remember how I can shake your hand?" Kitts says, extending her arm and rotat*ing her wrist. A boy reaches out, hesitantly, to touch her fingers. What he brushes against is flesh-colored plastic, fingers curved slightly inward. Underneath are three motors, a metal frame, and a network of sophisticated electronics. The assembly is topped by a white plastic cup midway up Kitts's biceps, encircling a stump that is almost all that remains from the arm she lost in a car accident in 2006.

Almost all, but not quite. Within her brain, below the level of consciousness, lives an intact image of that arm, a phantom. When Kitts thinks about flexing her elbow, the phantom moves. Impulses racing down from her brain are picked up by electrode sensors in the white cup and converted into signals that turn motors, and the artificial elbow bends.

"I don't really think about it. I just move it," says the 40-year-old, who uses both this standard model and a more experimental arm with even more control. "After my accident I felt lost, and I didn't understand why God would do such a terrible thing to me. These days I'm just excited all the time, because they keep on improving the arm. One day I'll be able to feel things with it and clap my hands together in time to the songs my kids are singing."




Kitts is living proof that, even though the flesh and bone may be damaged or gone, the nerves and parts of the brain that once controlled it live on. In many patients, they sit there waiting to commu*nicate—dangling telephone wires, severed from a handset. With microscopic electrodes and surgical wizardry, doctors have begun to connect these parts in other patients to devices such as cameras and microphones and motors. As a result, the blind can see, the deaf can hear, and Amanda Kitts can fold her shirts.

http://www.youtube.com/watch?v=mUe-FlsL8Uo

Kitts is one of "tomorrow's people," a group whose missing or ruined body parts are being replaced by devices embedded in their nervous systems that respond to commands from their brains. The machines they use are called neural prostheses or—as scientists have become more comfortable with a term made popular by science fiction writers—bionics. Eric Schremp, who has been a quadriplegic since he shattered his neck during a swimming pool dive in 1992, now has an electronic device under his skin that lets him move his fingers to grip a fork. Jo Ann Lewis, a blind woman, can see the shapes of trees with the help of a tiny camera that communicates with her optic nerve. And Tammy Kenny can speak to her 18-month-old son, Aiden, and he can reply, because the boy, born deaf, has 22 electrodes inside his ear that change sounds picked up by a microphone into signals his auditory nerve can understand.

The work is extremely delicate, a series of trials filled with many errors. As scientists have learned that it's possible to link machine and mind, they have also learned how difficult it is to maintain that connection. If the cup atop Kitts's arm shifts just slightly, for instance, she might not be able to close her fingers. Still, bionics represents a big leap forward, enabling researchers to give people back much more of what they've lost than was ever possible before.

"That's really what this work is about: restoration," says Joseph Pancrazio, program director for neural engineering at the National Institute of Neurological Disorders and Stroke. "When a person with a spinal-cord injury can be in a res*taurant, feeding himself, and no one else notices, that is my definition of success."

A history of body-restoration attempts, in the form of man-made hands and legs and feet, lines the shelves in Robert Lipschutz's office at the Rehabilitation Institute of Chicago (RIC). "The basic technology of prosthetic arms hasn't changed much in the last hundred years," he says. "Materials are different, so we use plastic instead of leather, but the basic idea has been the same: hooks and hinges moved by cables or motors, controlled by levers. A lot of amputees coming back from Iraq get devices like these. Here, try this on." Lipschutz drags a plastic shell off one of his shelves.



It turns out to be a left shoulder and arm. The shoulder part is a kind of breastplate, secured across the chest by a harness. The arm, hinged at the shoulder and elbow, ends in a metal pincer. To extend the arm, you twist your head to the left and press a lever with your chin, and use a little body English to swing the limb out. It is as awkward as it sounds. And heavy. After 20 minutes your neck hurts from the odd posture and the effort of pressing the levers. Many ampu*tees end up putting such arms aside.

"It's hard for me to give people these devices sometimes," Lipschutz says, "because we just don't know if they will really help." What could help more, he and others at RIC think, is the kind of prosthesis Amanda Kitts has volunteered to test—one controlled by the brain, not by body parts that normally have nothing to do with moving the hand. A technique called targeted muscle reinnervation uses nerves remaining after an amputation to control an artificial limb. It was first tried in a patient in 2002. Four years later Tommy Kitts, Amanda's husband, read about it on the Internet as his wife lay in a hospital bed after her accident. The truck that had crushed her car had also crushed her arm, from just above the elbow down.

"I was angry, sad, depressed. I just couldn't accept it," she says. But what Tommy told her about the Chicago arm sounded hopeful. "It seemed like the best option out there, a lot better than motors and switches," Tommy says. "Amanda actually got excited about it." Soon they were on a plane to Illinois.

Todd Kuiken, a physician and biomedical engineer at RIC, was the person responsible for what the institute had begun calling the"bionic arm." He knew that nerves in an amputee's stump could still carry signals from the brain. And he knew that a computer in a prosthesis could direct electric motors to move the limb. The problem was making the connection. Nerves conduct electricity, but they can't be spliced together with a computer cable. (Nerve fibers and metal wires don't get along well. And an open wound where a wire enters the body would be a dangerous avenue for infections.)




Kuiken needed an amplifier to boost the signals from the nerves, avoiding the need for a direct splice. He found one in muscles. When muscles contract, they give off an electrical burst strong enough to be detected by an electrode placed on the skin. He developed a technique to reroute severed nerves from their old, damaged spots to other muscles that could give their signals the proper boost.


In October 2006 Kuiken set about rewiring Amanda Kitts. The first step was to salvage major nerves that once went all the way down her arm. "These are the same nerves that work the arm and hand, but we had to create four different muscle areas to lead them to," Kuiken says. The nerves started in Kitts's brain, in the motor cortex, which holds a rough map of the body, but they stopped at the end of her stump—the disconnected telephone wires. In an intricate operation, a surgeon rerouted those nerves to different regions of Kitts's upper-arm muscles. For months the nerves grew, millimeter by milli*meter, moving deeper into their new homes.

"At three months I started feeling little tingles and twitches," says Kitts. "By four months I could actually feel different parts of my hand when I touched my upper arm. I could touch it in different places and feel different fingers." What she was feeling were parts of the phantom arm that were mapped into her brain, now recon*nected to flesh. When Kitts thought about moving those phantom fingers, her real upper-arm muscles contracted.

A month later she was fitted with her first bionic arm, which had electrodes in the cup around the stump to pick up the signals from the muscles. Now the challenge was to convert those signals into commands to move the elbow and hand. A storm of electrical noise was coming from the small region on Kitts's arm. Somewhere in there was the signal that meant "straighten the elbow" or "turn the wrist." A microprocessor housed in the prosthesis had to be programmed to fish out the right signal and send it to the right motor.




Finding these signals has been possible because of Kitts's phantom arm. In a lab at the RIC Blair Lock, a research engineer, fine-tunes the programming. He has Kitts slide off the artificial arm so that he can cover her stump with electrodes. She stands in front of a large flat-panel TV screen that displays a disembodied, flesh-colored arm floating in blue space—a visualization of her phantom. Lock's electrodes pick up commands from Kitts's brain radiating down to her stump, and the virtual arm moves.

In a hushed voice, so as not to break her concentration, Lock asks Kitts to turn her hand, palm in. On-screen, the hand turns, palm in. "Now extend your wrist, palm up," he says. The screen hand moves. "Is that better than last time?" she asks. "Oh yeah. Strong signals." Kitts laughs. Now Lock asks her to line up her thumb along*side her fingers. The screen hand obliges. Kitts opens her eyes wide. "Wow. I didn't even know I could do that!" Once the muscle signals asso*ciated with a particular movement are identified, the computer in the arm is programmed to look for them and respond by activating the correct motor.




Kitts practiced using her arm one floor below Kuiken's office in an apartment set up by occu*pational therapists with everything a newly equipped amputee might ordi*narily use. It has a kitchen with a stove, silverware in a drawer, a bed, a closet with hangers, a bathroom, stairs—things people use every day without a second thought but that pose huge obstacles to someone missing a limb. Watching Kitts make a peanut butter sandwich in the kitchen is a startling expe*rience. With her sleeve rolled back to reveal the plastic cup, her motion is fluid. Her live arm holds a slice of bread, her artificial fingers close on a knife, the elbow flexes, and she swipes peanut butter back and forth.

"It wasn't easy at first," she says. "I would try to move it, and it wouldn't always go where I wanted." But she worked at it, and the more she used the arm, the more lifelike the motions felt. What Kitts would really like now is sensation. That would be a big help in many actions, includ*ing one of her favorites*—gulping coffee.

"The problem with a paper coffee cup is that my hand will close until it gets a solid grip. But with a paper cup you never get a solid grip," she says. "That happened at Starbucks once. It kept squeezing until the cup went 'pop.' "

There's a good chance she'll get that sensation, says Kuiken, again thanks to her phantom. In partnership with bioengineers at the Johns Hopkins University Applied Physics Laboratory, RIC has been developing a new prototype for Kitts and other patients that not only has more flexibility—more motors and joints—but also has pressure-sensing pads on the fingertips. The pads are connected to small, pistonlike rods that poke into Kitts's stump. The harder the pressure, the stronger the sensation in her phantom fingers.

"I can feel how hard I'm grabbing," she says. She can also tell the difference between rubbing something rough, like sandpaper, and smooth, like glass, by how fast the rods vibrate. "I go up to Chicago to experiment with it, and I love it," she says. "I want them to give it to me already so I can take it home. But it's a lot more complicated than my take-home arm, so they don't have it completely reliable yet."




Eric Schremp, unlike Kitts, doesn't need arti*ficial hands. He just needs his natural ones to work. They haven't done that on their own since Schremp broke his neck in 1992, leaving him a quadriplegic. Now, however, the 40-year-old Ohio man can grip a knife or a fork.

He can do this because of an implanted device developed by Hunter Peckham, a biomedical engineer at Case Western Reserve University in Cleveland. "Our goal is to restore hand grasping," Peckham says. "Hand use is key to independence."




Schremp's finger muscles and the nerves that control them still exist, but the signals from his brain have been cut off at the neck. Peckham's team ran eight micro-thin electrodes from Schremp's chest under the skin of his right arm, ending at the finger muscles. When a muscle in his chest twitches, it triggers a signal that's sent via a radio transmitter to a small com*puter hanging from his wheelchair. The computer in*terprets the signal and radios it back to a receiver implanted in his chest, where the signal is sent by wires down Schremp's arm to his hand. There the signal tells his finger muscles to close in a grip—all within a microsecond.

"I can grab a fork and feed myself," Schremp says. "That means a lot."

About 250 people have been treated with this technique, which is still experimental. But another bionic device has shown that the marriage of mind and machine can be both powerful and enduring, having been implanted in nearly 200,000 people around the world during the past 30 years. That device is the cochlear implant, and Aiden Kenny is among the latest recipients. Tammy Kenny, his mother, remembers when, a year ago, she learned that her baby was beyond the help of hearing aids.

"I would just hold him in my arms and cry," she says, "knowing he couldn't hear me. How would he ever get to know me? One time, my hus*band banged pots to*gether, hop*ing for a re*sponse." Aiden never heard the noise.

He hears banging pots now. In February 2009 surgeons at Johns Hopkins Hospital snaked thin lines with 22 electrodes into each cochlea, the part of the inner ear that normally detects sound vibrations. In Aiden, a microphone picks up sounds and sends signals to the electrodes, which pass them directly to the nerves.




"The day they turned on the implant, a month after surgery, we noticed he responded to sound," Tammy Kenny says. "He turned at the sound of my voice. That was amazing." Today, she says, with intensive therapy, he's picking up language, quickly catching up to his hearing peers.

Bionic eyes may soon follow bionic ears. Jo Ann Lewis lost her sight years ago to ret*initis pigmentosa, a degenerative disease that destroys light-detecting cells in the eyes called rods and cones. Lately, however, she has partially regained her vision as a result of research by Mark Humayun, an ophthalmologist at the University of Southern California and a company called Second Sight.

As is common with this disease, part of an inner layer of her retina had survived. This layer, filled with bipolar and ganglion cells, normally gathers signals from outer rods and cones and passes them to fibers that fuse into the optic nerve. No one knew what language the inner retina spoke or how to feed it images it could understand. But in 1992, Humayun began laying, for a short time, a tiny electrode array on the retinas of RP patients undergoing surgery for other reasons.



"We asked them to follow a dot, and they could," he says. "They could see rows, and they could see columns." After another decade of testing, Humayun and his colleagues devel*oped a system they dubbed Argus. (Greek myth*ology. A giant. Hundreds of eyes.) Patients got a pair of dark glasses with a tiny video camera mounted on them, along with a radio transmitter. Video signals were beamed to a computer worn on a belt, translated to electrical impulse patterns understood by ganglion cells, and then beamed to a receiver resting behind the ear. From there a wire took them inside the eye, to a square array of 16 electrodes gently attached to the retinal surface. The impulses triggered the electrodes. The electrodes triggered the cells. Then the brain did the rest, enabling these first patients to see edges and some coarse shapes.

In the fall of 2006 Humayun, Second Sight, and an international team increased the electrodes in the array to 60. Like a camera with more pixels, the new array produced a sharper image. Lewis, from Rockwall, Texas, was among the first to get one. "Now I'm able to see silhouettes of trees again," she says. "That's one of the last things I remember seeing naturally. Today I can see limbs sticking out this way and that."


Pushing the neural prosthetic concept further, researchers are beginning to use it on the brain itself. Scientists behind a project called BrainGate are attempting to wire the motor cortex of completely immobilized patients directly into a computer so that patients can move remote objects with their minds. So far, test subjects have been able to move a cursor around a computer screen. Researchers are even planning to develop an artificial hippocampus, the part of the brain that stores memories, with the intent of implanting it in people with memory loss.

Not everything will work perfectly. One of the four initial BrainGate patients decided to have the plug removed because it interfered with other medical devices. And Jo Ann Lewis says her vision isn't good enough for her to safely cross a street. Today, however, Kitts has a new, more elastic cup atop her arm that better aligns electrodes with nerves that control the arm.

"It means I can do a lot more with the arm," she says. "A new one up in Chicago lets me do lots of different hand grasps. I want that. I want to pick up pennies and hammers and toys with my kids." These are reasonable hopes for a replacement part, Kuiken says. "We are giving people tools. They are better than what previously existed. But they are still crude, like a hammer, compared with the complexity of the human body. They can't hold a candle to Mother Nature."

Still, at least the people using the tools can grab the candle. And some can even see it flicker in the dark.
 

Rage

DFI TEAM
Senior Member
Joined
Feb 23, 2009
Messages
5,419
Likes
1,001
Defense Applications


The following is a 'disclosed' extract from 2006.


Bionics man becoming a reality

04 Apr 2006


In the mid-1970s, when scientists in a popular TV series rebuilt a wounded, barely-living test pilot into the world's first bionic man, making him "better, stronger, faster," the field of medical bionics was the stuff of science fiction.

No longer. On April 3, at Experimental Biology 2006, some of the leading scientists in the rapidly expanding field of bionics explain how much of what was once fiction is today at least partial reality – including electronically-powered legs, arms, and eyes like those given TV's Six Million Dollar Man 30-plus years ago.




The symposium on "The $6 Billion (Hu)Man" is part of the scientific program of the American Association of Anatomists. Bionics, a word that mergesbiology with electronics, means replacing or enhancing anatomical structures or physiological processes with electronic or mechanical components Unlike prostheses, the bionic implant actually mimics the original function, sometimes surpassing the power of the original organ or other body part. Bionics takes place at the interface between bioengineering and anatomy. The AAA scientific program at Experimental Biology also includes a symposium on tissue engineering, another means of replacing organs or organ function.

Dr. William Craelius, Rutgers University, created the first multi-finger prosthesis, combining new understanding of musculoskeletal signaling with advances in human-to-machine communication. In recent years, prosthetic limbs have transformed from the unwieldy designs of the last century into more life-like limb substitutes that give users a more intuitive feel for their adopted limb. The bionic hand system (Dextra) produced by Dr. Craelius and his colleagues uses existing nerve pathways to control individual computer-driven mechanical fingers. Dextra consists of a standard plastic socket and silicone sensor sleeve that encases an amputee's limb below the elbow. After a brief training period, operating the fingers is biomimetic, that is, it is done by normal volitional thinking, as if the user were commanding his natural fingers. Dextra relies on the fact that much of the musculo-tendon control structures that originally operated the fingers are still present and controllable by the user and can be tapped by the proper sensors. As long as the user remembers how to activate his phantom fingers, he can mentally command the new robot fingers. Thus far, users have been able to play slow piano pieces with Dextra, as demonstrated at Epcot Center for the Discover Magazine Innovation of the Year Award ceremony.

In Dr. Scott Delp's Neuromuscular Biomechanics Laboratory at Stanford, digital humans walk across the computer screen, their visible musculoskeletal system revealing the complex interplay of muscles, bones, momentum and gravity that makes up human movement. A few alterations to the computer program that controls the form and function of these mechanisms, and the movements of the previously healthy, agile human on the screen change into those caused by neuromuscular disorders such as stroke, osteoarthritis, or Parkinson's.




Dr. Delp, now chairman of bioengineering at Stanford, helped establish the laboratory, which makes its computerized simulations of biological systems, ranging from molecules to entire organisms, available to scientists and clinicians studying the mechanisms of neuromuscular disease. The simulations also are invaluable in the education of bioengineers and physicians and in the development of new surgeries and medical devices. Delp originated the system that adapts the computerized models to different diseases, even to individual patients. His own work at the interface of bioengineering and medicine illustrates the simulations' widespread applications: he collaborates with physicians at Lucile Packard Children's Hospital in devising new treatments for children with cerebral palsy.

Dr. Homayoon Kazerooni, University of California, Berkeley, is the creator of BLEEX, a wearable robotic system that turns its wearer into a man or woman of incredible strength, able to carry up to 200 pounds with no more effort or strain than it would take to carry 10 pounds. Dr. Kazerooni started his work by understanding the human gait. Then, through the design of a novel actuation system, a network of sensors, a pair of computer controlled strap-on robotic legs, and an intelligent algorithm, he created the BLEEX to follow the wearer's gait faithfully while carrying major loads. As the wearer walks and runs normally on ascending and descending slopes and stairs, the embedded sensors and computers in the robotic legs function like an extension of his or her own nervous system, gathering information on the direction being moved and continually redistributing the weight to make it feel like a barely perceptible burden.

BLEEX created a sensation when it first appeared. The New York Times recognized it as one of the best ideas of 2004 and the military hopes the research will not only help soldiers carry heavy loads for long distances but eventually also help create super-human combat gear. Dr. Kazerooni, who directs the Berkeley Robotics and Human Engineering Laboratory at UC Berkeley, sees BLEEX as having wide range applications in the workforce and service industry, adding power while preventing back and other injuries. The beauty of this type of exoskeleton, he says, is that it combines the intellect of humans and the strength of machines. His laboratory currently is improving the system's speed and flexibility.




Dr. Timothy Marler describes SantosTM, a new kind of complete whole-body virtual (computer-based) human model developed at the University of Iowa's Virtual Soldier Research laboratory. Santos TM combines a highly realistic appearance, real-time simulations, and a relatively complex musculoskeletal structure. Because he will think, move, and act like a real human, he provides both an unique tool to scientists studying the human body and feedback to engineers who are designing and improving products. Unlike virtual mannequins, Santos actually predicts human motion and behavior based on human performance measures, such as energy, joint torque, or discomfort. That means that when trying out a new product, whether protective military clothing or new Army tanks, he can answer questions such as: Is this comfortable? Can I reach this? Am I strong enough to pull this lever? His motion is "task-based," like that of real humans," says Dr. Marler. "We move differently when dodging bullets than we do when sipping tea," he says," and we can model this difference in Santos." Advances in understanding the impact ofanatomy and physics are having substantial impact for a wide variety of peace-time industries as well as those in the military. Currently the Virtual Soldier Research Laboratory is working with TACOM (the department of the Army that designs tractor vehicles), Natick Soldier systems (the department that works with everything on the dismounted soldier, including clothing), Caterpillar, Rockwell, and Honda. –more-

Dr. Daniel Palanker, a physicist in Stanford's Department of Ophthalmology and Hansen Experimental Physics Laboratory, leads the team that recently designed a bionic eye. The eye, actually a retinalprosthesis system, consists of a portable wallet-sized computer processor, a solar or RF-powered battery implanted in the eye, a 3-millimeter (half the size of a grain of rice) light-sensing chip implanted in the retina, and a tiny video camera mounted on virtual-reality style pulsed infrared goggles. The system is designed to do what the eye's own photoreceptors do – or no longer do, in patients with degenerative retinal diseases – which is to stimulate the cells in theretina to perceive images. When tested in rats, the retinal neurons migrate into the porous interface with the subretinal implant and thus provide intimate proximity between the stimulation sites and the neural cells, which is essential for high resolution stimulation. First generation of the system is designed for visual acuity of 20/400, the second for 20/200, and the ultimate target is 20/80 vision. For humans who have lost vision through retinitis pigmentosa, age-related macular degeneration and other diseases that destroy the body's own photoreceptors, 20/80 vision would mean being able to recognize faces and read large print type. Currently there are no effective treatments for these diseases. Human trials of the first generation are expected to begin within two years.






Co-chairs of the symposium are Dr. Daniel Neufeld and Dr. Nicole Grosland, who assembled the panel of experts and also bring their own expertise in biomedical engineering to the symposium.

A professor of anatomy at the University of South Dakota School of Medicine, Dr. Neufeld is helping establish the state's new Biomedical Engineering Ph.D. program at the University of South Dakota School of Medicine and South Dakota School of Mines and Technology. He is perhaps best known for his work in regeneration of fingers and other appendices following amputation. He and colleagues have demonstrated that transplanting fingernail tissue to amputated digits in rats induces bone as well as tissue growth, providing hope for potential use of nail transplantation in human amputees.

Dr. Grosland, who holds a joint appointment in the University of Iowa's departments of biomedical engineering and orthopaedics and rehabilitation, is primarily interested in modeling of musculoskeletal anatomic structures and biomechanics, in order to know how to correct dysfunctions caused by disease, injury or surgical procedure. She is perhaps best known for helping engineer a total artificial wrist implant that has improved the quality of life for more than 100 people with arthritis and other problems causing pain and loss of motion.


From: Federation of American Societies for Experimental Biology
 

Global Defence

New threads

Articles

Top