Jump to content

NASA Tech Tuesday: Seeing is Communicating


NASA

Recommended Posts

  • Publishers

5 min read

Preparations for Next Moonwalk Simulations Underway (and Underwater)

Girl in a wheelchair with a laptop display on a mount
When a physical condition limits mobility, getting around is easier with EyeGaze Edge. The eye-tracking technology integrates with the Ability Drive application used with motorized mobility devices, enabling hands-free control of a wheelchair’s motion.
Credit: EyeGaze Inc.

Communicating when a traumatic brain injury, stroke, or disease has made speech impossible can be daunting. Specialized eye-tracking technology uses eye movement to enable people living with disabilities to connect one-on-one, over the phone, or via the internet.

Eye-tracking systems for computers pinpoint a person’s gaze – where the eye is looking at a screen – by reflecting infrared light off the cornea and capturing it with a camera, using image-processing software to determine the eye’s orientation. The technology isn’t new, but it has become much more widely accessible, thanks in part to a collaboration between NASA’s Jet Propulsion Laboratory in Southern California and a Fairfax, Virginia-based company called Eyegaze Inc.

When the company built the first model in 1988, its computers were bulky, requiring three shipping boxes for equipment and a company staff member to set up the system. That cost limited access, and the learning process could be intimidating. 

In 1998, NASA and Eyegaze entered a public-private partnership via Congressional funding to make the hardware smaller, more portable, and affordable without compromising efficiency. It also reduced the weight of the original system by six times and its volume by nearly the same factor. Other advancements served as a springboard for two more decades of development. By collaborating with JPL, the two entities were able to miniaturize and improve the company’s Eyegaze Edge system and lower costs, eliminating barriers to ownership of this communications technology.

“Working with NASA, we were able to make the device less bulky,” said Preethi Vaidyanathan, an engineer with Eyegaze. “Since then, we integrated the external components into a small camera.” It mounts above or below a standard computer screen and requires less than 15 seconds to calibrate to an individual’s gaze.

Visual Surfing

eyegaze-4.png?w=2048
Minesweeper and other video games adapted to use eye-tracking technology are just one form of entertainment made possible by EyeGaze for people living with disabilities.
Credit: EyeGaze Inc.

As personal electronic devices and internet access became commonplace, Eyegaze customers wanted to do more than type. The company’s work with NASA and other government partners put it in a position to meet that demand.

Eyeworld integrates with computers, mobile phones, and tablets, allowing the Eyegaze camera to function as an external mouse and keyboard. By enabling almost any computer function, it lets users chat online, post to social media, send emails, text, or make phone calls. It’s also possible to change room lighting, adjust thermostat settings, and operate other environmental controls using Amazon Echo and Google Home via pages of specialized buttons with one-glance button controls. 

During the COVID-19 pandemic, Eyegaze integrated communications programs such as Zoom and WhatsApp to allow people to connect with their family and friends. To help combat a sense of isolation, the company added meditation apps and Window Swap, which stream the views from different windows worldwide. Virtual museums take the viewer on guided tours. A music streaming service syncs to favorite music apps and offers the International Radio Garden app to sample music from other cultures. Access to online gaming communities provides another way to connect.

“We are constantly thinking about what the customers want. One thing is freedom of movement, so controlling a wheelchair gives them that to some extent,” said Vaidyanathan. Eyegaze Edge integrates with the Ability Drive application used with motorized mobility devices. Looking at a specific button enables hands-free control of a wheelchair’s motion.

The Right to Speak

Eye Tracking Keyboard Software
Eye-tracking hardware and software make it possible for a person to communicate using the movement of their eyes. This keyboard screen is one of many Eyegaze developed for people with a full range of eye motion. A vertical keyboard is available for those who can only look up and down.
Credit: EyeGaze Inc.

Numerous medical conditions can lead to the kind of physical paralysis making it impossible to speak. Well-publicized brain and spinal cord injuries in athletes have led to broader awareness. But there are a host of other causes, such as cerebral palsy, ALS, multiple sclerosis, muscular dystrophy, and spinal muscular atrophy. These conditions can result in locked-in syndrome, which paralyzes all voluntary muscles except those that control eye movement. Eye-tracking software is a lifeline for patients, using what may be their only remaining voluntary movement, but even that can be impeded. 

Eyegaze Edge measures several eye features, making it possible for the tracker to work even when less of the pupil is visible. The company employs clinical specialists who can troubleshoot issues that may prevent customers from using the system, eye conditions like cataracts, dry eyes, and eyelids that droop, partly covering the pupil.

The company now serves individuals in 44 countries, including nations in Southeast Asia and Africa. Adults, children as young as 18 months old, military veterans, and others can communicate using only their eyes. If only vertical eye movement is possible, Eyegaze Edge offers a special vertical keyboard screen. Pages of commonly used phrases communicate a statement with a single glance. Large, easy-to-use buttons allow patients to communicate directly with healthcare providers and caregivers for everyday needs.

Clinicians use Eyegaze Edge and teach their patients how to communicate using the technology. In some cases, Vaidyanathan said, this technology even allows people to share their final thoughts with family and friends.

“NASA helped us get our technology to the size of a laptop – small and sleek. But we continue to investigate and design our solutions to meet ongoing needs. Communication is a key right, so we must accommodate these different challenges,” she said.

NASA has a long history of transferring technology to the private sector. The agency’s Spinoff publication profiles NASA technologies that have transformed into commercial products and services, demonstrating the broader benefits of America’s investment in its space program. Spinoff is a publication of the Technology Transfer program in NASA’s Space Technology Mission Directorate (STMD).

For more information on how NASA brings space technology down to Earth, visit:

spinoff.nasa.gov

By Margo Pierce
NASA’s Spinoff Publication

View the full article

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Similar Topics

    • By NASA
      Continuing his engagement to deepen international collaboration and promote the peaceful use of space, NASA Administrator Bill Nelson will travel to Lima on Wednesday.
      Nelson will meet with Maj. Gen. Roberto Melgar Sheen, director of Peru’s National Commission for Aerospace Research and Development (CONIDA) Thursday, Nov. 14, and sign a non-binding memorandum of understanding to enhance space cooperation. The memorandum of understanding between NASA and CONIDA will include safety training, a joint feasibility study for a potential sounding rockets campaign, and technical assistance for CONIDA on sounding rocket launches. 
      Nelson will discuss the importance of international partnerships and collaboration in space and celebrate Peru’s signing of the Artemis Accords earlier this year.
      For more information about NASA’s international partnerships, visit:
      https://www.nasa.gov/oiir
      -end-
      Meira Bernstein
      Headquarters, Washington
      202-615-1747
      meira.b.bernstein@nasa.gov
      Share
      Details
      Last Updated Nov 13, 2024 LocationNASA Headquarters Related Terms
      Office of International and Interagency Relations (OIIR) Bill Nelson View the full article
    • By NASA
      This illustration shows a red, early-universe dwarf galaxy that hosts a rapidly feeding black hole at its center. Using data from NASA’s James Webb Space Telescope and Chandra X-ray Observatory, a team of astronomers have discovered this low-mass supermassive black hole at the center of a galaxy just 1.5 billion years after the Big Bang. It is pulling in matter at a phenomenal rate — over 40 times the theoretical limit. While short lived, this black hole’s “feast” could help astronomers explain how supermassive black holes grew so quickly in the early universe.NOIRLab/NSF/AURA/J. da Silva/M. Zamani A rapidly feeding black hole at the center of a dwarf galaxy in the early universe, shown in this artist’s concept, may hold important clues to the evolution of supermassive black holes in general.
      Using data from NASA’s James Webb Space Telescope and Chandra X-ray Observatory, a team of astronomers discovered this low-mass supermassive black hole just 1.5 billion years after the big bang. The black hole is pulling in matter at a phenomenal rate — over 40 times the theoretical limit. While short lived, this black hole’s “feast” could help astronomers explain how supermassive black holes grew so quickly in the early universe.
      Supermassive black holes exist at the center of most galaxies, and modern telescopes continue to observe them at surprisingly early times in the universe’s evolution. It’s difficult to understand how these black holes were able to grow so big so rapidly. But with the discovery of a low-mass supermassive black hole feasting on material at an extreme rate so soon after the birth of the universe, astronomers now have valuable new insights into the mechanisms of rapidly growing black holes in the early universe.
      The black hole, called LID-568, was hidden among thousands of objects in the Chandra X-ray Observatory’s COSMOS legacy survey, a catalog resulting from some 4.6 million Chandra observations. This population of galaxies is very bright in the X-ray light, but invisible in optical and previous near-infrared observations. By following up with Webb, astronomers could use the observatory’s unique infrared sensitivity to detect these faint counterpart emissions, which led to the discovery of the black hole.
      The speed and size of these outflows led the team to infer that a substantial fraction of the mass growth of LID-568 may have occurred in a single episode of rapid accretion.
      LID-568 appears to be feeding on matter at a rate 40 times its Eddington limit. This limit relates to the maximum amount of light that material surrounding a black hole can emit, as well as how fast it can absorb matter, such that its inward gravitational force and outward pressure generated from the heat of the compressed, infalling matter remain in balance.
      These results provide new insights into the formation of supermassive black holes from smaller black hole “seeds,” which current theories suggest arise either from the death of the universe’s first stars (light seeds) or the direct collapse of gas clouds (heavy seeds). Until now, these theories lacked observational confirmation.
      The new discovery suggests that “a significant portion of mass growth can occur during a single episode of rapid feeding, regardless of whether the black hole originated from a light or heavy seed,” said International Gemini Observatory/NSF NOIRLab astronomer Hyewon Suh, who led the research team.
      A paper describing these results (“A super-Eddington-accreting black hole ~1.5 Gyr after the Big Bang observed with JWST”) appears in the journal Nature Astronomy.
      About the Missions
      NASA’s Marshall Space Flight Center manages the Chandra program. The Smithsonian Astrophysical Observatory’s Chandra X-ray Center controls science operations from Cambridge, Massachusetts, and flight operations from Burlington, Massachusetts.
      The James Webb Space Telescope is the world’s premier space science observatory. Webb is solving mysteries in our solar system, looking beyond to distant worlds around other stars, and probing the mysterious structures and origins of our universe and our place in it. Webb is an international program led by NASA with its partners, ESA (European Space Agency) and CSA (Canadian Space Agency).
      Read more from NASA’s Chandra X-ray Observatory.
      Learn more about the Chandra X-ray Observatory and its mission here:
      https://www.nasa.gov/chandra
      https://chandra.si.edu
      News Media Contact
      Elizabeth Laundau
      NASA Headquarters
      Washington, DC
      202-923-0167
      elizabeth.r.landau@nasa.gov
      Lane Figueroa
      Marshall Space Flight Center, Huntsville, Alabama
      256-544-0034
      lane.e.figueroa@nasa.gov
      View the full article
    • By NASA
      1 min read
      Preparations for Next Moonwalk Simulations Underway (and Underwater)
      Shauntina Lilly, a NASA Glenn public affairs officer, speaks to students about NASA’s available internships and educational resources during the STEM Goes Red for Girls event at Great Lakes Science Center, home of the NASA Glenn Visitor Center, on Oct. 21.Credit: NASA/Debbie Welch NASA’s Glenn Research Center in Cleveland supported this year’s STEM Goes Red for Girls event at Great Lakes Science Center on Oct. 21. The program provides seventh and eighth grade students exposure to some of Greater Cleveland’s leading STEM companies. The event also featured a hands-on exhibitor fair, speed mentoring, and educational classes. 
      Hosted by the American Heart Association, this year’s event welcomed its largest audience to date with 352 students and educators from 32 schools within Northeast Ohio. NASA Glenn’s presence focused heavily on internships and career advice, but also highlighted the center’s work with the Space Communications and Navigation program’s Deep Space Network. Glenn’s Julie Sufka also served as a mentor, speaking to young girls about STEM opportunities in mathematics.  
      Return to Newsletter Explore More
      1 min read NASA Glenn Chief Counsel Named to CSU Law Hall of Fame 
      Article 2 mins ago 5 min read NASA Funds New Studies Looking at Future of Sustainable Aircraft
      Article 20 hours ago 4 min read X-59 Fires Up its Engine for First Time on its Way to Takeoff
      Article 7 days ago View the full article
    • By NASA
      4 min read
      Preparations for Next Moonwalk Simulations Underway (and Underwater)
      Coastal locations, such as Drakes Bay on the Point Reyes peninsula in Northern California, are increasingly vulnerable to sea level rise.NOAA/NMFS/WCR/CCO The information will help people who live in coastal areas prepare for impacts caused by rising sea levels.
      Earth’s ocean is rising, disrupting livelihoods and infrastructure in coastal communities around the world. Agencies and organizations are working to prepare people as their world changes around them, and NASA information is helping these efforts.
      The agency’s global data is now available in the sea level section of the Earth Information Center. NASA developed the global sea level change website in collaboration with the U.S. Department of Defense, the World Bank, the U.S. Department of State, and the United Nations Development Programme.  
      The site includes information on projected sea level rise through the year 2150 for coastlines around the world, as well as estimates of how much flooding a coastal community or region can expect to see in the next 30 years. The projections come from data collected by NASA and its partners and from computer models of ice sheets and the ocean, as well as the latest sea level assessment from the Intergovernmental Panel on Climate Change, and other sources.
      “NASA innovates for the benefit of humanity. Our cutting-edge instruments and data-driven information tools help communities and organizations respond to natural hazards and extreme weather, and inform critical coastal infrastructure planning decisions,” said Karen St. Germain, director of the Earth science division at NASA Headquarters in Washington.
      Information to Action
      International organizations such as the World Bank will use the data from the global sea level change site for tasks including the creation of Climate Risk Profiles for countries especially vulnerable to sea level rise.
      The Defense Department will continue to incorporate sea level rise data into its plans to anticipate and respond to hazards posed to its facilities by the effects of rising oceans. Similarly, the State Department uses the information for activities ranging from disaster preparedness to long-term adaptation planning to supporting partners around the world in related efforts.
      “We are at a moment of truth in our fight against the climate crisis. The science is unequivocal and must serve as the bedrock upon which decision-making is built. With many communities around the world already facing severe impacts from sea-level rise, this new resource provides a vital tool to help them protect lives and livelihoods. It also illustrates what is at stake between a 1.5-degree-Celsius world and a current-policies trajectory for all coastal communities worldwide,” said Assistant Secretary-General Selwin Hart, special adviser to the United Nations secretary-general on climate action and just transition.
      Rising Faster
      NASA-led data analyses have revealed that between 1970 and 2023, 96% of countries with coastlines have experienced sea level rise. The rate of that global rise has also accelerated, more than doubling from 0.08 inches (0.21 centimeters) per year in 1993 to about 0.18 inches (0.45 centimeters) per year in 2023.
      As the rate of sea level rise increases, millions of people could face the related effects sooner than previously projected, including larger storm surges, more saltwater intrusion into groundwater, and additional high-tide flood days — also known as nuisance floods or sunny day floods.
      “This new platform shows the timing of future floods and the magnitude of rising waters in all coastal countries worldwide, connecting science and physics to impacts on people’s livelihoods and safety,” said Nadya Vinogradova Shiffer, director of the ocean physics program at NASA Headquarters in Washington.
      Data released earlier this year found that Pacific Island nations will experience at least 6 inches (15 centimeters) of sea level rise in the next 30 years. The number of high-tide flood days will increase by an order of magnitude for nearly all Pacific Island nations by the 2050s.
      “The data is clear: Sea levels are rising around the world, and they’re rising faster and faster,” said Ben Hamlington, a sea level researcher at NASA’s Jet Propulsion Laboratory in Southern California and head of the agency’s sea level change science team. “Having the best information to make decisions about how to plan for rising seas is more crucial than ever.”
      To explore the global sea level change site:
      https://earth.gov/sealevel
      News Media Contacts
       
      Karen Fox / Elizabeth Vlock
      NASA Headquarters, Washington
      202-358-1600
      karen.c.fox@nasa.gov / elizabeth.a.vlock@nasa.gov
      Jane J. Lee / Andrew Wang
      Jet Propulsion Laboratory, Pasadena, Calif.
      818-354-0307 / 626-379-6874
      jane.j.lee@jpl.nasa.gov / andrew.wang@jpl.nasa.gov
      2024-158
      Share
      Details
      Last Updated Nov 13, 2024 Related Terms
      Oceans Climate Change Earth Jet Propulsion Laboratory Natural Disasters Explore More
      5 min read JPL Workforce Update
      Article 17 hours ago 6 min read Inia Soto Ramos, From the Mountains of Puerto Rico to Mountains of NASA Earth Data
      Dr. Inia Soto Ramos became fascinated by the mysteries of the ocean while growing up…
      Article 22 hours ago 4 min read NASA-developed Technology Supports Ocean Wind Speed Measurements from Commercial Satellite
      A science antenna developed with support from NASA’s Earth Science Technology Office (ESTO) is now…
      Article 1 day ago Keep Exploring Discover Related Topics
      Missions
      Humans in Space
      Climate Change
      Solar System
      View the full article
    • By NASA
      5 Min Read Wearable Tech for Space Station Research
      A wearable monitoring device is visible on the left wrist of NASA astronaut Jeanette Epps. Credits: NASA Science in Space Nov 2024
      Many of us wear devices that count our steps, measure our heart rate, track sleep patterns, and more. This information can help us make healthy decisions – research shows the devices encourage people to move more, for example – and could flag possible problems, such as an irregular heartbeat.
      Wearable monitors also have become common tools for research on human health, including studies on the International Space Station. Astronauts have worn special watches, headbands, vests, and other devices to help scientists examine sleep quality, effectiveness of exercise, heart health, and more.
      Warm to the core
      Spaceflight can affect body temperature regulation and daily rhythms due to factors such as the absence of convection (a natural process that transfers heat away from the body) and changes in the cardiovascular and metabolic systems.
      A current investigation from ESA (European Space Agency), Thermo-Mini or T-Mini examines how the body regulates its core temperature during spaceflight. The study uses a non-invasive headband monitor that astronauts can wear for hours at a time. Data from the monitor allow researchers to determine the effect on body temperature from environmental and physiological factors such as room temperature and humidity, time of day, and physical stress. The same type of sensor already is used on Earth for research in clinical environments, such as improving incubators, and studies of how hotter environments affect human health.
      Thermolab, an earlier ESA investigation, examined thermoregulatory and cardiovascular adaptations during rest and exercise in microgravity. Researchers found that core body temperature rises higher and faster during exercise in space than on Earth and that the increase was sustained during rest, a phenomenon that could affect the health of crew members on long-term spaceflight. The finding also raises questions about the thermoregulatory set point humans are assumed to have as well as our ability to adapt to climate change on Earth.
      NASA astronaut Nick Hague wears the T-mini device while exercising.NASA To sleep, perchance to dream
      Spaceflight is known to disrupt sleep-wake patterns. Actiwatch Spectrum, a device worn on the wrist, contains an accelerometer to measure motion and photodetectors to monitor ambient lighting. It is an upgrade of previous technology used on the space station to monitor the length and quality of crew member sleep. Data from earlier missions show that crew members slept significantly less during spaceflight than before and after. The Actiwatch Sleep-Long investigation used an earlier version of the device to examine how ambient light affects the sleep-wake cycle and found an association between sleep deficiency and changes during spaceflight in circadian patterns, or the body’s response to a normal 24-hour light and dark cycle. Follow up studies are testing lighting systems to address these effects and help astronauts maintain healthy circadian rhythms.
      NASA astronaut Sunita Williams wears an Actiwatch as she conducts research.NASA Wearable Monitoring tested a lightweight vest with embedded sensors to monitor heart rate and breathing patterns during sleep and help determine whether changes in heart activity affect sleep quality. The technology offers a significant advantage by monitoring heart activity without waking the test subject and could help patients on Earth with sleep disorders. Researchers reported positive performance and good quality of recorded signals, suggesting that the vest can contribute to comprehensive monitoring of individual health on future spaceflight and in some settings on Earth as well.
      These and other studies support development of countermeasures to improve sleep for crew members, helping to maintain alertness and lessen fatigue during missions.
      (Not) waiting to exhale
      Humans exhale carbon dioxide and too much of it can build up in closed environments, causing headaches, dizziness, and other symptoms. Spacecraft have systems to remove this substance from cabin air, but pockets of carbon dioxide can form and be difficult to detect and remove. Personal CO2 Monitor tested specially designed sensors attached to clothing to monitor the wearer’s immediate surroundings. Researchers reported that the devices functioned adequately as either crew-worn or static monitors, an important step toward using them to determine how carbon dioxide behaves in enclosed systems like spacecraft.
      One of the wearable carbon dioxide monitors clipped to the wall near a crew sleeping compartment. Radiation in real time
      EVARM, an investigation from CSA (Canadian Space Agency), used small wireless dosimeters carried in a pocket to measure radiation exposure during spacewalks. The data showed that this method is a feasible way to measure radiation exposure, which could help focus routine dosage monitoring where it is most needed. Any shielding and countermeasures developed also could help protect people who work in high-radiation areas on Earth.
      ESA’s Active Dosimeter tested a radiation dosimeter worn by crew members to measure changes in their exposure over time based on the space station’s orbit and altitude, the solar cycle, and solar flares. Measurements from the device allowed researchers to analyze radiation dosage across an entire space mission.
      ESA astronaut Thomas Pesquet holds one of the mobile units for the Active Dosimeter study.NASA The Active Dosimeter also was among the instruments used to measure radiation on NASA’s Orion spacecraft during its 25.5-day uncrewed Artemis I mission around the Moon and back in 2022.
      Another device tested on the space station and then on Artemis I, AstroRad Vest is designed to protect astronauts from solar particle events. Researchers used these and other radiation measuring devices to show that Orion’s design can protect its crew from potentially hazardous radiation levels during lunar missions.
      The International Space Station serves as an important testbed for these technologies and many others being developed for future missions to the Moon and beyond.
      Melissa Gaskill
      International Space Station Research Communications Team
      Johnson Space Center
      Keep Exploring Discover More Topics From NASA
      Humans In Space
      Space Station Technology Demonstration
      Space Station Research and Technology
      Station Science 101: Human Research
      View the full article
  • Check out these Videos

×
×
  • Create New...