Jump to content

NASA Tech Tuesday: Seeing is Communicating


NASA

Recommended Posts

  • Publishers

5 min read

Preparations for Next Moonwalk Simulations Underway (and Underwater)

Girl in a wheelchair with a laptop display on a mount
When a physical condition limits mobility, getting around is easier with EyeGaze Edge. The eye-tracking technology integrates with the Ability Drive application used with motorized mobility devices, enabling hands-free control of a wheelchair’s motion.
Credit: EyeGaze Inc.

Communicating when a traumatic brain injury, stroke, or disease has made speech impossible can be daunting. Specialized eye-tracking technology uses eye movement to enable people living with disabilities to connect one-on-one, over the phone, or via the internet.

Eye-tracking systems for computers pinpoint a person’s gaze – where the eye is looking at a screen – by reflecting infrared light off the cornea and capturing it with a camera, using image-processing software to determine the eye’s orientation. The technology isn’t new, but it has become much more widely accessible, thanks in part to a collaboration between NASA’s Jet Propulsion Laboratory in Southern California and a Fairfax, Virginia-based company called Eyegaze Inc.

When the company built the first model in 1988, its computers were bulky, requiring three shipping boxes for equipment and a company staff member to set up the system. That cost limited access, and the learning process could be intimidating. 

In 1998, NASA and Eyegaze entered a public-private partnership via Congressional funding to make the hardware smaller, more portable, and affordable without compromising efficiency. It also reduced the weight of the original system by six times and its volume by nearly the same factor. Other advancements served as a springboard for two more decades of development. By collaborating with JPL, the two entities were able to miniaturize and improve the company’s Eyegaze Edge system and lower costs, eliminating barriers to ownership of this communications technology.

“Working with NASA, we were able to make the device less bulky,” said Preethi Vaidyanathan, an engineer with Eyegaze. “Since then, we integrated the external components into a small camera.” It mounts above or below a standard computer screen and requires less than 15 seconds to calibrate to an individual’s gaze.

Visual Surfing

eyegaze-4.png?w=2048
Minesweeper and other video games adapted to use eye-tracking technology are just one form of entertainment made possible by EyeGaze for people living with disabilities.
Credit: EyeGaze Inc.

As personal electronic devices and internet access became commonplace, Eyegaze customers wanted to do more than type. The company’s work with NASA and other government partners put it in a position to meet that demand.

Eyeworld integrates with computers, mobile phones, and tablets, allowing the Eyegaze camera to function as an external mouse and keyboard. By enabling almost any computer function, it lets users chat online, post to social media, send emails, text, or make phone calls. It’s also possible to change room lighting, adjust thermostat settings, and operate other environmental controls using Amazon Echo and Google Home via pages of specialized buttons with one-glance button controls. 

During the COVID-19 pandemic, Eyegaze integrated communications programs such as Zoom and WhatsApp to allow people to connect with their family and friends. To help combat a sense of isolation, the company added meditation apps and Window Swap, which stream the views from different windows worldwide. Virtual museums take the viewer on guided tours. A music streaming service syncs to favorite music apps and offers the International Radio Garden app to sample music from other cultures. Access to online gaming communities provides another way to connect.

“We are constantly thinking about what the customers want. One thing is freedom of movement, so controlling a wheelchair gives them that to some extent,” said Vaidyanathan. Eyegaze Edge integrates with the Ability Drive application used with motorized mobility devices. Looking at a specific button enables hands-free control of a wheelchair’s motion.

The Right to Speak

Eye Tracking Keyboard Software
Eye-tracking hardware and software make it possible for a person to communicate using the movement of their eyes. This keyboard screen is one of many Eyegaze developed for people with a full range of eye motion. A vertical keyboard is available for those who can only look up and down.
Credit: EyeGaze Inc.

Numerous medical conditions can lead to the kind of physical paralysis making it impossible to speak. Well-publicized brain and spinal cord injuries in athletes have led to broader awareness. But there are a host of other causes, such as cerebral palsy, ALS, multiple sclerosis, muscular dystrophy, and spinal muscular atrophy. These conditions can result in locked-in syndrome, which paralyzes all voluntary muscles except those that control eye movement. Eye-tracking software is a lifeline for patients, using what may be their only remaining voluntary movement, but even that can be impeded. 

Eyegaze Edge measures several eye features, making it possible for the tracker to work even when less of the pupil is visible. The company employs clinical specialists who can troubleshoot issues that may prevent customers from using the system, eye conditions like cataracts, dry eyes, and eyelids that droop, partly covering the pupil.

The company now serves individuals in 44 countries, including nations in Southeast Asia and Africa. Adults, children as young as 18 months old, military veterans, and others can communicate using only their eyes. If only vertical eye movement is possible, Eyegaze Edge offers a special vertical keyboard screen. Pages of commonly used phrases communicate a statement with a single glance. Large, easy-to-use buttons allow patients to communicate directly with healthcare providers and caregivers for everyday needs.

Clinicians use Eyegaze Edge and teach their patients how to communicate using the technology. In some cases, Vaidyanathan said, this technology even allows people to share their final thoughts with family and friends.

“NASA helped us get our technology to the size of a laptop – small and sleek. But we continue to investigate and design our solutions to meet ongoing needs. Communication is a key right, so we must accommodate these different challenges,” she said.

NASA has a long history of transferring technology to the private sector. The agency’s Spinoff publication profiles NASA technologies that have transformed into commercial products and services, demonstrating the broader benefits of America’s investment in its space program. Spinoff is a publication of the Technology Transfer program in NASA’s Space Technology Mission Directorate (STMD).

For more information on how NASA brings space technology down to Earth, visit:

spinoff.nasa.gov

By Margo Pierce
NASA’s Spinoff Publication

View the full article

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Similar Topics

    • By NASA
      NASA has awarded Bastion Technologies Inc., of Houston, the Center Occupational Safety, Health, Medical, System Safety and Mission Assurance Contract (COSMC) at the agency’s Ames Research Center in California’s Silicon Valley.
      The COSMC contract is a hybrid cost-plus-fixed-fee and firm-fixed-price contract, with an indefinite-delivery/indefinite-quantity component and maximum potential value of $53 million. The contract phase-in begins Thursday, Jan. 2, 2025, followed by a one-year base period that begins Feb. 14, 2025, and options to extend performance through Aug. 13, 2030.
      Under this contract, the company will provide support for occupational safety, industrial hygiene, health physics, safety and health training, emergency response, safety culture, medical, wellness, fitness, and employee assistance. The contractor also will provide subject matter expertise in several areas including system safety, software safety and assurance, quality assurance, pressure system safety, procurement quality assurance, and range safety. Work will primarily be performed at NASA Ames and NASA’s Armstrong Flight Research Center in Edwards, California, as needed.
      For information about NASA and agency programs, visit:
      https://www.nasa.gov
      -end-
      Tiernan Doyle
      NASA Headquarters, Washington
      202-358-1600
      tiernan.p.doyle@nasa.gov
      Rachel Hoover
      Ames Research Center, Silicon Valley, Calif.
      650-604-4789
      rachel.hoover@nasa.gov
      View the full article
    • By NASA
      NASA Deputy Administrator Pam Melroy speaks during an agency town hall on Sept. 21, 2021 at NASA Headquarters in Washington. Credit: NASA/Aubrey Gemignani NASA Deputy Administrator Pam Melroy and Nicola Fox, associate administrator for NASA’s Science Mission Directorate, will travel to Mexico City on Sunday, Nov. 24, for a multi-day trip to build on previous engagements and advance scientific and technological collaboration between the United States and Mexico.
      This visit will focus on fostering partnerships in astronomy and astrophysics research, as well as highlighting opportunities for economic, educational, and science, technology, engineering, and math collaborations between the two nations.
      Melroy’s trip will include high-level meetings with senior Mexican government officials, including the secretariat-designate for Science, Technology, Humanities, and Innovation. Melroy and Fox also will meet with leaders from academia, industry, and scientific institutions. These discussions will emphasize expanding cooperation in space science, with particular focus on Mexico’s growing astronomy programs.
      This visit builds on Melroy’s trip to Mexico City earlier this year and reflects NASA’s commitment to advancing international cooperation in space and science for the benefit of all.
      For more information about NASA’s international partnerships, visit:
      https://www.nasa.gov/oiir
      -end-
      Amber Jacobson / Katherine Rohloff
      Headquarters, Washington
      202-358-1600
      amber.c.jacobson@nasa.gov / katherine.a.rohloff@nasa.gov
      Share
      Details
      Last Updated Nov 22, 2024 EditorJessica TaveauLocationNASA Headquarters Related Terms
      Science Mission Directorate Office of International and Interagency Relations (OIIR) View the full article
    • By NASA
      NASA’s Human Landing System (HLS) will transport the next astronauts that land on the Moon, including the first woman and first person of color, beginning with Artemis III. For safety and mission success, the landers and other equipment in development for NASA’s Artemis campaign must work reliably in the harshest of environments.
      The Hub for Innovative Thermal Technology Maturation and Prototyping (HI-TTeMP) lab at NASA’s Marshall Space Flight Center in Huntsville, Alabama, provides engineers with thermal analysis of materials that may be a prototype or in an early developmental stage using a vacuum chamber, back left, and a conduction chamber, right. NASA/Ken Hall Engineers at NASA’s Marshall Space Flight Center in Huntsville, Alabama, are currently testing how well prototype insulation for SpaceX’s Starship HLS will insulate interior environments, including propellant storage tanks and the crew cabin. Starship HLS will land astronauts on the lunar surface during Artemis III and Artemis IV.
      Marshall’s Hub for Innovative Thermal Technology Maturation and Prototyping (HI-TTeMP) laboratory provides the resources and tools for an early, quick-check evaluation of insulation materials destined for Artemis deep space missions.
      “Marshall’s HI-TTeMP lab gives us a key testing capability to help determine how well the current materials being designed for vehicles like SpaceX’s orbital propellant storage depot and Starship HLS, will insulate the liquid oxygen and methane propellants,” said HLS chief engineer Rene Ortega. “By using this lab and the expertise provided by the thermal engineers at Marshall, we are gaining valuable feedback earlier in the design and development process that will provide additional information before qualifying hardware for deep space missions.”
      A peek inside the conductive test chamber at NASA Marshall’s HI-TTeMP lab where thermal engineers design, set up, execute, and analyze materials destined for deep space to better understand how they will perform in the cold near-vacuum of space. NASA/Ken Hall On the Moon, spaceflight hardware like Starship HLS will face extreme temperatures. On the Moon’s south pole during lunar night, temperatures can plummet to -370 degrees Fahrenheit (-223 degrees Celsius). Elsewhere in deep space temperatures can range from roughly 250 degrees Fahrenheit (120 degrees Celsius) in direct sunlight to just above absolute zero in the shadows.
      There are two primary means of managing thermal conditions: active and passive. Passive thermal controls include materials such as insulation, white paint, thermal blankets, and reflective metals. Engineers can also design operational controls, such as pointing thermally sensitive areas of a spacecraft away from direct sunlight, to help manage extreme thermal conditions. Active thermal control measures that could be used include radiators or cryogenic coolers.
      Engineers use two vacuum test chambers in the lab to simulate the heat transfer effects of the deep space environment and to evaluate the thermal properties of the materials. One chamber is used to understand radiant heat, which directly warms an object in its path, such as when heat from the Sun shines on it. The other test chamber evaluates conduction by isolating and measuring its heat transfer paths.
      NASA engineers working in the HI-TTeMP lab not only design, set up, and run tests, they also provide insight and expertise in thermal engineering to assist NASA’s industry partners, such as SpaceX and other organizations, in validating concepts and models, or suggesting changes to designs. The lab is able to rapidly test and evaluate design updates or iterations.
      NASA’s HLS Program, managed by NASA Marshall, is charged with safely landing astronauts on the Moon as part of Artemis. NASA has awarded contracts to SpaceX for landing services for Artemis III and IV and to Blue Origin for Artemis V. Both landing services providers plan to transfer super-cold propellant in space to send landers to the Moon with full tanks.
      With Artemis, NASA will explore more of the Moon than ever before, learn how to live and work away from home, and prepare for future human exploration of Mars. NASA’s SLS (Space Launch System) rocket, exploration ground systems, and Orion spacecraft, along with the HLS, next-generation spacesuits, Gateway lunar space station, and future rovers are NASA’s foundation for deep space exploration.
      For more on HLS, visit: 
      https://www.nasa.gov/humans-in-space/human-landing-system
      News Media Contact
      Corinne Beckinger 
      Marshall Space Flight Center, Huntsville, Ala. 
      256.544.0034  
      corinne.m.beckinger@nasa.gov 
      Explore More
      8 min read Preguntas frecuentes: La verdadera historia del cuidado de la salud de los astronautas en el espacio
      Article 1 day ago 6 min read FAQ: The Real Story About Astronaut Health Care in Space
      Article 1 day ago 3 min read Ready, Set, Action! Our Sun is the Star in Dazzling Simulation
      Article 1 day ago
      r
      View the full article
    • By NASA
      2 Min Read Why NASA Is a Great Place to Launch Your Career 
      Students at NASA's Jet Propulsion Laboratory pose for photos around the laboratory wearing their eclipse glasses. Credits: NASA/JPL-Caltech  Recently recognized as the most prestigious internship program by Vault.com, NASA has empowered countless students and early-career professionals to launch careers in science, technology, engineering, and mathematics (STEM) fields. NASA interns make real contributions to space and science missions, making it one of the best places to start your career. 
      “NASA internships give students the chance to work on groundbreaking projects alongside experts, providing impactful opportunities for professional growth,” said Mike Kincaid, associate administrator for NASA’s Office of STEM Engagement. “Since starting my career as an intern at NASA’s Johnson Space Center in Houston, I’ve experienced firsthand how NASA creates lasting connections and open doors—not just for me, but for former interns who are now colleagues across the agency. These internships build STEM skills, confidence, and networks, preparing the next generation of innovators and leaders.” 
      NASA interns achieve impressive feats, from discovering new exoplanets to becoming astronauts and even winning Webby Awards for their science communication efforts. These valuable contributors play a crucial role in NASA’s mission to explore the unknown for the benefit of all. Many NASA employees start their careers as interns, a testament to the program’s lasting impact. 
      Students congratulate the 23rd astronaut class at NASA’s Johnson Space Center in Houston on March 5, 2024.NASA/Josh Valcarcel Additionally, NASA is recognized as one of America’s Best Employers for Women and one of America’s Best Employers for New Graduates by Forbes, reflecting the agency’s commitment to fostering a diverse and inclusive environment. NASA encourages people from underrepresented groups to apply, creating a diverse cohort of interns who bring a wide range of perspectives and ideas to the agency.  
      “My internship experience has been incredible. I have felt welcomed by everyone I’ve worked with, which has been so helpful as a Navajo woman as I’ve often felt like an outsider in male-dominated STEM spaces,” said Tara Roanhorse, an intern for NASA’s Office of STEM Engagement. 
      If you’re passionate about space, technology, and making a difference in the world, NASA’s internship program is the perfect place to begin your journey toward a fulfilling and impactful career.  
      To learn more about NASA’s internship programs, visit: https://www.intern.nasa.gov/ 
      Keep Exploring Discover More STEM Topics From NASA
      For Colleges and Universities
      For Students Grades 9-12
      Join Artemis
      Learning Resources
      View the full article
    • By NASA
      Media are invited to learn about a unique series of flight tests happening in Virginia in partnership between NASA and GE Aerospace that aim to help the aviation industry better understand contrails and their impact on the Earth’s climate. Contrails are the lines of clouds that can be created by high-flying aircraft, but they may have an unseen effect on the planet – trapping heat in the atmosphere.
      The media event will occur from 9 a.m.-12 p.m. on Monday, Nov. 25 at NASA’s Langley Research Center in Hampton, Virginia. NASA Langley’s G-III aircraft and mobile laboratory, as well as GE Aerospace’s 747 Flying Test Bed (FTB) will be on site. NASA project researchers and GE Aerospace’s flight crew will be available to discuss the Contrail Optical Depth Experiment (CODEX), new test methods and technologies used, and the real-world impacts of understanding and managing contrails. Media interested in attending must contact Brittny McGraw at brittny.v.mcgraw@nasa.gov no later than 12 p.m. EST, Friday, Nov. 22.
      Flights for CODEX are being conducted this week. NASA Langley’s G-III will follow GE Aerospace’s FTB in the sky and scan the aircraft wake with Light Detection and Ranging (LiDAR) technology. This will advance the use of LiDAR by NASA to generate three-dimensional imaging of contrails to better characterize how contrails form and how they behave over time.
      For more information about NASA’s work in green aviation tech, visit:
      https://www.nasa.gov/aeronautics/green-aero-tech
      -end-
      David Meade 
      Langley Research Center, Hampton, Virginia 
      757-751-2034  davidlee.t.meade@nasa.gov
      View the full article
  • Check out these Videos

×
×
  • Create New...