Jump to content

GSFC Data Science Group Releases Innovative Foundation Model: SatVision Top-Of-Atmosphere (TOA)


Recommended Posts

  • Publishers
Posted

At Goddard Space Flight Center, the GSFC Data Science Group has completed the testing for their SatVision Top-of-Atmosphere (TOA) Foundation Model, a geospatial foundation model for coarse-resolution all-sky remote sensing imagery. The team, comprised of Mark Carroll, Caleb Spradlin, Jordan Caraballo-Vega, Jian Li, Jie Gong, and Paul Montesano, has now released their model for wide application in science investigations.

Foundation models can transform the landscape of remote sensing (RS) data analysis by enabling the pre-training of large computer-vision models on vast amounts of remote sensing data. These models can be fine-tuned with small amounts of labeled training and applied to various mapping and monitoring applications. Because most existing foundation models are trained solely on cloud-free satellite imagery, they are limited to applications of land surface or require atmospheric corrections. SatVision-TOA is trained on all-sky conditions which enables applications involving atmospheric variables (e.g., cloud or aerosol).

SatVision TOA is a 3 billion parameter model trained on 100 million images from Moderate Resolution Imaging Spectroradiometer (MODIS). This is, to our knowledge, the largest foundation model trained solely on satellite remote sensing imagery. By including “all-sky” conditions during pre-training, the team incorporated a range of cloud conditions often excluded in traditional modeling. This enables 3D cloud reconstruction and cloud modeling in support of Earth and climate science, offering significant enhancement for large-scale earth observation workflows.

With an adaptable and scalable model design, SatVision-TOA can unify diverse Earth observation datasets and reduce dependency on task-specific models. SatVision-TOA leverages one of the largest public datasets to capture global contexts and robust features. The model could have broad applications for investigating spectrometer data, including MODIS, VIIRS, and GOES-ABI. The team believes this will enable transformative advancements in atmospheric science, cloud structure analysis, and Earth system modeling.

The model architecture and model weights are available on GitHub and Hugging Face, respectively. For more information, including a detailed user guide, see the associated white paper: SatVision-TOA: A Geospatial Foundation Model for Coarse-Resolution All-Sky Remote Sensing Imagery

Examples of image reconstruction by SatVision-TOA. Left: MOD021KM v6.1 cropped image chip using MODIS bands [1, 3, 2]. Middle: The same images with randomly applied 8 × 8 mask patches, masking 60% of the original image. Right: The reconstructed images produced by the model, along with their respective Structural Similarity Index Measure (SSIM) scores. These examples illustrate the model’s ability to preserve structural detail and reconstruct heterogeneous features, such as cloud textures and land-cover transitions, with high fidelity.
Examples of image reconstruction by SatVision-TOA. Left: MOD021KM v6.1 cropped image chip using MODIS bands [1, 3, 2]. Middle: The same images with randomly applied 8×8 mask patches, masking 60% of the original image. Right: The reconstructed images produced by the model, along with their respective Structural Similarity Index Measure (SSIM) scores. These examples illustrate the model’s ability to preserve structural detail and reconstruct heterogeneous features, such as cloud textures and land-cover transitions, with high fidelity.
NASA

View the full article

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Similar Topics

    • By NASA
      NASA Stennis partnered with Mississippi Enterprise for Technology to host more than 100 members of the 57th Rocket Test Group on March 18-19.
      NASA Stennis partnered with Mississippi Enterprise for Technology to host more than 100 members of the 57th Rocket Test Group on March 18-19.NASA/Jason Richard The group toured the south Mississippi NASA center on March 19, learning how NASA Stennis operates as NASA’s primary, and America’s largest, rocket propulsion test site to serve the nation and commercial sector with its unique capabilities and expertise.
      NASA Stennis partnered with Mississippi Enterprise for Technology to host more than 100 members of the 57th Rocket Test Group on March 18-19.NASA/Jason Richard The day included tours of test stands and facilities hosted by NASA Stennis test complex personnel. Visits included the Fred Haise Test Stand, where NASA Stennis tests RS-25 engines to help power NASA’s Artemis missions to the Moon and beyond; the Thad Cochran Test Stand, where NASA Stennis will test NASA’s exploration upper stage for future Artemis missions; the E Test Complex, where NASA Stennis supports agency and commercial propulsion test activity; and the L3Harris Technologies (formerly Aerojet Rocketdyne) Engine Assembly Facility, where RS-25 engines are produced.
      NASA Stennis partnered with Mississippi Enterprise for Technology to host more than 100 members of the 57th Rocket Test Group on March 18-19.NASA/Jason Richard The group also received overviews from site personnel on the Rocket Propulsion Test Program Office located at NASA Stennis, on lessons learned from testing at the E Test Complex, and on the NASA Data Acquisition System developed onsite.
      NASA Stennis partnered with Mississippi Enterprise for Technology to host more than 100 members of the 57th Rocket Test Group on March 18-19.NASA/Jason Richard The Rocket Test Group originally formed in response to a congressional demand for an ongoing working group crossing agency and company boundaries. It is a volunteer organization intended to allow rocket test facility operators to come together to recommend solutions for difficult testing problems; lower testing costs by reducing time spent on solving critical issues and eliminating duplicate programs; facilitate the activation of new facilities; learn from each other by viewing different methods and touring various facilities; provide a networking opportunity for testing advice and problem solving support; and allow test facility operators to stay informed on the newest developments.
      NASA Stennis partnered with Mississippi Enterprise for Technology to host more than 100 members of the 57th Rocket Test Group on March 18-19.L3Harris TechnologiesView the full article
    • By NASA
      2 min read
      Citizen Scientists Use NASA Open Science Data to Research Life in Space
      2023 Workshop of Analysis Working Group members, Washington, D.C., November 14, 2023. Now, you are invited to join their quest to understand how life can thrive in deep space! Want to learn more first? Join our live virtual event April 17 at 3pm Eastern Time to hear an overview of the OSDR AWG’s operations. Photo: NASA OSDR Team How can life thrive in deep space? The Open Science Data Repository Analysis Working Groups invite volunteers from all backgrounds to help answer this question. Request to join these citizen science groups to help investigate how life adapts to space environments, exploring topics like radiation effects, microgravity’s impact on human and plant health, and how microbes change in orbit.
      Currently, nine Analysis Working Groups (AWGs) hold monthly meetings to advance their specific focus areas. Participants collaborate using an online platform, the AWG “Forum-Space”, where they connect with peers and experts, join discussions, and contribute to over 20 active projects. 
      The AWGs work with data primarily from the NASA Open Science Data Repository (OSDR), a treasure trove of spaceflight data on physiology, molecular biology, bioimaging, and much more. For newcomers, there are tutorials and a comprehensive paper covering all aspects of the repository and the AWG community. You can explore 500+ studies, an omics multi-study visualization portal, the environmental data app, and RadLab, a portal for radiation telemetry data. (“Omics” refers to fields of biology that end in “omics,” like “genomics”.)   
      Each of the nine AWGs has a Lead who organizes their group and holds monthly virtual meetings. Once you join, make sure to connect with the Lead and get on the agenda so you can introduce yourself. Learn more about the AWGs here.
      Have an idea for a new project? Propose a new project and help lead it! From data analysis and visualization to shaping data standards and conducting literature meta-analyses, there’s a place for everyone to contribute. Request to join, and together, we can address a great challenge for humanity: understanding and enabling life to thrive in deep space! 
      Want to learn more?
      On April 17 at 3pm Eastern Time, the NASA Citizen Science Leaders Series is hosting an virtual event with Ryan Scott about these Analysis Working Groups and their work. Ryan is the Science Lead for the Ames Life Sciences Data Archive and the liaison between the Open Data Science Repository and the Analysis Working Groups. Click here to register for this event!
      Share








      Details
      Last Updated Apr 01, 2025 Related Terms
      Citizen Science Biological & Physical Sciences Explore More
      9 min read Interview with Michiharu Hyogo, Citizen Scientist and First Author of a New Scientific Paper


      Article


      2 weeks ago
      2 min read Redshift Wranglers Reach Remarkable Milestones


      Article


      4 weeks ago
      2 min read 2025 Aviation Weather Mission: Civil Air Patrol Cadets Help Scientists Study the Atmosphere with GLOBE Clouds


      Article


      4 weeks ago
      View the full article
    • By Space Force
      The U.S. Space Force published its Data and Artificial Intelligence FY 2025 Strategic Action Plan.

      View the full article
    • By Space Force
      The Department of the Air Force provided guidance March 19 for military members and civilian employees who are presently on TDY, traveling on PCS orders, or scheduled to begin such travel for A1-sponsored training.
      View the full article
    • By European Space Agency
      On 19 March 2025, the European Space Agency’s Euclid mission released its first batch of survey data, including a preview of its deep fields. Here, hundreds of thousands of galaxies in different shapes and sizes take centre stage and show a glimpse of their large-scale organisation in the cosmic web.
      View the full article
  • Check out these Videos

×
×
  • Create New...