NASA has published two detailed evaluation reports on Umbra SAR data, and the findings paint a picture that’s part encouraging, part cautionary. The assessments — produced through NASA’s Commercial Satellite Data Acquisition (CSDA) program — give the agency’s Earth science community a clearer view of where Umbra’s X-band synthetic aperture radar constellation delivers, and where it falls short of its own stated performance targets.
- NASA’s CSDA program evaluated Umbra SAR data and found geolocation accuracy did not meet the company’s own published specifications.
- Umbra SAR data showed radiometric underperformance compared to well-calibrated reference SAR systems, according to NASA subject matter experts.
- Strengths of Umbra’s constellation include very high spatial resolution, rapid tasking capability, and an open data program.
- NASA uses commercial satellite data to augment its own Earth observation capabilities cost-effectively alongside ESA and other partners.
Table of Contents
What NASA’s CSDA Program Actually Does
Before getting into the results, it’s worth understanding what the CSDA program is designed for. Established to identify, evaluate, and acquire commercially sourced satellite data, the program operates on a practical premise: commercial constellations are proliferating fast, and NASA can’t — and arguably shouldn’t — try to build and launch everything itself. By systematically vetting commercial providers, NASA can potentially fold high-quality third-party data into its Earth observation pipeline at a fraction of the cost of operating dedicated government satellites.
That’s the theory, anyway. The evaluations of Umbra SAR data show the gap between commercial marketing claims and operational scientific utility can still be substantial. Umbra, a US-based SAR startup that has built one of the more capable commercial X-band constellations in orbit, was given a thorough going-over by two separate evaluation tracks — a Principal Investigator (PI) team assessment and a technical Quality Assessment (QA) conducted by NASA subject matter experts (SMEs) following joint NASA/ESA assessment guidelines published in 2024.
Where Umbra SAR Data Holds Up
The PI evaluation gave researchers direct access to Umbra’s archive and — critically — the ability to task the constellation for new acquisitions in near-real time. That’s a meaningful capability. Being able to direct a SAR satellite to image a specific area on short notice opens up a category of science that archive-only access simply can’t support: monitoring rapidly evolving environmental events.
Evaluation teams used this tasking ability to track areas undergoing rapid change, including harmful algal blooms — a use case where timing matters enormously, since these events can develop and dissipate within days. The ability to acquire fresh imagery on demand rather than waiting for a scheduled pass is one of the more compelling commercial advantages over traditional government satellite programs, which often operate on fixed acquisition plans.
The PI summary also highlighted several concrete strengths of Umbra SAR data: the constellation’s very high spatial resolution in the X-band, flexible imaging geometry across a range of azimuth and incidence angles, and Umbra’s Open Data Program, which makes a subset of its imagery freely available. That open data initiative has generated genuine goodwill in the research community and aligns with broader pushes — from NASA, ESA, and others — toward more accessible Earth observation data.
Spatial resolution, as confirmed by the QA analysis, is an area where Umbra’s numbers check out. The SMEs found that measured resolution agreed with Umbra’s published specifications. For a company that markets itself partly on resolution performance, that’s a meaningful validation.
Umbra SAR Data Falls Short on Geolocation and Radiometry
Here’s where the reports get uncomfortable for Umbra. Two of the most fundamental quality metrics for SAR data — geolocation accuracy and radiometric performance — didn’t pass muster against the benchmarks NASA’s experts applied.
On geolocation, the PI teams flagged both large and small positioning errors, and the QA analysis confirmed the picture: Umbra SAR data didn’t universally meet the company’s own geolocation specifications. The SMEs were direct in their conclusion, stating that “the overall positioning performance of the Umbra data did not meet the expected accuracy.” For applications like change detection, infrastructure monitoring, or any workflow where you’re precisely co-registering imagery over time, positional accuracy isn’t a minor footnote — it’s foundational.
The radiometric performance findings were similarly pointed. Assessed in terms of absolute accuracy, stability, and sensitivity, the SMEs found that Umbra SAR data “underperform[ed] relative to that of well-calibrated reference SAR systems.” Radiometric quality governs how reliably you can extract quantitative information from SAR imagery — things like surface roughness measurements, soil moisture estimates, or biomass calculations. Underperformance here doesn’t necessarily mean the data is useless, but it does mean researchers need to apply additional calibration steps or exercise caution in quantitative applications.
Additional weaknesses noted by the PI teams included limited software compatibility — always a friction point when researchers are trying to integrate new data sources into existing workflows — along with gaps in metadata and missing technical documentation. These are the kinds of issues that don’t make headlines but quietly eat researcher time and erode confidence in a data product.
How This Fits the Broader Commercial SAR Landscape
Umbra isn’t operating in a vacuum. The commercial SAR sector has seen a surge of activity over the past few years, with players like Capella Space, ICEYE, and Synspective all fielding constellations and competing for both government and commercial contracts. Umbra SAR data sits in a competitive market where agencies like NASA, the National Reconnaissance Office (NRO), and their international counterparts are all actively evaluating which commercial providers can meet the rigorous standards required for scientific and intelligence applications.
NASA’s evaluation framework — built around joint NASA/ESA guidelines — is precisely the kind of third-party scrutiny that separates genuine performance from spec-sheet claims. The fact that Umbra’s spatial resolution held up while geolocation and radiometry fell short is actually a fairly typical pattern in maturing satellite programs. Resolution is often the flagship metric that gets the most engineering attention early on; calibration and absolute accuracy tend to be harder problems that require sustained ground truthing and ongoing refinement.
For context, well-established SAR missions like ESA’s Sentinel-1 or the JAXA/METI ALOS-2 have undergone years of calibration refinement and benefit from extensive ground infrastructure. Expecting a commercial newcomer to match that benchmark out of the gate is perhaps unrealistic — but NASA’s evaluation criteria don’t grade on a curve, and nor should they.
What Comes Next for Commercial SAR Evaluation
The CSDA program’s approach here is the right one. Publishing both a PI usability assessment and a rigorous technical QA report gives the research community a layered view of the data — practical utility on one side, fundamental quality metrics on the other. The two don’t always tell the same story, and in Umbra’s case they don’t.
The PI evaluation summary supports using Umbra SAR data for NASA Earth science research and applications overall, despite the documented weaknesses. That’s a pragmatic position: no data source is perfect, and the tasking flexibility and resolution capability offer real value for the right applications. But researchers now have a clear-eyed picture of where they need to be careful.
For Umbra, the NASA reports represent both a challenge and an opportunity. The geolocation and radiometric issues are solvable — they’re engineering problems, not fundamental physics constraints. Addressing them would meaningfully expand the range of scientific applications the constellation can support and strengthen the company’s position as government agencies continue to build out their commercial data procurement strategies.
The CSDA program is expected to continue evaluating additional commercial providers, and as the satellite industry keeps launching new constellations at pace, these independent assessments are becoming an increasingly critical filter between commercial hype and scientific reality.
Source: NASA Breaking News
Frequently Asked Questions
What did NASA find wrong with Umbra SAR data quality?
NASA’s subject matter experts found two main problems: geolocation accuracy that did not universally meet Umbra’s own specifications, and radiometric performance that underperformed relative to well-calibrated reference SAR systems. The spatial resolution, however, did match Umbra’s stated specs.
What is NASA’s CSDA program and why does it evaluate commercial satellites?
The Commercial Satellite Data Acquisition program identifies, evaluates, and acquires data from commercial satellite operators to support NASA Earth science goals. It helps determine whether commercial data can cost-effectively supplement observations from NASA, other U.S. agencies, and international partners.
What are the strengths of Umbra’s SAR constellation according to NASA?
NASA’s evaluation teams highlighted Umbra’s very high spatial resolution X-band SAR capability, flexible tasking with quick turnaround, imaging across a range of azimuth and incidence angles, and the company’s Open Data Program as notable strengths.
What format was the Umbra SAR data evaluated in?
NASA’s quality assessment focused primarily on single-look complex Level 1 data products in Sensor Independent Complex Data format, with some additional Level 2 products assessed for science usability. Evaluation followed joint NASA and ESA assessment guidelines published in 2024.
