This paper presents an extended scientific HDO/H2O total column data product from short-wave infrared (SWIR) measurements by the Tropospheric Monitoring Instrument (TROPOMI) including clear-sky and cloudy scenes. The retrieval employs a forward model which accounts for scattering, and the algorithm infers the trace gas column information, surface properties, and effective cloud parameters from the observations. Compared to the previous clear-sky-only data product, coverage is greatly enhanced by including scenes over low clouds, particularly enabling data over oceans as the albedo of water in the SWIR spectral range is too low to retrieve under cloud-free conditions. The new dataset is validated against co-located ground-based Fourier transform infrared (FTIR) observations by the Total Carbon Column Observing Network (TCCON). The median bias for clear-sky scenes is 1.4×1021 molec cm−2 (2.9 %) in H2O columns and 1.1×1017 molec cm−2 (−0.3 %) in HDO columns, which corresponds to −17 ‰ (9.9 %) in a posteriori δD. The bias for cloudy scenes is 4.9×1021 molec cm−2 (11 %) in H2O, 1.1×1018 molec cm−2 (7.9 %) in HDO, and −20 ‰ (9.7 %) in a posteriori δD. At low-altitude stations, the bias is small at low and middle latitudes and has a larger value at high latitudes. At high-altitude stations, an altitude correction is required to compensate for different partial columns seen by the station and the satellite. The bias in a posteriori δD after altitude correction depends on sensitivity due to shielding by clouds and on realistic a priori profile shapes for both isotopologues. Cloudy scenes generally involve low sensitivity below the clouds, and since the information is filled up by the prior, a realistic shape of the prior is important for realistic total column estimation in these cases. Over oceans, aircraft measurements with the Water Isotope System for Precipitation and Entrainment Research (WISPER) instrument from a field campaign in 2018 are used for validation, yielding biases of −3.9 % in H2O and −3 ‰ in δD over clouds. To demonstrate the added value of the new dataset, a short case study of a cold air outbreak over the Atlantic Ocean in January 2020 is presented, showing the daily evolution of the event with single-overpass results.
