Cloud Masking is one of the most essential products for satellite remote sensing and downstream applications.This study develops machine learning-based(ML-based)cloud detection algorithms using spectral observations for the Advanced Himawari Imager(AHI)onboard the Himawari-8 geostationary satellite.Collocated active observations from Cloud-Aerosol Lidar with Orthogonal Polarization(CALIOP)are used to provide reference labels for model development and validation.We introduce both daytime and nighttime algorithms that differ according to whether solar band observations are included,and the artificial neural network(ANN)and random forest(RF)techniques are adopted for comparison.To eliminate the influences of surface conditions on cloud detection,we introduce three models with different treatments of the surface.Instead of developing independent ML-based algorithms,we add surface variables in a binary way that enhances the ML-based algorithm accuracy by～5％.Validated against CALIOP observations,we find that our daytime RF-based algorithm outperforms the AHI operational algorithm by improving the accuracy of cloudy pixel detection by～5％,while at the same time,reducing misjudgment by～3％.The nighttime model with only infrared observations is also slightly better than the AHI operational product but may tend to overestimate cloudy pixels.Overall,our ML-based algorithms can serve as a reliable method to provide cloud mask results for both daytime and nighttime AHI observations.We furthermore suggest treating the surface with a set of independent variables for future ML-based algorithm development.

Chao LIU;Shu YANG;Di DI;Yuanjian YANG;Chen ZHOU;Xiuqing HU;Byung-Ju SOHN

Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters,Nanjing University of Information Science&Technology,Nanjing 210044,China;Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration,School of Atmospheric Physics,Nanjing University of Information Science&Technology,Nanjing 210044,China;School of Atmospheric Sciences,Nanjing University,Nanjing 210046,China;Key Laboratory of Radiometric Calibration and Validation for Environmental Satellites,National Satellite Meteorological Center,China Meteorological Administration,Beijing 100081,China;School of Earth and Environmental Sciences,Seoul National University,Seoul 151747,South Korea

大气科学进展（英文版）

[1]Chao LIU;Shu YANG;Di DI;Yuanjian YANG;Chen ZHOU;Xiuqing HU;Byung-Ju SOHN-.A Machine Learning-based Cloud Detection Algorithm for the Himawari-8 Spectral Image)[J].大气科学进展（英文版）,2022(12):1994-2007

Collocated,misjudgment

Machine,Learning,Cloud,Detection,Algorithm,Himawari,Spectral,Masking,one,most,essential,products,satellite,remote,sensing,downstream,applications,This,study,develops,machine,learning,ML,detection,algorithms,using,spectral,observations,Advanced,Imager,AHI,onboard,geostationary,active,from,Aerosol,Lidar,Orthogonal,Polarization,CALIOP,used,provide,reference,labels,development,validation,We,introduce,both,daytime,nighttime,that,according,whether,solar,band,included,artificial,neural,network,ANN,random,forest,RF,techniques,adopted,comparison,To,eliminate,influences,surface,conditions,we,three,models,different,treatments,Instead,developing,independent,add,variables,binary,way,enhances,accuracy,by,Validated,against,find,our,outperforms,operational,improving,cloudy,while,same,reducing,only,infrared,also,slightly,better,than,but,may,tend,overestimate,pixels,Overall,can,serve,reliable,method,mask,results,furthermore,suggest,treating,set,future

0.561791