Self-occlusions are common in rice canopy images and strongly influence the calculation accuracies of panicle traits.Such interference can be largely eliminated if panicles are phenotyped at the 3D level.Research on 3D panicle phenotyping has been limited.Given that existing 3D modeling techniques do not focus on specified parts of a target object,an efficient method for panicle modeling of large numbers of rice plants is lacking.This paper presents an automatic and nondestructive method for 3D panicle modeling.The proposed method integrates shoot rice reconstruction with shape from silhouette,2D pan-icle segmentation with a deep convolutional neural network,and 3D panicle segmentation with ray trac-ing and supervoxel clustering.A multiview imaging system was built to acquire image sequences of rice canopies with an efficiency of approximately 4 min per rice plant.The execution time of panicle modeling per rice plant using 90 images was approximately 26 min.The outputs of the algorithm for a single rice plant are a shoot rice model,surface shoot rice model,panicle model,and surface panicle model,all rep-resented by a list of spatial coordinates.The efficiency and performance were evaluated and compared with the classical structure-from-motion algorithm.The results demonstrated that the proposed method is well qualified to recover the 3D shapes of rice panicles from multiview images and is readily adaptable to rice plants of diverse accessions and growth stages.The proposed algorithm is superior to the structure-from-motion method in terms of texture preservation and computational efficiency.The sam-ple images and implementation of the algorithm are available online.This automatic,cost-efficient,and nondestructive method of 3D panicle modeling may be applied to high-throughput 3D phenotyping of large rice populations.

Dan Wu;Lejun Yu;Junli Ye;Ruifang Zhai;Lingfeng Duan;Lingbo Liu;Nai Wu;Zedong Geng;Jingbo Fu;Chenglong Huang;Shangbin Chen;Qian Liu;Wanneng Yang

Britton Chance Center for Biomedical Photonics,Wuhan National Laboratory for Optoelectronics,and Key Laboratory of Ministry of Education for Biomedical Photonics,Department of Biomedical Engineering,Huazhong University of Science and Technology,Wuhan 430074,Hubei,China;School of Biomedical Engineering,Hainan University,Haikou 570228,Hainan,China;National Key Laboratory of Crop Genetic Improvement,National Center of Plant Gene Research,Huazhong Agricultural University,Wuhan 430070,Hubei,China

作物学报（英文版）

[1]Dan Wu;Lejun Yu;Junli Ye;Ruifang Zhai;Lingfeng Duan;Lingbo Liu;Nai Wu;Zedong Geng;Jingbo Fu;Chenglong Huang;Shangbin Chen;Qian Liu;Wanneng Yang-.Panicle-3D:A low-cost 3D-modeling method for rice panicles based on deep learning,shape from silhouette,and supervoxel clustering)[J].作物学报（英文版）,2022(05):1386-1398

supervoxel,phenotyped,icle

Panicle,low,cost,modeling,method,rice,panicles,deep,learning,from,silhouette,clustering,Self,occlusions,common,canopy,images,strongly,influence,calculation,accuracies,traits,Such,interference,largely,eliminated,level,Research,phenotyping,has,been,limited,Given,that,existing,techniques,do,focus,specified,parts,target,object,efficient,numbers,plants,lacking,This,paper,presents,automatic,nondestructive,proposed,integrates,shoot,reconstruction,2D,segmentation,convolutional,neural,network,ray,trac,multiview,imaging,system,was,built,acquire,sequences,canopies,efficiency,approximately,execution,using,outputs,algorithm,single,surface,all,rep,resented,by,list,spatial,coordinates,performance,were,evaluated,compared,classical,structure,motion,results,demonstrated,well,qualified,recover,shapes,readily,adaptable,diverse,accessions,growth,stages,superior,terms,texture,preservation,computational,sam,implementation,available,online,may,applied,high,throughput,populations

0.459571