Semi-supervised classification of dental conditions in panoramic radiographs using large language model and instance segmentation: A real-world dataset evaluation
Authors:
Bernardo Silva,
Jefferson Fontinele,
Carolina Letícia Zilli Vieira,
João Manuel R. S. Tavares,
Patricia Ramos Cury,
Luciano Oliveira
Abstract:
Dental panoramic radiographs offer vast diagnostic opportunities, but training supervised deep learning networks for automatic analysis of those radiology images is hampered by a shortage of labeled data. Here, a different perspective on this problem is introduced. A semi-supervised learning framework is proposed to classify thirteen dental conditions on panoramic radiographs, with a particular em…
▽ More
Dental panoramic radiographs offer vast diagnostic opportunities, but training supervised deep learning networks for automatic analysis of those radiology images is hampered by a shortage of labeled data. Here, a different perspective on this problem is introduced. A semi-supervised learning framework is proposed to classify thirteen dental conditions on panoramic radiographs, with a particular emphasis on teeth. Large language models were explored to annotate the most common dental conditions based on dental reports. Additionally, a masked autoencoder was employed to pre-train the classification neural network, and a Vision Transformer was used to leverage the unlabeled data. The analyses were validated using two of the most extensive datasets in the literature, comprising 8,795 panoramic radiographs and 8,029 paired reports and images. Encouragingly, the results consistently met or surpassed the baseline metrics for the Matthews correlation coefficient. A comparison of the proposed solution with human practitioners, supported by statistical analysis, highlighted its effectiveness and performance limitations; based on the degree of agreement among specialists, the solution demonstrated an accuracy level comparable to that of a junior specialist.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
Estimacao Temporal da Deformacao entre Objectos utilizando uma Metodologia Fisica
Authors:
Joao Manuel R. S. Tavares,
Raquel R. Pinho
Abstract:
In this paper, it is presented a methodology to estimate the deformation involved between two objects attending to its physical properties. This methodology can be used, for example, in Computational Vision or Computer Graphics applications, and consists in physically modeling the objects, by means of the Finite Elements Method, establishing correspondences between some of its data points, by us…
▽ More
In this paper, it is presented a methodology to estimate the deformation involved between two objects attending to its physical properties. This methodology can be used, for example, in Computational Vision or Computer Graphics applications, and consists in physically modeling the objects, by means of the Finite Elements Method, establishing correspondences between some of its data points, by using Modal Matching, and finally, determining the displacement field, that is the intermediate shapes, through the resolution of the Lagrange Dynamic Equilibrium Equation. As in many of the possible applications of the methodology to present, it is necessary to quantify the existing deformation, as well as to estimate only the non rigid component of the involved global deformation. The solutions adopted to satisfy such intentions will be also presented.
△ Less
Submitted 27 June, 2012; v1 submitted 15 May, 2005;
originally announced May 2005.