Comparison Between the Accuracy of Different AI-Based Cephalometric Analysis and Conventional Manual Analysis

Volume 12 , Issue 3 , December 2025 , Pages 1-9

Authors

Mohammed Mahmood 1 ; Mohammed Mahmood 1 ; Adham Abdulrahman 2 ; Anwar Amin 2 ; Hadi Ismail 2

1 Basic Science Department, College of Dentistry, University of Sulaimani, Sulaimaniya, Iraq

2 Orthodontics Department, College of Dentistry, University of Sulaimani, Sulaimaniya, Iraq

DOI logo 10.17656/sdj.10211

Keywords

Abstract

Objective: This study compared artificial intelligence-based cephalometric analysis platforms with conventional manual analysis using the Steiner Cephalometric analysis system.

Methods: Three AI online software platforms: WEBCEPH, AssembleCircle Corp, South Korea, CEPHIO, Cephio Sp. Z o.o., Poland, and VOXEL Voxel3Di, United Kingdom, were evaluated using 25 cephalometric radiographs and compared with two manual tracings performed using (Lab Pronto, Blue Sky Plan) for the Steiner Cephalometric analysis system. Independent sample t-test was used to compare the two manual analysis. The Kruskal-Wallis H-test, followed by pairwise comparisons, was used to evaluate differences between AI-based and manual analyses, with significance at p≤0.05.

Results: No significant discrepancies were found between the two manual analyses. However, the Kruskal-Wallis H-test and pairwise comparisons revealed significant differences between the AI platforms regarding the SNA angle and the U1 to NA angle. Specifically, VOXEL AI analysis differed from WEBCEPH (at p=0.003) and CEPHIO (at p=0.011) for these measurements.

Conclusions: The findings highlight that while AI platforms such as VOXEL show promising alignment with manual analysis across most measurements, discrepancies, particularly in specific angles, underscore the need for cautious integration and ongoing validation of AI in orthodontic practice. The selection of appropriate AI-based analysis is crucial; however, manual analysis remains the gold standard for cephalometric analysis.

References

  1. Tsolakis IA, Tsolakis AI, Elshebiny T, Matthaios S, Palomo JM. Comparing a Fully Automated Cephalometric Tracing Method to a Manual Tracing Method for Orthodontic Diagnosis. J Clin Med. 2022;1:6854.2.
  2. Bulatova G, Kusnoto B, Grace V, Tsay TP, Avenetti DM, Sanchez FJC. Assessment of automatic cephalometric landmark identification using artificial intelligence. Orthod Craniofac Res. 2021;24 (Suppl 2):37-42.
  3. Mohammed MH, Omer ZQ, Aziz BB, Abdulkareem JF, Mahmood TMA, Kareem FA, Mohammad DN. Convolutional Neural Network-Based Deep Learning Methods for Skeletal Growth Prediction in Dental Patients. J Imaging. 2024;10(11):278.
  4. Rauf AM, Mahmood TMA, Mohammed MH, Omer ZQ, Kareem FA. Orthodontic Implementation of Machine Learning Algorithms for Predicting Some Linear Dental Arch Measurements and Preventing Anterior Segment Malocclusion: A Prospective Study. Medicina (Kaunas). 2023;59(11):1973.
  5. Meriç P, Naoumova J. Web-based Fully Automated Cephalometric Analysis: Comparisons between App-aided, Computerized, and Manual Tracings. Turk J Orthod. 2020;33(3):142-9.
  6. Narkhede S, Rao P, Sawant V, Sachdev SS, Arora S, Pawar AM, Reda R, Testarelli L. Digital versus Manual Tracing in Cephalometric Analysis: A Systematic Review and Meta-Analysis. J Pers Med. 2024;14(6):566.
  7. Polizzi A, Leonardi R. Automatic cephalometric landmark identification with artificial intelligence: An umbrella review of systematic reviews. J Dent. 2024;146:105056.
  8. Guinot-Barona C, Alonso Pérez-Barquero J, Galán López L, Barmak AB, Att W, Kois JC, Revilla-León M. Cephalometric analysis performance discrepancy between orthodontists and an artificial intelligence model using lateral cephalometric radiographs. J Esthet Restor Dent. 2024;36(4):555-65.
  9. Jiang F, Guo Y, Yang C, Zhou Y, Lin Y, Cheng F, et al. Artificial intelligence system for automated landmark localization and analysis of cephalometry. Dentomaxillofac Radiol. 2023;52(1):20220081.
  10. Wang CW, Huang CT, Lee JH, Li CH, Chang SW, Siao MJ, et al. A benchmark for comparison of dental radiography analysis algorithms. Med Image Anal. 2016;31:63-76.
  11. Çoban G, Öztürk T, Hashimli N, Yağci A. Comparison between cephalometric measurements using digital manual and web-based artificial intelligence cephalometric tracing software. Dental Press J Orthod. 2022;27(4):222112.
  12. Abdullah RT, Kuijpers MA, Bergé SJ, Katsaros C. Steiner cephalometric analysis: predicted and actual treatment outcome compared. Orthod Craniofac Res. 2006;9(2):77-83
  13. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175-91.
  14. Jeon S, Lee KC. Comparison of cephalometric measurements between conventional and automatic cephalometric analysis using convolutional neural network. Prog Orthod. 2021;22(1):14.
  15. Mahto RK, Kafle D, Giri A, Luintel S, Karki A. Evaluation of fully automated cephalometric measurements obtained from web-based artificial intelligence driven platform. BMC Oral Health. 2022;22(1):132.
  16. Hlongwa P. Cephalometric analysis: manual tracing of a lateral cephalogram. South African Dent J. 2019;74(6):318-22.
  17. Bao H, Zhang K, Yu C, Li H, Cao D, Shu H, et al. Evaluating the accuracy of automated cephalometric analysis based on artificial intelligence. BMC Oral Health. 2023;23(1):191.
  18. Wang CW, Huang CT, Hsieh MC, Li CH, Chang SW, Li WC, et al. Evaluation and Comparison of Anatomical Landmark Detection Methods for Cephalometric X-Ray Images: A Grand Challenge. IEEE Trans Med Imaging. 2015;34(9):1890-900.
  19. El-Fegh I, Galhood M, Sid-Ahmed M, Ahmadi M. Automated 2-D cephalometric analysis of X-ray by image registration approach based on least square approximator. Annu Int Conf IEEE Eng Med Biol Soc. 2008;2008:3949-52.
  20. Kiełczykowski M, Kamiński K, Perkowski K, Zadurska M, Czochrowska E. Application of Artificial Intelligence (AI) in a Cephalometric Analysis: A Narrative Review. Diagnostics (Basel). 2023;13(16):2640.
  21. François-Lavet V, Henderson P, Islam R, Bellemare MG, Pineau J. An introduction to deep reinforcement learning. Foundations and Trends® in Machine Learning. 2018;11(3-4):219-354.
  22. Brownlee J. Deep learning for computer vision: image classification, object detection, and face recognition in python. Machine Learning Mastery; 2019.
Statistics
  • Article view1238
  • Downloads24
  • First online1 December 2025
  • Published at1 December 2025

  • RIS
  • BibTeX
  • EndNote
  • Mendeley
  • APA (7th edition)
  • MLA (9th edition)
  • Chicago
  • Harvard
  • IEEE
  • Vancouver