Artificial intelligence-based imaging analytics for orthopedic applications (J2-4453)

General information

Title
Artificial intelligence-based imaging analytics for orthopedic applications
Period
Oct 1, 2022 -- Sep 30, 2025
Range
1.63 FTE
Activity
2.06 - Engineering Sciences and Technologies / Systems and Cybernetics / Biomedical Tehnics

Abstract

Musculoskeletal disorders, which affect the locomotor system including the spine, have become a major medical, social and economic problem that, because of its high prevalence and the increasing number of patients, unfavorably impacts the quality of life. Radiological examination of spine images has a crucial role in surgery planning and establishing treatment strategies for many musculoskeletal and spinal disorders. Orthopedics, the medical specialty that focuses on the musculoskeletal system, has embraced imaging as an integral part of diagnosis, treatment and follow-up. By interpreting image information, different quantitative features can be extracted that help in image-assisted orthopedic examinations, such as the evaluation and prediction of the geometrical characteristics of the spinopelvic complex. Recently, advances in artificial intelligence (AI) have been recognized as valuable in tasks related to imaging analytics, and with the increase in computational power and general availability of data in the past decade, a major leap in the performance has been observed with the advent of deep learning (DL). In the proposed research project, we will design, develop and evaluate intelligent AI-based imaging analytics algorithms that aim to improve medical image interpretation, and investigate their integration with clinical practice in the field of orthopedic imaging and management of musculoskeletal and spinal disorders. In orthopedics, imaging analytics is mostly concentrated around the segmentation of spine structures and measurement of spinopelvic parameters. Spine segmentation represents the localization and delineation of the boundaries of individual vertebrae in the given image, while spinopelvic parameter measurement is focused on image-assisted evaluation of scoliosis, kyphosis, lordosis and sagittal balance as clinical expressions of the spinal curvature and body posture. For the purpose of the proposed AI-based imaging analytics, we will first devise a database consisting of radiographic (X-ray), computed tomography (CT) and magnetic resonance (MR) spine images with corresponding reference annotations in the form of vertebral segmentation masks and spinopelvic parameter measurements. By building on our previous work, we will then develop state-of-the-art DL algorithms for spine segmentation and modeling from CT and MR images, and landmark detection and modeling from X-ray images. As measurements are considered to be more reliable when extracted from three-dimensional (3D) CT or MR images, they will be transferred to two-dimensional (2D) X-ray images by 3D-2D mapping. Afterwards, the spinopelvic parameters will be measured from X-ray images by relying on the accurate information obtained by 3D spine segmentation of CT and MR images, resulting in a complete radiological analysis of the spinopelvic complex. To augment the obtained results, we will then focus on the evaluation of the interpretability of the developed DL algorithms, obtained through uncertainty estimation that describes the confidence of an AI method in its output. Finally, we will devise a software framework to merge the developed DL algorithms with tools for medical image manipulation, and ensure their end-to-end functionality. The methodological advances and the obtained results will be disseminated by publication in top-ranking scientific journals and presentation at international conferences, as well as by means of open science and scientific networking. Our final goal is therefore to devise a comprehensive software framework consisting of AI-based imaging analytics with integrated interpretability evaluation that will enhance medical image interpretation, facilitate the clinical workflow from the perspective of radiological examinations of the spine, improve the quality of life of patients with musculoskeletal disorders, and enable further research on innovative orthopedic applications.

Phases of the project and their realization

Work packages (WPs)
WP-1
Image Database
WP-2
AI-Based Imaging Analytics
WP-3
Interpretability Evaluation
WP-4
Software Framework
WP-5
Research Dissemination
2022
WP-1 / Image Database
Completed
WP-2 / AI-Based Imaging Analytics
Completed
WP-5 / Research Dissemination
Completed
2023
WP-1 / Image Database
Completed
WP-2 / AI-Based Imaging Analytics
Completed
WP-3 / Interpretability Evaluation
Completed
WP-4 / Software Framework
Completed
WP-5 / Research Dissemination
In progress
2024
WP-1 / Image Database
In progress
WP-2 / AI-Based Imaging Analytics
In progress
WP-3 / Interpretability Evaluation
In progress
WP-4 / Software Framework
In progress
WP-5 / Research Dissemination
In progress
2025
WP-3 / Interpretability Evaluation
Planned
WP-4 / Software Framework
Planned
WP-5 / Research Dissemination
Planned

Bibliographics records

1.
Domen Ocepek: Segmentation of lumbar vertebrae from computed tomography spine images by applying deep implicit statistical shape models [in Slovenian language]. Master's thesis - University of Ljubljana, Faculty of Electrical Engineering, 2024 (supervisor: Tomaž Vrtovec, co-supervisor: Gašper Podobnik) [COBISS-ID:199629059 ]
2.
Domen Ocepek, Gašper Podobnik, Bulat Ibragimov, Tomaž Vrtovec: Deep implicit statistical shape models for 3D lumbar vertebrae image delineation. SPIE Medical Imaging 2024: Image Processing, Feb 18-22, San Diego, CA, USA, 12926:1292638, 2024 [COBISS-ID:191585795 ] [doi:10.1117/12.3007664 ]
3.
Kamil Ibragimov, Gašper Podobnik, Teodor Trojner, Gregor Rečnik, Tomaž Vrtovec: Mid-sagittal cross-section identification for vertebra landmarking in MR spine images. SPIE Medical Imaging 2024: Image Processing, Feb 18-22, San Diego, CA, USA, 12926:1292637, 2024 [COBISS-ID:191582979 ] [doi:10.1117/12.3007593 ]
4.
Tomaž Vrtovec: The use of AI in orthopedic image analysis. Annual Spine Experts Group Meeting 2023, Nov 30 - Dec 1, Ljubljana, Slovenia, 43, 2023 [COBISS-ID:174753283 ]
5.
Tomaž Vrtovec, Bulat Ibragimov: Spinopelvic measurements of sagittal balance with deep learning: systematic review and critical evaluation. European Spine Journal, 31:2031-2045, 2022 [COBISS-ID:100711939 ] [doi:10.1007/s00586-022-07155-5 ]