Automated Zonal level implant loosening detection from Hip X-ray using a multi-staged approach
Radiolucency;Implant loosening;Gruen zones;Charnley zones
Yes
Not sure if the dataset is open-source, if so based on what compliance?
Yes, Legal compliance (e.g., GDPR, copyright, terms of use)
1. Figure 8 shows the GradCam of the segmentation method. How exactly is this done? The baseline GradCAM is only suitable for classification models.
2. "We ensured that at least 75% of the original images were retained during training" -- What is the rationale behind this? Does this mean the test set was augmented?
3. Panoptic Quality may be a better score to analyze the results instead of dice score:
- Given there are majority classes even based on size here.
- It will be one metric representative of the entire image instead of a class by class analysis (which is definitely good to keep in as well.)
1. It is a novel application of existing deep learning techniques to the field of orthopaedics. 
2. Overall empirical scores seem to be quite high, which indicates a good potential of clinical translation.
3. GradCAM maps (issue discussed below) seem to provide good qualitative confidence in terms of importance regions developed by the network.
The authors have proposed proposed a 3-stage algorithm that detects the sanity of the image for diagnosis, segments into the zones, and then identifies radiolucency within the zones.
1. The primary results stem from high quality annotations rather than theoretical/architectural advancements. Maybe more suited to a different conference. What could be interesting is a multi-task model as the it can be seen a common backbone can be used from all and the there is a definite inter task benefit which could be presented as a custom loss (for a baseline comparison at the least).

2. The overall outline is not very clear to me in terms of the actual task at the final stage. In Stage 3, to my understanding it is classification, but the section discusses of a segmentation loss? A general figure covering the entire pipeline is highly suggested, which combines Figure 4 and 5 along with an additional figure for stage 2.
Yes
none
No ethics review needed.
* Can you relate this work to prior publications in ICLR or closely related confrences? (Right now there are mostly clinical application referenced.)  It would make this study more accesible to the ICLR audience. And it would help you to sharpen the presentation of the contributions that are relevant to the ICLR audience.
* The authors adddress an interesting application
* Reported performances are good
* The contribution to a public resource / dataset is appreciated
The author present a mult-step segmentation approach for a medical image segmentation task. They contribute to the anntoation of a public dataset and report favorable performances in their application
* The study focuses on a very narrow application and the solution proposed is highly specialized on this application
* It is not quite clear what type of segmentation algorithm is used, important technical details are missing (also elsewhere)
Yes
No ethics review needed.
1. I recommend that the paper includes a more extensive dataset to robustly demonstrate the effectiveness of the proposed method. 
2. The explanations of Figure 3 could be more detailed for further understanding of stage 2 and stage 3.
3. Consider provide clearer explanations of loss function formulas  for better precision in mathematical representation.
1. The 3-stage algorithm provide a thorough assessment of implants for the Charnley and Gruen zones, comparing with the common classification of other papers.
2. The experimental results provide evidence of the superiority of this method over other reported methods , which supports its effectiveness.
3. The overall writing is clear and well-structured.
The paper proposes a 3-stage deep learning algorithm for detection of implant loosening after hip replacement surgery. The method involves fitness check of images, region segmentation and loosening detection. Also, Gruen and Charnley zones annotation and zone-wise loosening information are built on a open-source dataset. The experimental results demonstrate high accuracy of the proposed method.
1. The originality of the paper, which proposes a method to segment regions and classify loosening, may not be seen as highly innovative. The techniques of image segmentation and classification have been well-explored in deep learning research.
2. The limited availability of data for training and testing the algorithm may limit its effectiveness in real-world scenarios. The blind testing contains only 38 images, which is not enough to prove its robustness.
Yes
No ethics review needed.
The use of cross-validation across the 3 tasks on this small dataset needs further clarification, to reassure that there has not been data leakage.
Section 4 states the data-split was 70% training and 30% testing which seems inconsistent with the statement that the results are averaged over splits in a 5-fold cross-validation. Can this be clarified?

Is the fully annotated dataset available to other researchers? Is the code?

How was left-right mirroring handled (see e.g. Figure 6)?

It would be useful to clarify how overlapping regions in the annotations were “carefully addressed to ensure separation and non-overlapping markings”. Should adjacent zones not be contiguous?

The loosening classification result in Table 2 seems surprisingly good given that there are presumably some boundary cases which radiologists might disagree on. It would be useful to see such boundary cases given as examples and discussed. Similarly, it would be good to see error examples and discussion for the segmentation problem.
The zone segmentation and loosening classification results seem to be good (using standard methods on a relatively small dataset).
This paper addresses analysis of radiographs of hip protheses. Specifically, the authors propose a system based on deep learning to perform three analysis tasks automatically: (i) assessment of image suitability, (ii) segmentation of ten zones that are used in clinical practice, and (iii) detection of loosening. Evaluation is reported using a dataset of 206 images to which new annotations were added by a radiologist.
The dataset has only 19 “not fit” examples which is too few to train and test the stage 1 classifier. The accuracy reported for this binary classification task is 94% which is not significantly different from chance level which is 91%.

The dataset was annotated by one orthopaedic surgeon and no indication of annotation reliability was provided. It would be preferable to have multiple annotations of at least a subset to give some idea of inter/intra annotator variability. I imagine there is non-negligible variability in the boundaries between adjacent zones, for example. 

The methods used for image segmentation and classification are fairly standard. It would be good to compare with some pre-trained off-the-shelf architectures. The stage 2 network sounds like it is a U-Net but it is not called that in the paper nor is any prior work on U-Nets cited. The loss employed is also quite widely used but again prior work is not cited to make this clear.
@inproceedings{
anonymous2024automated,
title={Automated Zonal level implant loosening detection from Hip X-ray using a multi-staged approach},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=IFOgfaX2Fj},
note={under review}
}
Hip arthroplasty is a surgical procedure that involves the replacement of a patient’s hip joint with a prosthetic implant. While these implants are initially effective, they may eventually fail and necessitate revision surgery. It is important to identify the 3 Charnley and 7 Gruen zones around the implant and then identify the zone-wise radiolucency which indicates loosening for effective pre and post-operative planning. Despite the importance of zones, there is a lack of automation attempts in this field. In this work, we have proposed a 3-stage algorithm that detects the sanity of the image for diagnosis, segments into the zones, and then identifies radiolucency within the zones. We have demonstrated a 94% accuracy for Fit/Not Fit segregation, a 0.95 dice score for our zonal segmentation, and a 98% overall loosening accuracy. Obtaining an average dice score of 0.92 in the segmentation of zones and 0.93 accuracy on loosening detection on a blind dataset indicates the robustness of the proposed algorithm. This work will contribute to the development of more efficient and accurate models to detect implant loosening.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Radiolucency Implant loosening Gruen zones Charnley zones
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/128dc914042ed09405dfde254db60f24c7b8629d.pdf
applications to computer vision, audio, language, and other modalities
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Automated Zonal level implant loosening detection from Hip X-ray using a multi-staged approach
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission