Publications by Costantino Grana

Brain tumor segmentation is a crucial task in medical imaging that involves the integrated modeling of four distinct imaging modalities to identify tumor regions accurately. Unfortunately, in real-life scenarios, the full availability of such four modalities is often violated due to scanning cost, time, and patient condition. Consequently, several deep learning models have been developed to address the challenge of brain tumor segmentation under conditions of missing imaging modalities. However, the majority of these models have been evaluated using the 2018 version of the BraTS dataset, which comprises only $285$ volumes. In this study, we reproduce and extensively analyze the most relevant models using BraTS2023, which includes 1,250 volumes, thereby providing a more comprehensive and reliable comparison of their performance. Furthermore, we propose and evaluate the adoption of Mamba as an alternative fusion mechanism for brain tumor segmentation in the presence of missing modalities. Experimental results demonstrate that transformer-based architectures achieve leading performance on BraTS2023, outperforming purely convolutional models that were instead superior in BraTS2018. Meanwhile, the proposed Mamba-based architecture exhibits promising performance in comparison to state-of-the-art models, competing and even outperforming transformers. The source code of the proposed approach is publicly released alongside the benchmark developed for the evaluation: https://github.com/AImageLab-zip/IM-Fuse.

Reliable estimates of cellular composition and anatomical distribution in the human brain are essential for biologically plausible circuit models. In the hippocampus, existing reconstructions rely on low-resolution (LR) data without explicit cell-type-resolved annotations, limiting quantitative maps of excitatory neurons, inhibitory interneurons, and glial cells. Using newly released 1 um/px BigBrain sections of the right hippocampus, we present CALHippo, Cellular Annotation Library for the Hippocampus, a multiscale resource for cell-type-resolved reconstruction of the human CA complex. CALHippo includes the first expert-validated, cell-level annotated dataset spanning all Cornu Ammonis (CA1-CA4) subfields with explicit three-class labels, together with a lower-resolution mesoscale cellular point-cloud map. High-resolution (HR) cell instances are obtained through a human-in-the-loop pipeline combining foundation-model-based segmentation, iterative expert correction, and model ensembling, and are classified as excitatory neurons, inhibitory interneurons, or glial cells. To extend sparse HR annotations to the full volume, we project them into the 20 um/px LR BigBrain space and use the resulting class-specific supervision maps to train a UNet-based density estimation model. The predicted density maps enable slice-by-slice inference across the full CA complex and are sampled to generate a class-resolved mesoscale cellular point cloud. Code (https://github.com/AImageLab-zip/CALHippo-Framework) and dataset (https://ditto.ing.unimore.it/calhippo) are publicly released to support reproducibility.

Large-scale benchmarks such as BraTS have driven progress in brain tumor segmentation, but they provide only masks with limited access to the clinical semantics found in radiology reports. We introduce ReportX, a paired resource of 257 clinical reports aligned to BraTS-GLI-2023 subjects, structured into a rich set of qualitative and quantitative attributes. Qualitative fields are curated by clinicians, while quantitative descriptors are automatically derived via atlas-based localization and geometric computations. We compare our annotation schema to existing report-augmented datasets and show that ReportX provides substantially broader coverage of clinically relevant factors. To exploit this supervision, we encode reports using biomedical language models and incorporate their embeddings as auxiliary semantic guidance for 3D tumor segmentation during training. Experimental results demonstrate that the proposed vision-text alignment improves segmentation performance on standard BraTS metrics, with clinically curated reports providing more consistent improvements than automatically generated or less-structured counterparts. We publicly release the dataset (https://ditto.ing.unimore.it/reportx) and the source code (https://github.com/AImageLab-zip/ReportX).

Objectives: Aging people with HIV are increasingly affected by multimorbidity and polypharmacy, which heighten the risk of drug–drug interactions (DDIs) and potentially inappropriate medications (PIMs). This study evaluated a multidisciplinary, AI-supported quality improvement intervention designed to optimize polypharmacy management in older people with HIV. Methods: People with HIV aged ≥50 years attending the Modena HIV Metabolic Clinic (MHMC) were invited to submit photos of their medications via WhatsApp. Images were processed by AI for optical character recognition and automatically reconciled with the electronic patient chart (EPC). AI recognition accuracy was 94% when validated against manual review. Pharmacists reviewed AI-generated reports from the NavFarma® decision support system, generated alerts for PIM, defined according to Beers and the STOPP/START criteria, DDIs, anticholinergic burden (ACB), and risks of QTc prolongation and nephrotoxicity. Primary outcome was agreement between patient-reported and EPC-recorded medications. Secondary outcomes included pill burden, total prescribed drugs and actionable alerts. Results: Of 181 participants (median age 63 years; 72% male), 111 (61.3%) showed complete agreement between EPC and patient lists, while 70 (38.7%) had discrepancies. Pharmacist evaluation identified major DDIs in 70.4% of cases, ACB in 26.5%, QTc-prolonging drugs in 81.6% and nephrotoxic agents in 95.9%. Participants with ≥10 total prescribed drugs had higher frailty, pill burden and PIM. Conclusions: AI-assisted medication reconciliation combined with pharmacist review improved the identification of PIM and medication-related risks, supporting safer prescribing in people with HIV. This model aligns with international calls to improve prescribing safety and offers a scalable framework for integrating digital tools into multidisciplinary HIV care.

The segmentation of the Inferior Alveolar Canal (IAC) plays a central role in maxillofacial surgery, drawing significant attention in the current research. Because of their outstanding results, deep learning methods are widely adopted in the segmentation of 3D medical volumes, including the IAC in Cone Beam Computed Tomography (CBCT) data. One of the main challenges when segmenting large volumes, including those obtained through CBCT scans, arises from the use of patch-based techniques, mandatory to fit memory constraints. Such training approaches compromise neural network performance due to a reduction in the global contextual information. Performance degradation is prominently evident when the target objects are small with respect to the background, as it happens with the inferior alveolar nerve that develops across the mandible, but involves only a few voxels of the entire scan. In order to target this issue and push state-of-the-art performance in the segmentation of the IAC, we propose an innovative approach that exploits spatial information of extracted patches and integrates it into a Transformer architecture. By incorporating prior knowledge about patch location, our model improves state of the art by ~2 points on the Dice score when integrated with the standard U-Net architecture. The source code of our proposal is publicly released.

Despite their remarkable success in medical image segmentation, the life cycle of deep neural networks remains a challenge in clinical applications. These models must be regularly updated to integrate new medical data and customized to meet evolving diagnostic standards, regulatory requirements, commercial needs, and privacy constraints. Model merging offers a promising solution, as it allows working with multiple specialized networks that can be created and combined dynamically instead of relying on monolithic models. While extensively studied in standard 2D classification, the potential of model merging for 3D segmentation remains unexplored. This paper presents an efficient framework that allows effective model merging in the domain of 3D image segmentation. Our approach builds upon theoretical analysis and encourages wide minima during pre-training, which we demonstrate to facilitate subsequent model merging. Using U-Net 3D, we evaluate the method on distinct anatomical structures with the ToothFairy2 and BTCV Abdomen datasets. To support further research, we release the source code and all the model weights in a dedicated repository: https://github.com/LucaLumetti/UNetTransplant

In recent years, several algorithms have been developed for the segmentation of the Inferior Alveolar Canal (IAC) in Cone-Beam Computed Tomography (CBCT) scans. However, the availability of public datasets in this domain is limited, resulting in a lack of comparative evaluation studies on a common benchmark. To address this scientific gap and encourage deep learning research in the field, the ToothFairy challenge was organized within the MICCAI 2023 conference. In this context, a public dataset was released to also serve as a benchmark for future research. The dataset comprises 443 CBCT scans, with voxel-level annotations of the IAC available for 153 of them, making it the largest publicly available dataset of its kind. The participants of the challenge were tasked with developing an algorithm to accurately identify the IAC using the 2D and 3D-annotated scans. This paper presents the details of the challenge and the contributions made by the most promising methods proposed by the participants. It represents the first comprehensive comparative evaluation of IAC segmentation methods on a common benchmark dataset, providing insights into the current state-of-the-art algorithms and outlining future research directions. Furthermore, to ensure reproducibility and promote future developments, an open-source repository that collects the implementations of the best submissions was released.

This paper provides a detailed description of how to install, set up, and use "BarBeR" (Barcode Benchmark Repository) to reproduce the results presented in the ICPR 2024 paper "BarBeR: A Barcode Benchmarking Repository". The paper details the tests available in the repository and how the configuration parameters affect and influence experimental results.

Convolutional Neural Networks (CNNs) have been broadly employed in dermoscopic image analysis, mainly due to the large amount of data gathered by the International Skin Imaging Collaboration (ISIC). But where do neural networks look? Several authors have claimed that the ISIC dataset is affected by strong biases, i.e. spurious correlations between samples that machine learning models unfairly exploit while discarding the useful patterns they are expected to learn. These strong claims have been supported by showing that deep learning models maintain excellent performance even when "no information about the lesion remains" in the debased input images. With this paper, we explore the interpretability of CNNs in dermoscopic image analysis by analyzing which characteristics are considered by autonomous classification algorithms. Starting from a standard setting, experiments presented in this paper gradually conceal well-known crucial dermoscopic features and thoroughly investigate how CNNs performance subsequently evolves. Experimental results carried out on two well-known CNNs, EfficientNet-B3, and ResNet-152, demonstrate that neural networks autonomously learn to extract features that are notoriously important for melanoma detection. Even when some of such features are removed, the others are still enough to achieve satisfactory classification performance. Obtained results demonstrate that literature claims on biases are not supported by carried-out experiments. Finally, to demonstrate the generalization capabilities of state-of-the-art CNN models for skin lesion classification, a large private dataset has been employed as an additional test set.

Recently, Multimodal Large Language Models (MLLMs) have emerged as a leading framework for enhancing the ability of Large Language Models (LLMs) to interpret non-linguistic modalities. Despite their impressive capabilities, the robustness of MLLMs under conditions where one or more modalities are missing remains largely unexplored. In this paper, we investigate the extent to which MLLMs can maintain performance when faced with missing modality inputs. Moreover, we propose a novel framework to mitigate the aforementioned issue called Retrieval-Augmented Generation for missing modalities (MissRAG). It consists of a novel multimodal RAG technique alongside a tailored prompt engineering strategy designed to enhance model robustness by mitigating the impact of absent modalities while preventing the burden of additional instruction tuning. To demonstrate the effectiveness of our techniques, we conducted comprehensive evaluations across five diverse datasets, covering tasks such as audio-visual question answering, audio-visual captioning, and multimodal sentiment analysis.