Giter Club home page Giter Club logo

Hi! I am Gianluca

👉About me

👉Coding contributions

Biomedical engineer (MSc and BSc) working on AI for Medical Imaging applications

  • Graduate research fellow at the National Research Council (CNR) in Pisa, Italy (Sep 2021 - Ongoing)
  • Last-year PhD student in Information Engineering at the University of Pisa (Nov 2021 - Ongoing). Project: “Boosting deep learning with causality: insights on medical imaging”.
  • My current interests and expertise span out-of-distribution robustness, domain generalization, and explainability through causal reasoning, feature disentanglement and contrastive learning.

Recent research activity in Deep Learning, Biomedical Imaging, Computer Vision and AI

  • Proposed methods based on causal inference to foster DL models’ robustness to domain shift via Transformer/Conv. feature disentanglement, contrastive learning, and injection of prior knowledge. Applied to lung anomalies classification from large chest X-ray datasets.
  • Investigated techniques to discover causal disposition signals in images via Attention-inspired CNNs for cancer prediction from medical imaging (prostate T2w-MRI and digital pathology).
  • Proposed biologically inspired DL networks for image classification akin to human vision.
  • Experienced with DDPMs (generative AI) to synthesize MRI images of prostate cancer.
  • Led a systematic literature review to study the intersection of causality and Explainable AI.
  • Conducted multivar analyses on clinical, biophysical, optical, and MRI data for Alzheimer's.

Technical skills

Programming: Python, Bash, MATLAB, Java, Android, SQL. Python libraries: PyTorch, CUDA, Scikit-learn, Pandas, NumPy, OpenCV, Biopython, PyDicom. Tools: Git version control, Docker, SLURM-based large-scale HPC, NVIDIA DGX, DICOM/NIFTI formats.

Publications

You can find my published research works on my Google Scholar profile.

Some of my coding contributions

  • "MRI Reconstruction" CMRxReconChallenge: A group project together with other PhD students to respond to the MICCAI 2023 challenge https://cmrxrecon.github.io/ regarding cardiac cine MR reconstruction. It was so nice to code all together! Additional contributions here and here. You can read our paper Cine cardiac MRI reconstruction using a convolutional recurrent network with refinement to discover how we performed in the MICCAI STACOM workshop 2023.
  • "OOD/DG robustness" A causal perspective on medical image classification via neural networks (causal_medimg)(private, in progress): When it comes to medical image classification, assessing whether DL algorithms truly capture the cause-and-effect relationship between diseases and their underlying causes (or merely learn to map labels to images) remains a challenge. This work aims at leveraging ideas from causal theory, feature disentanglement and contrastive learning to improve the out of distribution performance of deep learning image classifiers. It separates the features that causally influence the diagnosis and features that act as confounders.
  • "Causality/XAI" Boosting CNNs with knowledge of conditional asymmetries across feature maps (causality_conv_nets): Code for experimenting with causality-aware (driven) CNNs, where the network learns and exploits intrinsic information contained in image datasets regarding the causal disposition of object in the visual scene. See our ESWA 2024 paper Exploiting Causality Signals in Medical Images: A Pilot Study with Empirical Results where we introduce the architecture and the "causality factor extractor". To see how such "causality-driven" neural networks can boost performance and XAI explanations in low-data scenarios (Few-Shot), check our ICCV 2023 paper Causality-Driven One-Shot Learning for Prostate Cancer Grading from MRI!!
  • "Generative AI" (Un)conditional Denoising Diffusion Probabilistic Models: implementation of DDPMs in PyTorch for generating synthetic medical images of prostate cancer patients. I am developing both unconditional and conditional (classifier-free guidance) generation.
  • "Explainable AI (XAI)" ProtoPNet, with @andreaberti11235: In our ICPR 2022 paper, we investigate the application of prototypical part learning to the medical imaging field. In particular, mammographic images are used. The clinical question is to determine the malignancy of breast masses, and the goal is to assess that using Deep Learning methods, without an invasive biopsy, which still remains the gold standard today
  • dataset_utils_scripts, with @andreaberti11235: useful scripts for deep learning pipelines with digital images. Includes: stratified group splitting for dataset preparation, code for early stopping in neural networks' training, image resize and histogram of dimensions, scripts for reading DICOM/NIFTI files and convert them in PNG images, pipelines for Data Augmentation, etc

Project collaborations (Italy, Greece, Portugal)

  • ProCAncer-I European Union Project funded by Horizon 2020 research and innovation programme under grant agreement No 952159
  • TAILOR European Union Project ICT-48 Network (GA 952215). A network of AI research excellence centre
  • NAVIGATOR Tuscany Regional Project. An Imaging Biobank to Precisely Prevent and Predict cancer, and facilitate the Participation of oncologic patients to Diagnosis and Treatment
  • PRAMA Tuscany Regional Project. Proteomics, RAdiomics & Machine learning-integrated strategy for precision medicine for Alzheimer’s

#DeepLearning #MachineLearning #ArtificialIntelligence #MedicalImaging #Causality #Explainability #GenerativeModels

Gianluca Carloni's Projects

causality_conv_nets icon causality_conv_nets

Experiment with our attention-inspired framework for causality-driven CNNs: learn how to model causal dispositions within image datasets and enhance your image classifier's performance and XAI robustness via our causality-factors extractor.

causalnex icon causalnex

A Python library that helps data scientists to infer causation rather than observing correlation.

cgnn icon cgnn

Replication code for the article "Learning Functional Causal Models with Generative Neural Networks"

covidcxr-hackathon_isticnr icon covidcxr-hackathon_isticnr

Repository containing scripts for Covid-CXR-Hackathon 2022. By Berti Andrea and Carloni Gianluca, Institute of Information Science and Technologies (ISTI), National Research Council (CNR), Pisa, Italy

dataset_utils_scripts icon dataset_utils_scripts

Different scripts to be used for specific datasets (e.g, prostate, mammograms, brain) operations and management

deepscm icon deepscm

Repository for Deep Structural Causal Models for Tractable Counterfactual Inference

dgx-a100_utils icon dgx-a100_utils

This tiny repo contains some useful scripts and bash commands to leverage the full potential of the NVIDIA DGX-A100 infrastructure, such as utilizing Docker and automatically deciding the best GPU node(s) to use when running a new job

disentanglement_tutorial icon disentanglement_tutorial

This repository summarizes the material gathered for the tutorial on learning disentangled representations in the imaging domain, and serves as a roadmap for the disentanglement aficionados.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.