A Normalized Fully Convolutional Approach to Head and Neck Cancer - PowerPoint PPT Presentation

Apr 07, 2023 •101 likes •177 views

A Normalized Fully Convolutional Approach to Head and Neck Cancer Outcome Prediction William Le, Francisco Perdigon Romero and Samuel Kadoury from MediCAL lab, CRCHUM Canada Research Chair in Medical Imaging and Assisted Interventions

A Normalized Fully Convolutional Approach to Head and Neck Cancer Outcome Prediction William Le, Francisco Perdigon Romero and Samuel Kadoury from MediCAL lab, CRCHUM Canada Research Chair in Medical Imaging and Assisted Interventions
Treatment context and 2 medical imaging data Diagnosis Planning Treatment Follow-up FDG PET-CT Planning CT (Chemo-)Radiotherapy 43 months (6-112) Preprocessing ▹ 3D → 2d using max GTV area CT ▹ Isotropic resampling to 1×1 mm Deep ▹ Resizing to 128×128 Convolutional ▹ Normalizing PET to SUV Neural Data Augmentation (x20) Network PET ▹ Flip 50% probability 298 H&N ▹ Shifu up to 40% cancer patients ▹ Rotate up to 20 degrees [1] Vallières, M, et al. (2017). Data from Head-Neck-PET-CT. The Cancer Imaging Archive.
3 Proposed model [1] Xie, Saining, et al. "Aggregated residual transformations for deep neural networks." Proceedings of the IEEE conference on computer vision and pattern recognition , 1492-1500 (2017). [2] Drozdzal, M. et al . Learning normalized inputs for iterative estimation in medical image segmentation. Med. image analysis 44, 1–13 (2018).
4 Training and Evaluation Characteristics Alive / Deceased SeLU activation as regularizer/normalization ▹ 83:18 CHUS Training Residual connections to improve convergence rate ▹ Aggregated convolutions for model capacity regularization Validation ▹ FCN as an target-oriented image-to-image domain ▹ 197 samples (5:1) 77:14 HGJ translation or image normalizer Implementation 60:5 CHUM Test PyTorch using GeForce RTX 2080 TI ▹ 101 samples Categorical cross-entropy loss ▹ 22:19 HMR 1:8 resampling to combat data imbalance ▹ Adam optimizer: 0.0006 lr ▹ Batch size: 8 ▹ Dataset augmented 20 times ▹ Total epochs: 100 (1 hour) ▹ [1] Vallières, M. et al. Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer. Sci Rep 7, 10117 (2017).
Survival binary classification 5 prediction results AUC PET CT Masked CT PET-CT (Spec, Sens) 59% 57% 67% 65% 930,146 parameters CNN¹ (90%, 29%) (37%, 77%) (82%, 52%) (99%, 30%) 59% 65% 63% 70% 1,321,682 parameters FCN+CNN (41%, 77%) (51%, 79%) (35%, 90%) (69%, 71%) 50% 65% 69% 74% AggResCNN 291,874 parameters (100%, 0%) (54%, 76%) (51%, 87%) (66%, 82%) FCN+AggResCNN 57% 70% 67% 76% 683,650 parameters (ours) (21%, 94%) (46%, 94%) (52%, 82%) (61%, 91%) [1] Diamant, A., Chatterjee, A., Vallières, M., Shenouda, G. & Seuntjens, J. Deep learning in head & neck cancer outcome prediction. Sci. reports 9, 1–10 (2019).
6 Conclusion 1. Our proposed CNN model improves over the state-of-the-art for head and neck cancer survival outcome prediction (76% > 65%). 2. Incorporating PET imaging information improves model performance. 3. Our proposed architectural change (FCN, aggregated residual connections) benefit model performance without incurring a larger model complexity cost. 4. The addition of the FCN improves performance when coupled with more complex input features (CT, PET-CT).

Recommend

Neural Network Basics Part II Content Image-to-image Why fully convolutional?

Neural Network Basics Part II Content Image-to-image Why fully convolutional? Fully Convolutional Networks (FCN) Up-sampling Network architecture Recurrent Neural Networks Sequence data and representation

625 views • 45 slides

Convolutional Autoencoder (CAE) Prof. Seungchul Lee Industrial AI Lab. Convolutional Autoencoder

Convolutional Autoencoder (CAE) Prof. Seungchul Lee Industrial AI Lab. Convolutional Autoencoder Motivation: image to autoencoder ? Convolutional autoencoder extends the basic structure of the simple autoencoder by changing the fully

349 views • 15 slides

S 3 D: S ingle S hot multi- S pan D etector via Fully 3D Convolutional Network Da Zhang 1 ,

S 3 D: S ingle S hot multi- S pan D etector via Fully 3D Convolutional Network Da Zhang 1 , Xiyang Dai 2 , Xin Wang 1 , and Yuan-Fang Wang 1 dazhang@cs.ucsb.edu 1 UC Santa Barbara & 2 University of Maryland Task: Temporal Activity Detection

391 views • 21 slides

CONVOLUTIONAL AND RECURRENT NEURAL NETWORKS Neural networks Fully connected networks

CONVOLUTIONAL AND RECURRENT NEURAL NETWORKS Neural networks Fully connected networks Neuron Non-linearity Softmax layer DNN training Loss function and regularization SGD and backprop Learning rate Overfitting

1.8k views • 86 slides

Fully Convolutional Networks for Handwriting Recognition Felipe Petroski Such, Dheeraj Peri,

Fully Convolutional Networks for Handwriting Recognition Felipe Petroski Such*, Dheeraj Peri*, Frank Brockler, Paul Hutkowski, Raymond Ptucha* *Rochester Institute of Technology, Kodak Alaris, 1 Such et al. ICFHR18 Background

579 views • 20 slides

The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation Simon

The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation Simon Jegou , Michal Drozdzal, David Vazquez, Adriana Romero Yoshua Bengio 1 Deep Neural Network use a cascade of multiple layers of units for

640 views • 29 slides

Cascaded 3D Fully Convolutional Networks for Medical Image Segmentation Holger Roth Assistant

Cascaded 3D Fully Convolutional Networks for Medical Image Segmentation Holger Roth Assistant Professor (Research) Nagoya University, Japan Contributors: Hirohisa Oda a , Xiangrong Zhou b , Natsuki Shimizu a , Ying Yang a , Chen Shen a ,

389 views • 25 slides

A Fuller Understanding of Fully Convolutional Networks Evan Shelhamer* Jonathan Long* Trevor

A Fuller Understanding of Fully Convolutional Networks Evan Shelhamer* Jonathan Long* Trevor Darrell UC Berkeley in CVPR'15, PAMI'16 1 pixels in, pixels out colorization Zhang et al.2016 monocular depth + normals Eigen & Fergus 2015

414 views • 38 slides

Convolutional Neural Networks in Speech Lecture 20 CS 753 Instructor: Preethi Jyothi

Convolutional Neural Networks in Speech Lecture 20 CS 753 Instructor: Preethi Jyothi Convolutional Neural Networks (CNNs) Fully connected (dense) layers have no awareness of spatial information Key concept behind convolutional layers is

983 views • 41 slides

Fully Convolutional Network (FCN) Prof. Seungchul Lee Industrial AI Lab. Deep Learning for

Fully Convolutional Network (FCN) Prof. Seungchul Lee Industrial AI Lab. Deep Learning for Computer Vision: Review Source: 6.S191 Intro. to Deep Learning at MIT 2 Segmentation Segmentation task is different from classification task because

522 views • 15 slides

Fully-Convolutional Siamese Networks for Object Tracking Luca Bertinetto, Jack Valmadre, Joo

Fully-Convolutional Siamese Networks for Object Tracking Luca Bertinetto*, Jack Valmadre*, Joo Henriques, Andrea Vedaldi and Philip Torr www.robots.ox.ac.uk/~luca luca.bertinetto@eng.ox.ac.uk Tracking of single, arbitrary objects Problem .

514 views • 19 slides

Convolutional Neural Networks M. Soleymani Sharif University of Technology Fall 2017 Slides

Convolutional Neural Networks M. Soleymani Sharif University of Technology Fall 2017 Slides have been adopted from Fei Fei Li and colleagues lectures and notes, cs231n, Stanford 2017. Fully connected layer Fully connected layers Neurons

680 views • 55 slides

ON TEGRA X1 ALAN WANG, NVIDIA Convolutional Neural Network optimization target Result

DIRECT CONVOLUTION FOR DEEP NEURAL NETWORK CLASSIFICATION ON TEGRA X1 ALAN WANG, NVIDIA Convolutional Neural Network optimization target Result Convolutional Fully Connected Input layer layer Convolutional Layer An example: A E

621 views • 18 slides

SEMANTIC IMAGE SEGMENTATION WITH DEEP CONVOLUTIONAL NETS AND FULLY CONNECTED CRFS Paper by Chen,

SEMANTIC IMAGE SEGMENTATION WITH DEEP CONVOLUTIONAL NETS AND FULLY CONNECTED CRFS Paper by Chen, Papandreou, Kokkinos, Murphy, Yuille Slides by Josh Kelle (with graphics from the paper) Semantic Segmentation Goal: Partition the image into

520 views • 22 slides

Count-ception: Counting by Fully Convolutional Redundant Counting Joseph Paul Cohen - MILA,

Count-ception: Counting by Fully Convolutional Redundant Counting Joseph Paul Cohen - MILA, University of Montreal Genevive Boucher - IRIC, University of Montreal Craig A. Glastonbury - BDI, University of Oxford Henry Z. Lo -

859 views • 51 slides

An approach to fully coupled FBSDEs via functional differential equations Matteo Casserini

Brownian FBSDEs as functional differential equations Fully coupled forwardbackward stochastic dynamics Existence and uniqueness of solutions Related discretization algorithms for Brownian FBSDEs An approach to fully coupled FBSDEs via

760 views • 44 slides

Health System Transformation Update for Media June 14, 2018 Methodology and approach Health

Health System Transformation Update for Media June 14, 2018 Methodology and approach Health System Transformation /2 /2 Blueprinting Target State Re-Allocation Normalized Functions List Current State Normalized MHSAL MHSAL Refine

477 views • 31 slides

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting LSTM

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting LSTM : VALSE 2016/03/23 Content Quick Review of Recurrent Neural Network

738 views • 27 slides

Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural

Transfer Learning with Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural Networks A breakthough Convolutional Neural Networks VGG-16 example Layers of Convolutional filters Bottleneck

625 views • 23 slides

Convolutional Kuan-Ting Lai 2020/3/31 Neural Network Convolutional Neural Networks (CNN)

Convolutional Kuan-Ting Lai 2020/3/31 Neural Network Convolutional Neural Networks (CNN) A.k.a. CNN or ConvNet Adit Deshpande, A Beginner's Guide To Understanding Convolutional Neural Networks. Digital Images Input array: an images

1.42k views • 72 slides

Lecture 5: Edges, Corners, Sampling, Pyramids Thursday, Sept 13 Normalized cross correlation

Lecture 5: Edges, Corners, Sampling, Pyramids Thursday, Sept 13 Normalized cross correlation Best match Template Normalized correlation: normalize for image region brightness Windowed correlation search: inexpensive way to find a

1.08k views • 84 slides

lecture 5 - projective transformation - normalized view volume - GL_PROJECTION matrix - clip

lecture 5 - projective transformation - normalized view volume - GL_PROJECTION matrix - clip coordinates - normalized device coordinates - planes and normals in projective space - Assignment 1 (python and pyopengl) Recall last lecture:

737 views • 39 slides

Convolutional Neural Nets 4-25-16 Reading Quiz Convolutional neural networks are most commonly

Convolutional Neural Nets 4-25-16 Reading Quiz Convolutional neural networks are most commonly used for what sort of task? a) Recognizing images b) Transcribing speech c) Translating documents d) Playing games Neural network review

431 views • 13 slides

Spectral/Discontinuous Galerkin approach to fully kinetic simulations of plasma turbulence with

Spectral/Discontinuous Galerkin approach to fully kinetic simulations of plasma turbulence with reduced velocity space O. Koshkarov 1 V. Roytershteyn 2 (PI) G. L. Delzanno 1 G. Manzini 1 1 Los Alamos National Laboratory 2 Space Science Institute

384 views • 11 slides