LEARNING ANALYSIS OF BREAST MRI S FOR
PREDICTION OF OCCULT INVASIVE DISEASE IN DUC TAL CARCINOMA IN SITU

arXiv:1711.10577v1 [] 28 Nov 2017

D EEP

Zhe Zhu, Michael Harowicz, Jun Zhang, Ashirbani Saha, Lars J. Grimm
Department of Radiology
Duke University
Durham, NC 27705, USA
zhe.zhu@duke.edu, michael.harowicz@gmail.com
{jun.zhang.2017,as698,lars.grimm}@duke.edu
E.Shelley Hwang
Department of Surgery
Duke University Comprehensive Cancer Center
Durham, NC 27705, USA
shelley.hwang@duke.edu

Maciej A. Mazurowski
Department of Radiology
Duke University
Durham, NC 27705, USA
maciej.mazurowski@duke.edu

A BSTRACT
Purpose: To determine whether deep learning-based algorithms applied to breast
MR images can aid in the prediction of occult invasive disease following the diagnosis of ductal carcinoma in situ (DCIS) by core needle biopsy.
Material and Methods: In this institutional review board-approved study, we
analyzed dynamic contrast-enhanced fat-saturated T1-weighted MRI sequences
of 131 patients at our institution with a core needle biopsy-confirmed diagnosis of
DCIS. The patients had no preoperative therapy before breast MRI and no prior
history of breast cancer. We explored two different deep learning approaches to
predict whether there was a hidden (occult) invasive component in the analyzed
tumors that was ultimately detected at surgical excision. In the first approach, we
adopted the transfer learning strategy, in which a network pre-trained on a large
dataset of natural images is fine-tuned with our DCIS images. Specifically, we
used the GoogleNet model pre-trained on the ImageNet dataset. In the second
approach, we used a pre-trained network to extract deep features, and a support
vector machine (SVM) that utilizes these features to predict the upstaging of the
DCIS. We used 10-fold cross validation and the area under the ROC curve (AUC)
to estimate the performance of the predictive models.
Results: The best classification performance was obtained using the deep features
approach with GoogleNet model pre-trained on ImageNet as the feature extractor
and a polynomial kernel SVM used as the classifier (AUC = 0.70, 95% CI: 0.580.79). For the transfer learning based approach, the highest AUC obtained was
0.53 (95% CI: 0.41-0.62).
Conclusion: Convolutional neural networks could potentially be used to identify
occult invasive disease in patients diagnosed with DCIS at the initial core needle
biopsy.

1

I NTRODUCTION

While most breast cancers are diagnosed via a core needle biopsy (CNB), the limited size, number,
and location of samples can lead to undersampling which can miss occult invasive disease. For
ductal carcinoma in situ (DCIS), upstaging to invasive disease at surgical excision occurs in roughly
one quarter of cases Brennan et al. (2011). Failure to diagnose invasive disease prior to surgery can
have multiple clinical implications. By definition, DCIS has no metastatic potential so evaluation
1

of regional lymph nodes or distant sites of disease are not performed initially van Roozendaal et al.
(2016). Treatment options are different between DCIS and invasive disease, so patients may need
to undergo additional surgical procedures if invasive disease is missed. Clinical outcomes are worse
for invasive disease, so conversations with patients must subsequently change Martinez-Perez et al.
(2017). Lastly, some patients with DCIS may elect to forgo surgery and pursue active surveillance,
but the presence of occult invasive disease makes this management strategy riskier Grimm et al.
(2017).
While multiple efforts have been aimed at using pathology and mammographic features to predict
upstaging Brennan et al. (2011), there has been limited work utilizing MRI which boasts the greatest
sensitivity for cancer detection. Harowicz et al has shown that hand-crafted MRI features Harowicz
et al. (2017) could be effective in predicting DCIS upstaging. However, deep learning offers a
promising alternative means of identifying occult invasive disease, based on promising results for
translating natural image classification Krizhevsky et al. (2012); Szegedy et al. (2015) to medical
image classification Shin et al. (2016).
The success of deep learning approaches in natural image processing is primarily the result of diverse and sufficient training samples. For example in the ImageNet Jia Deng et al. (2009) classification challenge, there are up to 1000 categories of images with 1000 examples for each category,
resulting in 1 million training images in total. However, medical imaging datasets are much smaller
which hinders the training of convolutional neural networks, due to over-fitting. Nevertheless, deep
learning-based methods have been applied to medical imaging for segmentation Gao et al. (2016b),
detection Navab et al. (2015), and classification Gao et al. (2016a) tasks by utilizing problem-specific
modifications. For example, to predict the pixels in the border region in biomedical image segmentation, the missing context is extrapolated by mirroring the input image Ronneberger et al. (2015).
For more details reader can refer to the surveys Litjens et al. (2017); Greenspan et al. (2016) of deep
learning in medical imaging.
In this study, we applied deep learning techniques to breast MRIs to identify which patients diagnosed with DCIS at core needle biopsy have occult invasive disease. For this purpose, we evaluated
two approaches. In the transfer learning approach, instead of random initialization, a pre-trained
model was used as the starting point in training. In the deep feature based method, the feature
map of a certain layer of the pre-trained network was used as imaging variables (features) and a
traditional classifier, such as support vector machine, was trained using the extracted features.

2
2.1

M ATERIALS AND M ETHODS
PATIENT P OPULATION

Following Institutional Review Board approval, we reviewed patient data at our institution from
January 1, 2000 to March 23, 2014 to identify patients who underwent MRI and were diagnosed
with breast cancer. We identified women satisfying the following criteria: CNB-confirmed DCIS
without invasive cancer, a preoperative bilateral breast MRI with a nonfat-saturated T1-weighted
MRI sequence, no neoadjuvant therapy before breast MRI, and no prior history of breast cancer.
Using these criteria, we identified 131 patients in total, of whom 35 were upstaged to invasive
cancer at surgery. Patient demographics for the cohort are illustrated in Table 1.
2.2

MR I MAGING

All patients in this study underwent MR imaging of the breast, where preoperative breast axial
dynamic contrast-enhanced MRI scans were acquired using 1.5T and 3.0T scanners in the prone
position. For each patient, there was a pre-contrast sequence and at least 3 post-contrast sequences.
The information about the scanners and the MRI protocols are listed in Table 2.
2.3

I MAGE A NNOTATION

One fellowship-trained breast-imaging radiologist with 1 year of experience at our institution annotated the images. We provided the reader with a T1-weighted pre-contrast fat-saturated sequence,
T1-weighted post-contrast fat-saturated sequence, and the sequence showing the subtraction be2

Table 1: Clinicopathologic characteristics of DCIS.
Characteristic
No. of Patients (%)
Age
30-40
18(13.7)
40-50
42(32.1)
50-60
42(32.1)
60-70
22(16.8)
70-80
7(5.3)
Race
White
100(76.3)
Black
22(16.8)
Others
6(4.6)
N/A
3(2.3)
Menopausal status
Pre
61(46.6)
Post
68(51.9)
N/A
2(1.5)
ER status
Neg
26(19.8)
Pos
99(75.6)
N/A
6(4.6)

Scanner
Signa HDx
Signa HDx/HDxt
MAGNETOM Trio
MAGNETON Avanto

Table 2: Scanner information and MRI protocols.
Field Strength(T) FOV(cm) Matrix Size TE (msec)
3.0
34
350*350
2.4
1.5
38
350*350
2.4
3.0
36
448*448
1.4
1.5
36
448*448
1.3

TR (msec)
5.7
5.3
4.1
4.0

tween these two sequences. Additional information was also provided to the reader for further
assistance: breast CNB location of the DCIS collected from the medical record and access to the
MRI exam in our institution’s picture archiving and communication system (PACS). For each case,
a compact 2D bounding box was drawn around the lesion region by the reader using a graphical user
interface (GUI). After the reader reviewed the case, the range of slices that encompassed the totality
of the lesion was chosen, resulting in the 3D bounding box for each tumor. A visualization of the
MRI with 3 orthorhombic views is shown in Figure 1.
2.4

C LASSIFICATION F RAMEWORK

Our approach was developed to classify each tumor as containing an invasive component or not, and
thus the considered task is a binary classification task. The classification steps for a given image

Figure 1: A visualization of the MRI with 3 orthorhombic views.
3

Figure 2: Patch extraction and data augmentation.

were as follows: (1) preprocessing of the image, (2) extracting patches to represent the tumor, (3)
application of a deep learning-based classifier. The details of the steps are described below.

2.5

MR I MAGING P RE - PROCESSING AND T UMOR PATCH E XTRACTION

Since multiple scanners were used to acquire the MRIs, there were several different spatial resolutions in our imaging data. Therefore, the first step was to register all the MRIs to achieve the same
pixel spacing in x-y coordinates. The most common pixel spacing was chosen, and MRIs with other
values of the pixel spacing parameter were scaled using bilinear interpolation.
For each patient, there were 4 sequences scanned at different times before and after the administration of contrast. We used the patch-based method that extracted patches from each slice as training
samples. For each patient, the number of slices of the MRI was between 100 and 200, so there
can be multiple samples for each patient. Since we used a network pre-trained on natural images
that has three channels (red, green, and blue), we concatenated S 0 − Sp ,S 00 − Sp and S 000 − Sp
as 3-channel image where S 0 , S 00 and S 000 are 3 post-contrast sequences and Sp is the pre-contrast
sequence. For the same patient, the size of the lesion might differ in different slices. In order to
eliminate the interference of non-lesion regions, only slices which contain lesion whose area of the
bounding box is larger than 100 pixels were chosen for further processing. Then the center of the
lesion was calculated from its bounding box. To further generate more samples, except the patch
centered at the lesion center, 5 additional samples were generated by random rotations. We chose
120×120 as the patch size according to the statistics of our DCIS dataset: the longest edge of the
lesion’s bounding box ranges between 40 and 160 for 80% of the patients, so this size could cover
most part of the lesion while the proportion of the lesion in the patch was not too small for some
cases. The patch extraction and data augmentation strategy are illustrated in Figure 2. Finally, there
were 30426 patches generated in total, which is a reasonable number for transfer learning and deep
features approach.
4

2.6

D EEP L EARNING P LATFORM

We used deep learning in two ways: transfer learning and off-the-shelf deep features. We chose
GoogleNet7 which is one of the most representative network in image classification as the basis
of our analysis. The details of the training are presented below. For our experiments, we used the
CAFFE Jia et al. (2014) framework on a desktop computer with a NVIDIA GTX 1080 GPU.
2.7

T RANSFER L EARNING

In our transfer learning approach, we chose GoogleNet pre-trained on ImageNet, which consists of
convolution layers, Inception layers, and fully connected layers. Though convolution layers can deal
with arbitrary input sizes, fully connected layers can only process fixed input dimension. To fit the
input size of the GoogleNet and reduce the problem of overfitting in training, all patches extracted
from the MRI images were resized to 256×256×3 using bilinear interpolation, and a 224×224×3
randomly sampled sub-image was cropped during each epoch in the training phase. The output
dimension of the last fully connected layer of pre-trained GoogleNet is 1000 since there are 1000
categories in ImageNet. Here, we modified that dimension to 2 for our binary classification task.
The last fully connected layer was completely re-initialized randomly while all the other layers
maintained their weights from the pre-training. Since shallow layers correspond to more general but
low-level image features while deeper layers are higher level but task-specific, the learning rate of
deeper layers should be set larger than that of shallow layers. In our implementation, the learning
rate for the final fully connected layer was set to 0.001 and the learning rate of all the other layers
was set to 0.0001. Following a seminal publication in the field6 we used the following parameters in
training: the maximum number of iterations was set to 200000, gamma was set to 0.96, momentum
was set to 0.9, batch size was set to 32. We used stochastic gradient descent (SGD) for training.
2.8

O FF - THE - SHELF D EEP F EATURES

Since our task is to classify the upstaging of the DCIS, we chose ImageNet pre-trained networks using a classification task, as similar task should share more common features. More specifically, we
chose the GoogleNet pre-trained on ImageNet and used the feature map of the last fully connected
layer Zhou et al. (2014) as the primary feature map and trained an SVM on those features. As each
individual patch can generate a unique feature vector, there were tens of thousands training samples
for SVM. Since kernel functions have great influence on the performance of the SVM, several different kernel functions were evaluated during our experiments. The feature maps of different layers
were also evaluated for comparison.
2.9

M ODEL E VALUATION

We used 10-fold cross-validation scheme to evaluate the trained classifiers. The data was split by
patients, ensuring that data (multiple patches) for one patient were fully contained in the training
set or in the test set (never in both). Note that there are multiple slices for each patient. We picked
5 slices that have the 5 largest lesion areas, and for each slice the patch centered at the lesion’s
bounding box center without translation and rotation was chosen for the test. Then, scores of the 5
patches were averaged. The AUCs in the 10-folds were averaged to arrive at the final performance
evaluation. Each fold had a similar rate between positive (upstaged) samples and negative (not
upstaged) samples. Confidence intervals for AUCs were estimated using the bootstrapping strategy.

3

R ESULTS

The transfer learning approach resulted in a final AUC of 0.53 (95% CI: 0.41-0.62). The AUC-based
training curve for the network is shown in Figure 3. For the performance on the training set, the AUC
increased during the first 10 epochs, and reached the stable value of 0.96 after 10 epochs. On the
contrary, the performance on the test set varied around 0.53, showing performance close to chance.
This indicates a strong overtraining effect when transfer learning is applied to our problem.
For the off-the-shelf deep feature based approach, the highest AUC obtained was 0.70 (95% CI:
0.58-0.79) with an SVM using polynomial kernel. To further verify this result, we altered the patch
5

Figure 3: AUC training curves for transfer learning. Orange line is the AUC for the test set while
the blue line is the AUC for the training set.

Table 3: AUCs with different patch sizes and kernels of SVM.
Patch Size Kernel Function Training AUC Test AUC
75
poly
0.81
0.68
80
rbf
0.84
0.55
80
poly
0.86
0.70
80
linear
0.77
0.63
85
poly
0.85
0.67
100
poly
0.86
0.65

size in the patch extraction step and explored different kernel functions in SVM. Representative
results are illustrated in Table 3. To achieve the best suitable patch size, we fixed the kernel function
in SVM to polynomial, and found that 80 was the best patch size for our dataset. The result of using
80 as the patch size and polynomial kernel SVM is illustrated in row 4 of Table 3. Results with
different patch sizes but the same kernel function in SVM are illustrated in row 2, row 6, and row
7 of Table 3. To choose the best kernel function in SVM, we fixed the patch size and evaluated
the performance of different kernel functions in SVM. The results using the same patch size with
different kernel functions in SVM are illustrated in row 3, row 4, and row 5 of Table 3. These results
indicate that polynomial kernel function has the highest performance for our DCIS dataset.
Our primary results were obtained by using the feature map of the last fully connected layer. Additionally, we investigated the performances of different layers’ feature maps of GoogleNet. Specifically, the GoogleNet consists of 2 convolution layers, 9 Inception layers and 1 fully connected layer.
Except the last fully connected layer, feature maps of other layers are 2-dimensional matrices in
each feature channel, making the overall dimension too large. Thus, for those feature maps, we used
a max pooling strategy in the image plane, so the dimension of the output feature map equals to
the number of original feature channels. For example, the output of the first convolution layer is a
64×112×112 matrix, and the max pooled feature vector is a 64-dimensional vector. For each layer’s
max pooled feature map, an SVM with polynomial kernel was trained as a classifier. The results
using different layers’ feature maps are illustrated in Table 4 and Figure 4 respectively. From these
results we can conclude that the last fully connected layer has the highest performance in our task.
Finally, we also evaluated the classification performance in terms of AUC for each individual feature
from the set of 1000 deep features used in our primary multivariate (SVM) model. In order to
perform the classification, the value of each individual feature was regarded as the predicted score.
The AUCs for all the features, ordered by the performance, are illustrated in Figure 5. The AUC
of each individual feature ranged from 0.5 to 0.69. This indicates that the best performance, which
was obtained by combining all these features, is slightly higher than the best performance by using
single feature only.
6

Conv1
Feature
Length
Training
AUC
Test
AUC

Table 4: Performance of feature maps from different layers.
Conv2 Incp1 Incp2 Incp3 Incp4 Incp5 Incp6

Incp7

Incp8

Incp9

FC1

64

192

256

480

512

512

512

528

832

832

1024

1000

0.81

0.82

0.86

0.82

0.84

0.74

0.74

0.72

0.78

0.76

0.84

0.86

0.45

0.47

0.53

0.53

0.59

0.55

0.55

0.57

0.64

0.58

0.69

0.70

Figure 4: AUCs for different feature maps.

Figure 5: AUCs for each individual feature. Features have been sorted by AUC.

7

4

D ISCUSSION

Prediction of occult invasive disease in DCIS is of high importance in the current clinical practice of
breast cancer treatment. With accurate prediction of upstaging to invasive using MRI image features
before surgery, DCIS patients would be given more personalized and appropriate treatment earlier.
Furthermore, identifying invasive disease among DCIS patients is crucial when selecting patients
for active surveillance. Since in this new treatment paradigm the patient does not undergo surgery,
missing an invasive component could have significant negative consequences to the patient.
We studied the problem of predicting upstaging of DCIS using two deep learning methods: transfer
learning and off-the-shelf deep features. The transfer learning approach suffered from overfitting and
resulted in poor classification performance, while the off-the-shelf deep features approach achieved
relatively good results. Results of the latter approach show promise of using deep learning approach
to predict the upstaging of DCIS.
Our experiment with transfer learning indicated that insufficient training data can cause the overfitting problem. Although some previous studies have shown that pre-trained deep networks can
generalize well to some other tasks Zhou et al. (2014), in our evaluation of transfer learning, the
performance on training set reached near perfect while on the test set the performance resembled
random guess. This implies that fine-tuning a pre-trained network on a new task still requires significant amount of data specific to the solved task which was not available in this study. Compared
with the random weights initialization in training from scratch, transfer learning starts with better
initial weights. Nevertheless sufficient data is also needed to train the weights in each layer of the
network.
Two main factors contributed the promising results using deep features approach. First, the pretrained networks can extract rich image features. Specifically, since we used the pre-trained network
on classification task, the extracted features were more suited for DCIS upstaging prediction. Second, the extracted features were used to train a traditional classifier (SVM) which is less prone to
overfitting as compared with deep neural networks. Using medical imaging for prediction of occult invasive disease in DCIS is a relatively new topic and limited literature is available. The gold
standard is MRI review by highly trained breast imagers Wisner, DJ; Hwang, ES; Chang, CB; Tso,
HH; Joe, BN; Lessing, JN; Lu, Y; Hylton (2013), but there has been interest in exploring a more
reproducible and automated process for this task. Recently, Harowicz et al. Harowicz et al. (2017)
showed that an individual hand crafted feature of MRI may be predictive of occult invasive disease.
However no multivariate model was presented in this study. Shi et al. Shi et al. (2017) showed
that mammographic features could also potentially be used to distinguish DCIS from invasive cancer. Our study builds on these results by showing that deep learning methods which do not require
design and selection of specific features could be used for this task despite a small sample size.
Our work had limitations. First, the evaluation result using 10-fold cross-validation is a common
choice, however, the lack of an independent test set is a limitation. Second, the deep features were
used as a ”black box” which means that those features might not have a specific meaning that would
be understandable to a clinician. Finally, the size of the analyzed dataset was limited. Future studies with a larger dataset are required to validate the results presented in our paper. Further, we
acknowledge that an AUC of 0.70, while promising, is not sufficiently accurate for clinical use in
separation from other currently used tools. Thus, further steps to optimize the performance of the
model are planned. The primary step to improving performance of this classifier is a collection of
a large multi-institutional dataset for training. This will allow for more optimal utilization of the
power of convolutional neural networks. Furthermore, an improved normalization of the images
from different imaging protocols might result in improvements in performance. Finally, while the
imaging-based mode alone might not achieve a sufficiently high predictive performance, a combination of the imaging-based model with a pathology-based model could result in satisfactory prediction
accuracy. In the long term, in order to incorporate these types of tools to the clinical setting, we must
perform a validation of the optimized tool in a multi-institutional setting as well as place it in the
proper context of other clinicopathologic variables.
In conclusion, we demonstrated that a deep learning-based model based on MR imaging showed
predictive power for identifying occult invasive cancer in patients diagnosed with ductal carcinoma
in situ using core needle biopsy. Further refinement of this has the potential to be of clinical value
for patients with DCIS making treatment decisions for their disease.
8

R EFERENCES
Meagan E Brennan, Robin M Turner, Stefano Ciatto, M Luke Marinovich, James R French, Petra
Macaskill, and Nehmat Houssami. Ductal Carcinoma in Situ at Core-Needle Biopsy: MetaAanalysis of underestimation and predictors of invasive breast cancer. Radiology, 260(1):119–
128, 2011. doi: 10.1148/radiol.11102368.
Mingchen Gao, Ulas Bagci, Le Lu, Aaron Wu, Mario Buty, Hoo-Chang Shin, Holger Roth, Georgios Z. Papadakis, Adrien Depeursinge, Ronald M. Summers, Ziyue Xu, and Daniel J. Mollura. Holistic classification of CT attenuation patterns for interstitial lung diseases via deep
convolutional neural networks. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, pp. 1–6, 2016a. ISSN 2168-1163. doi: 10.1080/21681163.2015.
1124249. URL https://www.tandfonline.com/doi/full/10.1080/21681163.
2015.1124249.
Mingchen Gao, Ziyue Xu, Le Lu, Aaron Wu, Isabella Nogues, Ronald M. Summers, and Daniel J.
Mollura. Segmentation label propagation using deep convolutional neural networks and dense
conditional random field. 2016 IEEE 13th International Symposium on Biomedical Imaging
(ISBI), pp. 1265–1268, 2016b. ISSN 19458452. doi: 10.1109/ISBI.2016.7493497. URL
http://ieeexplore.ieee.org/document/7493497/.
H. Greenspan, B. van Ginneken, and R. M. Summers. Guest Editorial Deep Learning in Medical
Imaging: Overview and Future Promise of an Exciting New Technique. IEEE Transactions on
Medical Imaging, 35(5):1153–1159, 2016. ISSN 0278-0062. doi: 10.1109/TMI.2016.2553401.
Lars J. Grimm, Marc D. Ryser, Ann H. Partridge, Alastair M. Thompson, Jeremy S. Thomas, Jelle
Wesseling, and E. Shelley Hwang. Surgical Upstaging Rates for Vacuum Assisted Biopsy Proven
DCIS: Implications for Active Surveillance Trials. Annals of Surgical Oncology, 2017. ISSN
1068-9265. doi: 10.1245/s10434-017-6018-9. URL http://link.springer.com/10.
1245/s10434-017-6018-9.
Michael R. Harowicz, Ashirbani Saha, Lars J. Grimm, P. Kelly Marcom, Jeffrey R. Marks, E. Shelley
Hwang, and Maciej A. Mazurowski. Can algorithmically assessed MRI features predict which
patients with a preoperative diagnosis of ductal carcinoma in situ are upstaged to invasive breast
cancer? Journal of Magnetic Resonance Imaging, pp. 1–9, 2017. ISSN 15222586. doi: 10.1002/
jmri.25655.
Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick,
Sergio Guadarrama, and Trevor Darrell. Caffe : Convolutional Architecture for Fast Feature Embedding. Proceedings of the ACM International Conference on Multimedia - MM ’14,
pp. 675–678, 2014. ISSN 9781450330633. doi: 10.1145/2647868.2654889. URL http:
//dl.acm.org/citation.cfm?doid=2647868.2654889.
Jia Deng, Wei Dong, R. Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. ImageNet: A large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, 2009. ISSN 1063-6919. doi: 10.1109/CVPRW.2009.5206848. URL http:
//ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5206848.
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. ImageNet Classification with Deep Convolutional Neural Networks. Advances In Neural Information Processing Systems, pp. 1–9, 2012.
ISSN 10495258. doi: 10.1145/3065386.
Geert Litjens, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud Arindra Adiyoso Setio, Francesco
Ciompi, Mohsen Ghafoorian, Jeroen A. W. M. van der Laak, Bram van Ginneken, and Clara I.
Sánchez. A Survey on Deep Learning in Medical Image Analysis. Medical Image Analysis, 42
(1995):60–88, 2017. doi: 10.1016/j.media.2017.07.005.
Carlos Martinez-Perez, Arran K. Turnbull, Gregory E. Ekatah, Laura M. Arthur, Andrew H. Sims,
Jeremy S. Thomas, and J. Michael Dixon. Current treatment trends and the need for better predictive tools in the management of ductal carcinoma in situ of the breast. Cancer Treatment Reviews,
55:163–172, 2017. ISSN 15321967. doi: 10.1016/j.ctrv.2017.03.009.
9

Nassir Navab, Joachim Hornegger, William M. Wells, and Alejandro F. Frangi. Computer-Aided
Pulmonary Embolism Detection Using a Novel Vessel-Aligned Multi-planar Image Representation and Convolutional Neural Networks. Medical Image Computing and Computer-Assisted
Intervention, 9350:62–69, 2015. ISSN 16113349. doi: 10.1007/978-3-319-24571-3.
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention, 9351:
1–8, 2015. ISSN 16113349. doi: 10.1007/978-3-319-24574-4 28. URL http://arxiv.
org/abs/1505.04597.
Bibo Shi, Lars J. Grimm, Maciej A. Mazurowski, Jay A. Baker, Jeffrey R. Marks, Lorraine M.
King, Carlo C. Maley, Shelley E. Hwang, and Joseph Y. Lo. Prediction of occult invasive disease
in ductal carcinoma in situ using deep learning. Proc. SPIE 10134, Medical Imaging 2017:
Computer-Aided Diagnosis, 101341I, 2017. doi: 10.1117/12.2255731.
Hoo Chang Shin, Holger R. Roth, Mingchen Gao, Le Lu, Ziyue Xu, Isabella Nogues, Jianhua
Yao, Daniel Mollura, and Ronald M. Summers. Deep Convolutional Neural Networks for
Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning. IEEE Transactions on Medical Imaging, 35(5):1285–1298, 2016. ISSN 1558254X. doi:
10.1109/TMI.2016.2528162.
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. Going deeper with convolutions. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition,
07-12-June:1–9, 2015. ISSN 10636919. doi: 10.1109/CVPR.2015.7298594.
L. M. van Roozendaal, B. Goorts, M. Klinkert, K. B. M. I. Keymeulen, B. De Vries, L. J. A.
Strobbe, C. A. P. Wauters, Y. E. van Riet, E. Degreef, E. J. T. Rutgers, J. Wesseling, and M. L.
Smidt. Sentinel lymph node biopsy can be omitted in DCIS patients treated with breast conserving therapy. Breast Cancer Research and Treatment, 156(3):517–525, 2016. ISSN 01676806. doi: 10.1007/s10549-016-3783-2. URL http://link.springer.com/10.1007/
s10549-016-3783-2.
NM Wisner, DJ; Hwang, ES; Chang, CB; Tso, HH; Joe, BN; Lessing, JN; Lu, Y; Hylton. Features
of Occult Invasion in Biopsy-Proven DCIS at Breast MRI. The Breast Journal, 19(6):650–658,
2013. ISSN 9780123850447. doi: 10.1111/tbj.12201.
Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, and Aude Oliva. Learning
Deep Features for Scene Recognition using Places Database. Proceedings of the 27th International Conference on Neural Information Processing Systems, 1:487–495, 2014. ISSN
10495258. doi: 10.1162/153244303322533223. URL http://papers.nips.cc/paper/
5349-learning-deep-features-for-scene-recognition-using-places-database.
pdf.

10

