Comicolorization: Semi-Automatic Manga Colorization

arXiv:1706.06759v4 [] 28 Sep 2017

CHIE FURUSAWA*, DWANGO Co., Ltd.
KAZUYUKI HIROSHIBA*, DWANGO Co., Ltd.
KEISUKE OGAKI, DWANGO Co., Ltd.
YURI ODAGIRI, DWANGO Co., Ltd.

© Minene Sakurano

© Kaoru Kawakata

Ref.
images

© Eri Nakanuki

Colorization results

Fig. 1. Colorization results by the proposed system. Each row illustrates pages from the same manga title. The leftmost column shows reference images. Each
manga page is colorized by the reference images. Note that we do not provide manual interactive revisions for these images. All manga are from the Manga
109 dataset [Matsui et al. 2016].
We developed Comicolorization, a semi-automatic colorization system
for manga images. Given a monochrome manga and reference images as
inputs, our system generates a plausible color version of the manga. This is
the first work to address the colorization of an entire manga title (a set of
manga pages). Our method colorizes a whole page (not a single panel) semiautomatically, with the same color for the same character across multiple
panels. To colorize the target character by the color from the reference image,
we extract a color feature from the reference and feed it to the colorization
network to help the colorization. Our approach employs adversarial loss to
encourage the effect of the color features. Optionally, our tool allows users
*:The first two authors are contributed equally.

to revise the colorization result interactively. By feeding the color features
to our deep colorization network, we accomplish colorization of the entire
manga using the desired colors for each panel.

1

INTRODUCTION

Manga (Japanese comics) have attracted readers all over the world.
Because manga are usually created with a pen and ink on white
paper, most existing manga are monochrome. To make the existing
manga more attractive, there is a strong demand for a colorization
technique for monochrome manga. However, manual colorization

(a) Baseline 1

(b) Baseline 2

(c) Our Method

the same character might be colorized by the different colors, such
as the yellow hair of the second row. These two tendencies caused
by the color ambiguity problem are typical of automatic methods.
To colorize the same character by the same color, the results become
faint and non-vivid. If the system colorizes characters more vividly,
the same character would have the different colors.
To solve the color ambiguity problem, we propose a semi-automatic
colorization method (Fig. 3). To colorize the input manga images,
our system takes reference images as additional inputs. From each
reference image, a color feature is extracted. Our system colorizes
the manga images using the extracted color feature. Fig. 2(c) shows
the result of the proposed approach with a reference image. The
characters are colorized not only vividly but also with the same color
for the same area, such as orange hair. Compared to the manual
colorization, our system drastically reduces the operations because
only a small number of interactions are required (only selecting reference images for each character). Fig. 1 illustrates other examples,
where several manga pages were colorized using reference images.
To further refine the result, our system provides standard interactive refinement functions, such as providing color dots [Sangkloy
et al. 2017; Zhang et al. 2017] or controlling the dominant color. A
user who is not satisfied with the result can interactively modify it.

2
Fig. 2. Examples of the color ambiguity problem: (a) Results by [Iizuka et al.
2016]. (b) Results by [Iizuka et al. 2016] + adversarial loss [Goodfellow et al.
2014]. (c) Our results.

of manga is a time-consuming task because the artist needs to edit
each page one by one.
To efficiently colorize manga, full automatic colorization methods
with convolutional neural networks (CNNs) have been proposed
[Cheng et al. 2015; Iizuka et al. 2016; Isola et al. 2017; Zhang et al.
2016]. However, it is impossible for such full automatic methods
to beautifully colorize a whole manga title (a set of manga pages)
because of the “color ambiguity problem.”
The color ambiguity problem is defined as follows. A manga title
typically consists of hundreds of pages, where each page is composed of several panels (Fig. 1). It is therefore essential to colorize
the same character by the same color across all panels. This is not a
trivial task, because (1) the same character might be visually different, and (2) different characters might seem visually similar. This is
the color ambiguity problem, and is the reason that fully automatic
methods do not work well.
Fig. 2 illustrates an example. Each column contains three panels
with the same character, where the automatic method does not work
well. The first and second columns show the colorized results by
fully automatic methods. Fig. 2(a) shows the results by [Iizuka et al.
2016]. Fig. 2(b) shows the results by [Iizuka et al. 2016] + adversarial
loss [Goodfellow et al. 2014]. Our objective is to colorize three panels
beautifully by the same color composition. Fig. 2(a) and (b) show two
typical tendencies of the automatic methods. Fig. 2(a) is colorized by
“faint” colors, i.e., reddish and non-vivid in this case. By this type of
method, all images are colorized by such faint and non-vivid colors.
On the other hand, each character of Fig. 2(b) is colorized by vivid
colors (e.g., the fresh green hair color of the third row). However,

PROPOSED SYSTEM

Fig. 3 shows an overview of our system. The pre-processing step,
including the automatic panel segmentation, is explained in Sec. 2.1.
Sec. 2.2 introduces the semi-automatic colorization method. The
revision functions are explained in Sec. 2.3. Sec. 2.4 describes the
post-processing step for obtaining a complete colorized manga page.

2.1

Automatic Panel Segmentation

Our system requires manga pages and reference images of each character as inputs. First, we binarize the input manga. Then, our system
segments the input manga pages into panels for the colorization
phase. Panel detection and segmentation are performed automatically on the basis of [Ishii et al. 2009]. This process is illustrated in
Fig. 3(a).

2.2

Semi-Automatic Colorization

Each segmented panel (character) is colorized using our CNN architecture (Fig. 3(b)). Our architecture is based on [Iizuka et al. 2016],
which is a convolutional encoder-decoder network with an additional classification branch. Our model has three improvements over
theirs:
• leveraging color features from reference images,
• training the classification branch using character names,
• training with adversarial loss for vivid colorization.
Please see Sec.5 for the details of our architecture and training
procedure. All source code is available. 1
Color feature: We extract color features from reference images,
and feed them into the CNN architecture to achieve consistent
colorization for the same character. Given a reference image, we
scan all pixels in order to create a color histogram. The histogram
is first normalized by the number of pixels, and quantized from
1

https://github.com/DwangoMediaVillage/Comicolorization

(b) Semi-Automatic
Colorization

(c) User interactive
revision

Palette
model

(a) Automatic
Panel
Segmentation

Palette
model

(d) Layout
Restoration

Color dots addition
Palette
model

Histogram
model

Palette
model

Panels

Output image

…

…

…

Input page

Panels

Panels
Histogram adjustment
Texts and
contours

Reference images

Ref. image

Palette

Ref. image

Histogram

Fig. 3. Illustration of our colorization pipeline. The inputs of the system are manga page images and reference images. (a) The system then segments the
manga page images into panel images for colorization (described in Sec. 2.1). (b) The colorization step is the main operation of our tool. This task is performed
semi-automatically using input reference images (described in Sec. 2.2). (c) Then, the revision is carried out by the user. The user can interactively modify
the result by applying color dots and/or adjust color histogram (described in Sec. 2.3). (d) Finally, the colorized panels are restored to the original layout via
resizing and overlaying the text and contours from the original page (described in Sec. 2.4).

a typical 2563 bins to 63 bins. The resultant color histogram for
each reference is h ∈ N216 . We further binarize this histogram to
p ∈ {0, 1}216 to handle the color feature more implicitly. We call this
216-dimensional binary vector p a palette. Compared to the color
histogram, a palette is robust against the difference of the ratio of
colors between the reference image and the input image.
Classification training by character names: The original model
of [Iizuka et al. 2016] has a classification branch. This branch predicts the category of the scene to better illustrate the result. For
example, if the model recognizes an input image as sea, the model
tends to colorize the image using more blue than green. In our case,
we train this categorization branch by the pair of the name of the
character and its image, using our character dataset.
Adversarial loss for vivid color: Additionally, we add an adversarial loss to the objective function to this architecture [Goodfellow
et al. 2014; Radford et al. 2017]. Recent studies showed that the adversarial loss helps to colorize images more vividly [Isola et al. 2017;
Sangkloy et al. 2017], and we also follow this line. At training time,
we input ground-truth and generated images to the discriminator
one by one, and the discriminator outputs 0 (= Fake) or 1 (= Real).
Following the previous approaches, the loss of the discriminator is
sigmoid cross entropy.

its original histogram h. The user can manually adjust the amount
of the most frequent color bin (typically, the background color). The
color feature is then automatically normalized with the adjustment.
This adjustment of the frequent color bin is useful to for preventing
color bleeding.
Color dots: Our method can accept color dots in addition to color
features. If a user applies a color dot to a region, the area around
the selected region is colorized by the color of the dot. Because our
model is trained using not only typical images but also images with
synthesized color dots, we can directly feed an input image with
color dots to our model.

2.3

In this section, we briefly explain how to train the network for
colorization.
We collected hand-drawn character images as a training dataset
instead of manga images because there are very few pairs of monochrome and colorized manga images publicly available. We binarized
each color manga image using [Otsu 1979] to make a pair of color
and monochrome images. The original color image is used as an

User Interactive Revision

Optionally, our system allows users to interactively revise the colorized results (Fig. 3(c)). Our system has two functions for revision:
histogram and color dots. The histogram is used for global revision
of the panel, and color dots are used for local revision.
Histogram: If the user fails to select colors by a palette, he or
she can interactively change the color feature from the palette p to

2.4

Layout Restoration

Finally, we finish the colorization by the following four steps: To
improve the results, whitish and blackish areas are automatically
changed to pure black and white, respectively. To resize the panel
images to the original size, we perform super-resolution. Finally,
the colorized panels are re-composed to the original page. The texts
and contours from the original page are then overlaid. This process
is illustrated in Fig. 3(d).

3

TRAINING

User interactive
revision
Adjust
histogram

RESULTS AND DISCUSSION

Fig. 4 shows inputs and the colorization results of our model. Fig. 4(a)
shows the input images. Fig. 4(b) shows the colorized results using
the palette of the reference images at the top. In the case of Fig. 4(c),
the color version of the input character was used as a reference. Our
method successfully colorized a set of input characters vividly with
the same color composition, using a reference character. Fig. 4(c)
was revised via manual revisions as shown in the next column. The
bleeding of the yellow color to the girl’s clothes on the left side was
prevented by adjusting the histogram. Incomplete areas such as the
forehead, hair, and collar were successfully colorized by providing
color dots. Because characters across different panels can be easily
colorized using the same color, our method is highly suitable for
manga colorization.
Limitations: Our semi-automatic colorization algorithm sometimes fails to colorize the panel image when multiple characters
appear. In the case of such failure, the user can edit the image with
many color dots.

Add
color dot

(a) Input

5 COLORIZATION NETWORK MODEL DETAIL
5.1 Training Dataset
We crawled several color illustrations from niconico-seiga 2 , which is
one of the largest illustration-sharing website in Japan. In niconicoseiga, creators draw an illustration of a character, and post it on the
service with the name of the character.
To train our model, we leveraged the niconico-seiga dataset, which
contains these images. Because our objective is to colorize manga
vividly, we removed images that have a low saturation value in
the HSV color space from the dataset. Because our main target is
a character, we used only character images that were detected by
an animation-face-detector 3 . We eventually used a total of 160,000
images as the training dataset.
First, each image was resized to 256×256 pixels. We then randomly
cropped regions to 224×224 pixels from each image. This cropping
makes our model robust. For further robustness, we also randomly
flipped the images horizontally with 50% probability.

5.2

Network Architecture

Fig. 5 shows the architecture of the networks in our system. This
architecture was based on [Iizuka et al. 2016], whose model has four
networks: a global features network, low-level features network,
mid-level features network, and colorization network. In addition
to [Iizuka et al. 2016], we added three components: leveraging color
3

http://seiga.nicovideo.jp/
https://github.com/nagadomi/lbpcascade_animeface

(b) Colorized by
ref. image 1

(c) Colorized by ref. image 2
with user interaction

Fig. 4. Results generated from our model and others. (a) Image based on
[Iizuka et al. 2016]. (b), (c) Colorized images using our model with the palette
extracted from the left reference image.

features from reference images, training the classification branch
using character names, and training with adversarial loss for vivid
colorization. We explain the implementation details of (1) fusing
the color features into the network, (2) preparing the data for the
global network, and (3) setting the parameters.
How to fuse color features: In the original model of [Iizuka
et al. 2016], given an input image, the visual information (the weight
tensor in R28×28×256 ) is extracted via low- and mid-level feature
networks. The global information (the weight vector in R256 that
represents a category of the image) is extracted via global feature
networks. These two features are concatenated so as to form a latent
variable of the network (“fusion layer” in Fig. 5) 4 .
In our proposed network, we further concatenated a 256-dimensional
color feature to the fusion layer in the same manner as the concatenation of the global feature. With the color feature, the color
information of a reference image is automatically incorporated to
colorize the input image.
4

2

Ref. image 2

4

Ref. image 1

input, and the monochrome image is used as a ground truth for the
training process.
Given pairs of training images (input and ground truth), our
network was trained based on the mean squared error criterion
over the L*a*b color space, with an additional adversarial loss and a
classification loss.
To handle revision by color dots, we trained our network using
synthesized color dots that are created on the basis of the colors in
the ground truth images.

For concatenation, the 256-dimensional global feature is duplicated to 28 × 28 times,
i.e., the (u, v ) position of the resultant latent variable is the concatenation of (1) the
(u, v ) position of the local feature and (2) the global feature.

Fig. 5. Network architecture at the colorization step.

Data preparation for the global network: The global features
network of the original model predicts the label (scene category) of
the input image. Unlike the original model, the global network of
our model predicts the label of the name of the character. The label
information was based on the service of niconico-seiga (as shown
Sec. 5.1). The total number of collected labels was 428.
Parameter settings: Table 1 illustrates the detailed parameter
settings of the networks. We trained the model for 550,000 iterations
with a batch size of 30.
As an activation function, we used a sigmoid function for the final
output layer, and ReLU for the other layers. We inserted a batchnormalization layer [Ioffe and Szegedy 2015] after each convolution
layer.

color dots in the L*a*b color space. If the color dot does not exist in
the pixel, zero is padded for the second and the third value.
The size of synthesized color dots is one pixel, and the number
of the dots is decided randomly from 0 to 15. The model becomes
robust by feeding a random number of dots. Our method works
perfectly even if the number of the inputs is more than 15, the
maximum of the number of given synthesized color dots, except for
unusual cases such as all points placed in the same position. In the
testing phase, users can provide any number of points to the system
to enhance the result.

5.3

In this paper, we propose the first system to colorize an entire manga
at once. Our method colorizes a whole page (not a single panel).
Moreover, with color features extracted from the input reference
image, we confirmed that our system was able to colorize the same
character by the same color. By employing adversarial loss, we
confirmed that adversarial networks emphasize the effect of given
color information. We demonstrated that the color features help
the inference by our deep colorization network. In addition, our
tool allows users to revise the colorization result interactively by
adjusting color histogram and adding color dots.

Optimization

Our network was trained on the basis of the mean squared error
(MSE) criterion over the L*a*b color space, with an additional adversarial loss and a classification loss. These losses were weighted
as:
MSE : adversarial : classi f ication = 1 : 1 : 0.003.
(1)
We trained our network using the Adam optimizer [Kingma and
Ba 2015]. We used the Adam parameters α = 0.0001, β 1 = 0.9, and
β 2 = 0.999. We used the optimization procedure until convergence
of the loss.

5.4

6

CONCLUSIONS

Generation of Training Color Dots

Our system enables users to interactively revise the colorized result
using color dots. To train a network to recognize these control color
dots at test time, we synthesized pseudo color dots for the training
data. We generate synthesized color dots on the basis of the colors
in the ground truth image.
We put synthesized color dots at random positions on the input
monochrome image. Each pixel of the resultant image consists of
three values. The first value is zero or one, which represents the
pixel value of the original input monochrome image. The second
and the third values are the “a” and “b” values, respectively, of the

APPENDIX
A SUPER RESOLUTION MODEL
Although we used character illustrations as the training datasets,
manga contains special components drawn with lines, such as many
contours of panels, text balloons, and the text itself. Because the
resolution of the image is changed during the colorization process,
the contours and texts tend to be blurred unintentionally. To remove such unintentional blurring, we apply a super-resolution (SR)
method for clear colorization.

(a) Low-Level Features network

Type
conv.
conv.
conv.
conv.
conv.
conv.

Kernel
3×3
3×3
3×3
3×3
3×3
3×3

Stride
2×2
1×1
2×2
1×1
2×2
1×1

(b) Global Features network

Outputs
64
128
128
256
256
512

Type
conv.
conv.
conv.
conv.
FC
FC

Kernel
3×3
3×3
3×3
3×3
-

Stride
2×2
1×1
2×2
1×1
-

(c) Mid-Level Features network

Outputs
512
512
512
512
1024
512

(d) Colorization network

Type
fusion
conv.
upsample
conv.
conv.
upsample
conv.
conv.

Kernel
3×3
3×3
3×3
3×3
3×3

Stride
1×1
1×1
1×1
1×1
1×1

Type
conv.
conv.

Kernel
3×3
3×3

Stride
1×1
1×1

Outputs
512
256

(e) Discriminator

Outputs
256
128
128
64
64
64
32
3

Type
conv.
conv.
conv.
conv.

Kernel
4×4
4×4
4×4
4×4

Stride
2×2
2×2
2×2
2×2

Outputs
64
128
256
512

Table 1. Parameters of our networks

(a)

(b)

(c)

(d)

(e)

Input image

Reference image

with Palette

with Raw Histogram

with Adjusted
Histogram

Input image

Reference image

with Palette

with Raw Histogram

with Adjusted
Histogram

Input image

Reference image

with Palette

with Raw Histogram

with Adjusted
Histogram

(1)

(a) Input image

(b) Colorized image

(c) SR image

(2)

Fig. 6. Results after super-resolution. (a) Input monochrome manga panel.
(b) Image colorized by our colorization network. (c) Image generated via
super-resolution.
(3)

A sample result of the process is shown in Fig. 6. The architecture
of super-resolution is inspired by PaintsChainer 5 , whose superresolution model was originally based on [Ronneberger et al. 2015].
The original size of colorized images by our colorization network
is 224 × 224 pixels for each panel (Fig.6 (b)). By applying superresolution, we obtain a high-resolution image with 448×448 pixels
(Fig. 6 (c)).

B

INTERACTIVE REVISION

In this section, we discuss the effect of histogram adjustment and
using color dots with results.
Fig. 7 explains the comparison of color features. Fig. 7 shows
the results of using a palette, a raw histogram, and an adjusted
histogram. For all rows, the results with a palette (Fig. 7 (c)) have
less color breeding than those with a raw histogram (Fig. 7 (d)).
This indicates that the palette enables us to robustly colorize images
5

Fig. 7. Results of in the case of using a palette, a raw histogram, and an
adjusted histogram. (a) Input image, (b) reference image for the histogram
or the palette, (c) image generated by the model with the palette, (d) image
generated by the model with the raw histogram, and (e) image generated
by the model with the adjusted histogram.

https://github.com/pfnet/PaintsChainer

with less breeding, because the palette constrains the possible color
space. In the result using a raw histogram (Fig. 7 (d)), the dominant
color is spread. At the top-row image, the red-brown color of the
hair in the reference image bleeds beyond the boundaries (Fig. 7
(1-d)); this occurs in the second row as well (Fig. 7 (2-d)). In the
third row (Fig. 7 (3-d)), the background color is white, and the most
frequent color in the reference image is white. Consequently, the
result with a raw histogram is too whitish. By adjusting the ratio of

(a) Target image

(b) Color Dot

(c) Histogram

(d) Color Dot
+ Histogram

(a) Input image
Number of dot

-

6

0

2

Fig. 8. Results of using only color dots, using only histogram, and combining
color dots and histogram, as well as the number of color dots used. (a) Target
image, and (b) image colorized using six color dots aiming to obtain a similar
colorization result as (a). (c) Image colorized using the histogram calculated
from the target image (a), and (d) image generated by adding two color dots
to (c) and inputting the histogram of (a).

the dominant color (white), the result is improved (Fig. 7 (e)), where
the hair and skin is colorized with pink.
In addition, we introduce how users can combine color features
and color dots effectively. Figure 8 shows the colorized results along
with the number of color dots. The images show the use of color
dots (Fig. 8 (b)), a histogram (Fig. 8 (c)), or a combination of both
(Fig. 8 (d)). When the user adds six dots, the colorization result is
as shown in Fig. 8 (b). The user adds four dots for the hairs (two
dots near the head and the others at the hair ends of the right side
and the left side), and two dots to both eyes. Although the colorized
result is similar to the target (Fig. 8 (a)), several interactions are
required (providing six dots). If the user uses only the histogram
extracted from the target (Fig. 8 (a)) as reference, the colorization
result is as shown in Fig. 8 (c). In this image, the eye color differs
from that of the target image, but most regions are colorized using
the same colors as the target image. Fig. 8 (d) shows the result with
two additional dots to Fig. 8 (c). Two dots are added to both eyes.
This result is colorized like the target by adding fewer color dots in
comparison (Fig. 8 (b)). We recommend that the user colorizes using
the color features calculated from the reference image first and then
specifying the local regions by adding only a few color dots.

C

HISTOGRAM BLENDING

Our semi-automatic colorization algorithm sometimes fails to colorize the panel image when multiple characters appear (Fig. 9). In
Fig. 9 (a), two characters appear in the input panel. In Fig. 9 (c), the
girl on the left side is colorized unappealingly, because the hair is
colorized using the same color as her hair on the right side. As in
one of the revision examples, the user edits the image with many
color dots (Fig. 9 (d)). However, this interaction wastes the color
information from the reference image.
Regarding this problem, we consider that histogram blending
(Fig. 10) is perhaps suitable for overcoming this problem. Instead of
using many color dots, we used two reference images (Fig. 10 (b)
and (c)) at an equal ratio. In Fig. 10 (d), we finally get the suitable
colorized result by using the blended histogram. When the size of
each character is different, the user should adjust the blending ratio
of the reference images.

(b) Reference image

(c) Palette

(d) Palette + Color Dot

Fig. 9. One of the failure cases of our colorization method. (a) Input image
where two girls appear in the panel. (b) Reference image of the colorization
where one girl has brown hair and one boy has purple hair. (c) Image colorized with the palette of (b). (d) Image revised by the user, who added color
dots to the left girl.

(a) Input image

(b) Reference
image 1

(c) Reference
image 2

(d) 1 : 1 Histogram

Fig. 10. Examples of histogram blending. The image in (d) was generated
from (a) with the blend of two histograms. The blended histogram was
calculated using one histogram of reference image (b) and another histogram
of reference image (c), which was then blended at an equal ratio.

D

FURTHER RESULTS

We show further colorization results in Fig. 11. In Fig. 11, the same
manga pages were colorized with different reference images, and
reference images were used as the palettes. Each result was colorized
with the colors of each combination of reference images.
In addition to this, we colorize all monochrome manga in the
Manga 109 Dataset [Matsui et al. 2016] using the palette of the cover
image of its manga.

ACKNOWLEDGMENTS
We would like to thank all of the illustrators for their inspiring
artwork, which has motivated us for this research, and was essential for creating the dataset. We would also like to thank Yusuke
Matsui and Tsukasa Omoto for the valuable suggestions and fruitful
discussions.

REFERENCES
Zezhou Cheng, Qingxiong Yang, and Bin Sheng. 2015. Deep Colorization. In IEEE
International Conference on Computer Vision (ICCV).
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu amd David Warde-Farley,
Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial
networks. In Neural Information Processing Systems (NIPS).
Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa. 2016. Let there be Color!:
Joint End-to-end Learning of Global and Local Image Priors for Automatic Image
Colorization with Simultaneous Classification. In ACM Transactions on Graphics
(TOG), Vol. 35. 110:1–110:11.
Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: accelerating deep
network training by reducing internal covariate shift. In the 32nd International
Conference on International Conference on Machine Learning (ICML), Vol. 37. 448–
456.
Daisuke Ishii, Kei Kawamura, and Hiroshi Watanabe. 2009. A Study on Control Parameters of Frame Decomposition Method for Comic Images. In Institute of Electronics,
Information and Communication Engineers Tech. Rep. (IEICE), Vol. 109. 187–192.
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-Image
Translation with Conditional Adversarial Networks. In IEEE Computer Vision and
Pattern Recognition (CVPR).
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization.
the 3rd International Conference for Learning Representations.
Yusuke Matsui, Kota Ito, Yuji Aramaki, Toshihiko Yamasaki, and Kiyoharu Aizawa.
2016. Sketch-based Manga Retrieval using Manga109 Dataset. In Multimedia Tools
and Applications (MTAP). Springer.
Nobuyuki Otsu. 1979. A Threshold Selection Method from Gray-Level Histograms. In
IEEE Transactions on Systems, Man, and Cybernetics (TSMC), Vol. 9. 62–66.
Alec Radford, Luke Metz, and Soumith Chintala. 2017. Unsupervised Representation
Learning with Deep Convolutional Generative Adversarial Networks. In International Conference on Learning Representations (ICLR).
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional
Networks for Biomedical Image Segmentation. ArXiv:1505.04597 (2015).
Patsorn Sangkloy, Jingwan Lu, Chen Fang, Fisher Yu, and James Hays. 2017. Scribbler:
Controlling Deep Image Synthesis with Sketch ancolord Color. In IEEE Computer
Vision and Pattern Recognition (CVPR).
Richard Zhang, Phillip Isola, and Alexei A. Efros. 2016. Colorful Image Colorization. In
European Conference on Computer Vision (ECCV).
Richard Zhang, Jun-Yan Zhu, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu,
and Alexei A. Efros. 2017. Real-Time User-Guided Image Colorization with Learned
Deep Priors. In ACM Transactions on Graphics (TOG), Vol. 9. 119:1–119:11.

Reference
Images

© Minene Sakurano

Fig. 11. Manga page colorized by our tool. Each manga was colorized semi-automatically using the reference images at left. All input manga were the same.
The reference images were different. We used monochrome manga from the Manga 109 dataset [Matsui et al. 2016].

