# Overview

Long time ago, I worked one a project which allowed users to select images on a 2D canvas and then draw that image on a cylinder surface (the mug in this case).

I had to Google for the suitable libraries but I couldn’t find any. I also asked a question on stackoverflow but the answer did not satisfy me. The reason is that it demonstrates how to stretch the image, not how to bend the image (which is what shown in the picture above). Because of that, I decided to implement it by myself and turned out that it was not as hard as I thought before. Everything is just a loop of basic mathematic formula that I had been taught in (Vietnamese) high school.

# The idea

It’s best to demonstrate these geometrical idea using an image. Below is the image that show the view of the mug from the upside down.

Since the mug is a cylinder object, if we view it from the upside down, we will get a circle like in the picture.

• O: the center of the circle
• the red arrows: user’s eyes, view direction to the mug
• AB line segment: diameter of the circle
• AB curve: demonstrates the image that will be drawn on the real mug (original image). Since the red arrows illustrate the view direction, we will see half of the mug (the AB curve)
• x0xn: the image that is displayed on the computer screen (reflected image), the image that reflects the one drawn on the mug. Its width is the same with AB line segment.

The basic idea is that we will loop line by line, from the upside down, 1px each line. The current line will be represented just like the idea image above. For each line, continue to loop each column (each pixel), from left to right (loop x from x0 to xn). Within each loop, project the current pixel to the circle (the AB curve, the image that is drawn on the real mug), calculate the corresponding pixel on that original image, take it back and draw on the reflected image. For each loop, we have

• x: the current (width) value
• M: projection image of x on AB line segment
• N: projection image of x on the circle
• aa: the angle between ON and OM

The length of AN curve can be calculated using the aa angle. The aa angle can be calculated using the right triangle (with OM and ON)

After finishing all the loops, we will get the output reflected image that is the bended image. The final task is to take that image and draw on the real image of the mug.

Actually, the above is just the initial idea. It is not the most optimized way to implement that since there will be many repetitive calculation tasks. I will not follow this precisely in the inplementation (I will explain later). Also, this can be used for side view direction only (as is demonstrated on the image). To make the image bended in vertical direction (to fit with the real mug image with the view direction from vantage point), we can modify the formula a bit. However, for simplicity, I only apply a small hack to bend the image vertically after transforming it.

To achieve this, first we need to find the equation of AOB parabola. After that, simply slice the left image vertically into 1px wide slices, translate all the slice based on the coordination of the corresponding point on the parabola.

This idea can be implemented using pixel manipulation API from HTML Canvas. If you are not used to pixel manipulation, read this post from Mozilla Pixel Manipulation with Canvas. You can also read about Image Blending using HTML Canvas, which is another simpler example using the pixel manipulation API that I have made before.

# Prepare the Images and Information

First, we need to prepare original image. This image should be in the same width/height ratio with the mug, which means the width of the image should be the same with the mug’s diameter and its height should be the same with the height of the mug.

Note: you may notice that for left and right view of the final mug image (in the first image in this post), the image is not fully drawn on mug, which means the original image’s width is not the same with the mug’s perimeter. To make it easy, just add some transparent region on the left and the right of the original image to make it width the same with the mug’s perimeter (you can check on the original image above).

I will demonstrate it with the middle view of the canvas, which means we will need to crop this image (in width) from the position 1/4 to 3/4. Now retrive the image using Javascript

# Prepare the Canvas for Cropped Original and Reflected Images

We need 2 canvases for holding the information of the original image and the reflected image. From now on, when I refer to original image, it means the cropped one (1/4 to 3/4).

The function for creating canvas that holds the original image and all its stuff (context, pixel data,…)

The function for creating canvas that holds the reflected image and all its stuff (context, pixel data,…)

Call the 2 functions

# Start the loop…

I will show the idea image here again for you to easy to follow

Before the loop, we need to define some variables (based on the above image)

Magic happens now

# Draw the pixel data and Get the output image

Now, you need to draw all the pixel data that you have generated on the reflected canvas and let it export the PNG image

What you get is something similar to this

# Optimize it a bit

The above solution works fine. However, there are a lot of repetitive calculation tasks in the loop. For each column (x), even the y changes but the x of the project pixel will remain the same, so looping line by line is not a good idea. Instead, the above loop can be changed to loop x first, calculate the corresponding x position of the original image, and then loop y to take all the pixel of that column.

# Make it a bit more realistic (actually just a fake)

Let me repeat that, to transform from the left to the right image, simply slice the left image vertically, 1px for each slice. After that, translate those slices based on the AOB parabola. However, we don’t need to wait until the final reflected image is generated to do the translation. We will modify the loop to translate it directly in each column.

The AOB parabola can be described as

• y = ax2 + bx + c

Since the coordination of A is (0,0), the equation can be reduced to

• y = ax2 + bx.

Let the coordination of O is (x1, y1) and B is (x2, y2), we can calculate the value of a and b like this (don’t ask me where I get this, you can do this by yourself :D )

• b = (y2x12 - y1x22) / (x2x12 - x1x22)
• a = (y1 - bx1) / (x12)

Define those variables first, before the loop

Next, come back to the createReflectedCanvas function, modify the reflected canvas’ height

Inside the each x loop, before starting the y loop, calculate the current Y offset (using the parabola equation), translate it by Y offset when draw on the reflected canvas. The final loop will look like this

And the final images that you get will be something similar to this

# Combine with the real image

The final step is to draw the reflected image that we have generated on a new canvas that contains the image of the mug. You will get these images
{"extraction_info": {"found_math": true, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 0, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 0, "mathjax_display_tex": 0, "mathjax_asciimath": 1, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0, "katex": 0, "math-container": 0, "wp-katex-eq": 0, "align": 0, "equation": 0, "x-ck12": 0, "texerror": 0, "math_score": 0.6220815181732178, "perplexity": 841.4015865388417}, "config": {"markdown_headings": true, "markdown_code": true, "boilerplate_config": {"ratio_threshold": 0.18, "absolute_threshold": 20, "end_threshold": 15, "enable": true}, "remove_buttons": true, "remove_image_figures": true, "remove_link_clusters": true, "table_config": {"min_rows": 2, "min_cols": 3, "format": "plain"}, "remove_chinese": true, "remove_edit_buttons": true, "extract_latex": true}, "warc_path": "s3://commoncrawl/crawl-data/CC-MAIN-2021-21/segments/1620243991772.66/warc/CC-MAIN-20210517115207-20210517145207-00518.warc.gz"}