Which glue should I use to strongly attach a label to glass?
My method doesn’t involve glue at all. I use packing tape: 

Print or hand-write your label and place it face down onto the sticky side of a pristinely clean strip of packing tape. To make accurate positioning of the label much easier, secure the packing tape sticky-side-up onto a hard surface such as a kitchen counter, by making the strip about an inch longer than needed, and turning about 1/2 inch at each end under and pressing it against the counter. Once the label is positioned, trim the tape to size, and position the label on the very well cleaned glass. Use a spoon or your thumbnail to work out any air bubbles. 

Voila, much easier than glue with no cleanup, and for your needs which don’t involve contact with water, the labels will stay put for a long time, and withstand surface cleaning, even with a damp cloth.