Cranial nerve palsy associated with coronavirus disease 2019 (COVID-19) is rare. We herein report the first Asian case of the immediate onset of isolated and unilateral abducens nerve palsy (ANP) accompanied with COVID-19 infection. A 25-year-old man developed diplopia one day after the COVID-19 symptom onset. Neurological examination revealed limitation of left eye abduction without ataxia and hyporeflexia. Negative anti-ganglioside antibody results and mild albuminocytological dissociation were noted. The patient was diagnosed with left ANP accompanied by COVID-19 infection. The ANP spontaneously recovered without treatment. ANP can develop during the early phase of COVID-19 infection and adversely affect patients' quality of life.