As LLMs continue to advance, their potential and challenges in education become increasingly apparent. However, to effectively implement these models in education, particularly in Vietnam where the primary language is Vietnamese, comprehensive evaluations of their capabilities are essential, particularly in the field of high school chemistry. Despite this, no research has yet been conducted on this topic, and there are few datasets available to evaluate LLMs in high school chemistry. To address this gap, we developed the VNHSGE dataset , which includes data from Vietnamese national exams covering nine subjects, including chemistry. The dataset consists of 19K multiple-choice questions and 300 essays on literature and includes both text and images, with Json and Word formats provided. This article makes the following contributions: (1) A comprehensive evaluation of the performance of two of the most advanced language models, ChatGPT and BingChat, in the context of high school level chemistry education in Vietnam. (2) A comparative analysis of the capabilities of ChatGPT and BingChat against those of Vietnamese students.