In the vision we introduce here, LLMs can enhance the lecturing experience in chemistry by aiding teachers in content creation as well as students with personalized Q&A and assistance in problem-solving, among others. In the lab, LLMs can help guide and assist students through manuals to ensure the correct implementation of protocols, troubleshoot experimental setups, and build connections between experiences in the lab and the underlying chemical principles. Similarly, education in computer simulations will benefit from LLMs that can write code, and as interfaces to an array of software used in computational chemistry. Furthermore, LLMs can also aid in cultivating critical thinking in students by aiding with scientific writing, helping to organize ideas, and offering pertinent resources, all with real-time feedback.