Confidence votes 6. The hardest subject for elementary and middle school students are usually science. Science as we know it if your out of college is the longest tests and the hardest worksheets. This subject usually stresses people out because of either their memory or if they possibly have a phobia of long things.