How does SVM classify images?
A quick look (this post, for example) suggests that to use SVM for image classification, you need to extract features beforehand, and not run it directly on the image data.