How can I improve the results of my clustering
Always use a supervised algorithm when you have labeled data for your problem. Why would you ignore the labels, your most valuable bit of information?

To improve quality, you most likely need to improve your features.