Improve VLC quality on WMV, AVI etc?
More a sidestep than a workaround but have you considering using Flip4Mac to play WMV's in Quicktime rather than use VLC?

if you can lose the extra functionality you get from VLC, the playback is much better.