How can I increase the max windows for the stock browser?
From looking at some posts on Android Forums (1), (2) I think it's just not possible - to get more windows/tabs you'll need to use another browser like Dolphin HD/Mini.

Edit: Looks from this post on XDA that it's hard-coded into the browser; it can be changed, but not easily.