How do I reduce the heat in my white bean chicken chile
Dairy products have the impeccable ability to dampen heat from peppers, hot sauce and other spicy items. This includes milk (often drunk along with very spicy foods and peppers), sour cream, and cheese, among others.

I find Sour Cream not only adds to the complexity of flavors in most chili's (a great thing!), but also quells the heat quite a bit.

I'd leave your chili how it is, and then as you serve it, allow the individual to add sour cream to taste.

You can also top your chili with a healthy dose of your favorite cheese. This will help tame the heat a bit too. For white chili, jack or pepper jack cheese would be a good fit.