Single cell lipo over-voltage bleeding IC
The easiest way is to have a shunt regulator such as a TL431B across each cell that bleeds extra voltage away. Make sure to use 0.5% resistors or better to match the required tolerance. The datasheet gives a schematic for use in high-current situations which may be required in this application.