I recommend using your op-amps as true differential amps so you can remove the voltage offset of each cell.
You may find some useful info
here and you can see an implementation
here (the BOBMS1630 schematic in attachment).
I finally changed the topology and opted to put the multiplexer in front of the op-amps so I can have only one op-amp for 8 cells instead of 8 of them. You can see the current schematic
here but be warned if you decide to add the caps on the inputs as in the schematic they must be before the resistors, not after (the current schematic needs an update to correct that).
Altho for 4 cells I wouldn't bother with a mux and I would just put 4 op-amps as it's much simpler and easier