A SERIOUS issue when I was using Flooded Lead Acid cells, they had a massive self discharge as they aged. It should work so long as you set your batteries to operate on the voltage setpoints of the CALB cells (The CALB has a much narrower voltage range, so setting it to the range of the AGM would ruin the CALB) but in time as the AGM ages (Which would be more rapid than the CALB) it could start to pull down the system to be less capacity compared to what you began with.
Additionally, the bulk of the capacity of the CALB cells is at a higher voltage. like in my case 52-53 volts with CALB, whereas with my old FLA batteries, resting full charge was 51.2v. Having a lead-based chemistry over their resting voltage typically means they are going to consume power (Essentially charging off of the CALB drawing them down faster) and burning that power to electrolysis in the cell (At least for FLA - I realize you are running AGM) and heat generation.