Your concern totally makes sense, especially when you want to maximize the life of your LiFePO4 batteries.
Yes, there are ways to use solar power directly to run loads without charging the batteries, and it's commonly referred to as "load diversion." Essentially, you can set up your system to supply power to your loads directly from the solar panels when the batteries are at a certain state of charge (SOC). Once the batteries drop below a set SOC, the system can switch back to charging them.
Some charge controllers and inverters have these capabilities built-in, allowing you to program how and when to divert power. You might want to look into inverters with these specific capabilities, or you may explore additional accessories like a load diversion controller that can work with your current setup.
This way, you won't be wasting any solar power, and you'll be able to manage the charge cycles of your batteries more effectively, keeping them in the optimal SOC range for longer life.