Your diagram looks like 100% what my goal is.
Is this diagram, it almost looks like there 3 panels? Main, Power Panel, and Barn Sub Panel correct? The device labeled power panel, is that just a super small sub panel, with room for 2 breakers? If so where, does the "main" tie into that...