I can confirm this behavior in 2023 and 2024. With or without adjust for mullion size checked...
Pattern justification (beginning, center, end) has no bearing on the results. As soon as you change one or more mullion types Revit seems to forget how to do math.
There are plenty of ways to work around it, but it all depends on how many of them you will be placing and how dynamic they need to be after the initial placement.
I often have curtain walls that have defined patterns for early layout to give me the general patterns, but then change them to types that do not have a defined pattern (or even defined mullions sometimes), and just keep the layout when it asks if I want to convert the gridlines as independent. Then I have full control of the layout for fine tuning without pinning and unpinning all the time.

Once converted to a type that does not have a defined layout, changing the mullions does not affect the dimensions.
But this can be a pain if there are a lot of them and they are constantly changing.
-G
Gary J. Orr
GaryOrrMBI (MBI Companies 2014-Current)
aka (past user names):
Gary_J_Orr (GOMO Stuff 2008-2014);
OrrG (Forum Studio 2005-2008);
Gary J. Orr (LHB Inc 2002-2005);
Orr, Gary J. (Gossen Livingston 1997-2002)