It would seem that it should be possible to set up the design as @Mark_Bailey suggests and then add
Modifier Type = A & Modifier > 0.09
as a disallowed combination.
However, you can't have disallowed combinations with Mixture factors in Custom Design :(.
I'm not sure why this is. I guess it is complex to implement constraints with optimal mixture designs. You might want to add that as a request in the JMP Wish List.
So I think you might need to use the Candidate Set Design approach as presented by @chris_gotwalt1 at JMP Discovery Europe 2021.
Following this approach I created a "Big Design" of 2000 runs that obeys the constraints that you have. Then used this as a candidate set for the smaller 40-run Custom Design. (Both designs attached). I think this approach would work for you?
You can see that it obeys the constraint you stated: