One way of doing this might be going with example found from scripting index. Searching for close all like this gives this example:
Names Default To Here(1);
dt = Open("$SAMPLE_DATA/Big Class.jmp");
fm = dt << Run Script("Fit Model");
r = fm << Report;
Wait(2);
r["Least Squares Means Table"] << Close All Like This;
Then a bit tinkering around with control chart builder script:
Names Default To Here(1);
dt = Open("$SAMPLE_DATA/Quality Control/Coating.jmp");
cc = dt << Control Chart Builder(Variables(Subgroup(:Sample), Y(:Weight)), By(:Pin));
rep = cc << Report;
wait(1);
rep[1]["Weight Limit Summaries"] << Close All Like This;
Using rep[1] because in the example I'm using By and it creates multiple control charts. Also do note that the name of outline box will change depending on the column used.
-Jarmo