If you use grouping variables in Graph Builder, making changes to axes for one level will force the same change to all other levels. This is done to facilitate comparison between the graphs for different levels.
Having said this, you may be able to get close to what you would like by hitting the 'Dialog' button in the Graph Builder Control Panel, and assigning the variable containing your levels to the 'By' role.