I did not find any Preference settings for Graph Builder that permitted the unselecting of the "Fit" check box for the Confidence option. There are a lot of preferences available for Graph Builder, so you may want to check them out yourself.
File=>Preferences=>Platforms=>Graph Builder
Jim