The check box in the Fit Model dialog is for both the dispersion parameter and the test for dispersion. If you decide that the dispersion is not significant, then run the model again after un-checking this option. Otherwise, you get both the test and a model with the extra over-dispersion parameter.
The whole model test is based on a likelihood ratio test between your model and the reduced model. It is an omnibus test to decide if the model, as a whole, is significant compared to the marginal distribution (response independent of all terms except intercept.) We generally hope that this test is significant!
The deviance test is based on a likelihood ratio test between your model and the saturated model. The saturated model is a perfect fit, that is, without bias. The deviance test is an omnibus test to decide if the model is biased. We generally hope that this test is not significant! It is a kind of lack of fit test for the GLM and other related models.