If you want a formal statistical test to compare the curves, then you would add the categorical variable into the model. Using Georg's example, your model would be Height, Height^2, Height^3, Sex, Sex*Height, Sex*Height^2, Sex*Height^3.
The test of the parameter for Sex would tell you if there are differences in the intercepts.
The test of the Sex*Height parameter would tell you if there are differences in the slopes of Height.
The test of Sex*Height^2 would tell you if there are differences in the quadratic parameter estimates.
The test of Sex*Height^3 would tell you if there are differences in the cubic parameters.
Dan Obermiller