The standard report provides the RMSE. See the documentation. You do not need JMP Pro for this result.
You will not be able to use a data column in the validation role, use the informative missing option, more than the hyperbolic tangent activation function, or more than one hidden layer without JMP Pro.