Welcome to the JMP Community
The task you have specified is a very easy thing to do in JMP.
First read the data into JMP
txnelson_0-1709476625541.png
Add the Spec Limits to the Column Properties for the data column by right clicking on the header for the column and selecting Column Properties=>Spec Limits
txnelson_1-1709476775765.png
In the dialog box that opens, enter in the limits. Make sure you check the "Show as Graph Reference Lints"
txnelson_2-1709476895436.png
Click OK and go back to the data table
Go to the Graph pull down menu and select Graph Builder
txnelson_3-1709476991749.png
In the Graph Builder window drag the data column to the X drop area
txnelson_4-1709477136556.png
Now Click on the Histogram Icon at the top of the graph
txnelson_6-1709477316995.png
The graph will now show the histogram with the specified limits
txnelson_7-1709477350248.png
Jim