cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Browse apps to extend the software in the new JMP Marketplace
Choose Language Hide Translation Bar
Harj
Harj
Level II

Generating confidence intervals for sensitivity, specificity and AUC in ROC curves

Feb 16, 2020 06:04 AM (3899 views)

Hi,

Can anyone help me with how to generate 95% confidence intervals in ROC curve analyses?

 

I can generate the curves and view the tables but cannot find an easy way of getting the confidence intervals for sensitivity, specificity and AUC.

 

Many thanks. 

 

 

0 Kudos
1 ACCEPTED SOLUTION

Accepted Solutions
KarenC
Super User (Alumni) KarenC
Super User (Alumni)
Solution

Re: Generating confidence intervals for sensitivity, specificity and AUC in ROC curves

Feb 16, 2020 04:08 PM (3881 views)  |  Posted in reply to message from Harj 02-16-2020

There are a couple of ways to get to what you need:

 

1. If you have JMP Pro then you can use one-click bootstrapping to get a bootstrap CI for AUC.

2. The add-in https://community.jmp.com/t5/JMP-Add-Ins/Exploring-Model-Classification-Thresholds/ta-p/66964 will provide AUC CI and Se and Sp CI and more.

3. The add-in https://community.jmp.com/t5/JMP-Add-Ins/Performance-Summary-for-Diagnostic-Tests/ta-p/22524 is a simpler add-in that just does the performance measures portion of the add-in in #2.

4. You can always get the Se (or Sp) CI using the distribution platform using summary table with a column for 0/1 and a column for counts of each and then use distribution with column 1 (a nominal column) as the Y and the column of counts as the Freq then select CI from the red triangle menu (you can use Redo>Automatic Recalc to look at different results).

 

 

View solution in original post

1 REPLY 1
KarenC
Super User (Alumni) KarenC
Super User (Alumni)
Solution

Re: Generating confidence intervals for sensitivity, specificity and AUC in ROC curves

Feb 16, 2020 04:08 PM (3882 views)  |  Posted in reply to message from Harj 02-16-2020

There are a couple of ways to get to what you need:

 

1. If you have JMP Pro then you can use one-click bootstrapping to get a bootstrap CI for AUC.

2. The add-in https://community.jmp.com/t5/JMP-Add-Ins/Exploring-Model-Classification-Thresholds/ta-p/66964 will provide AUC CI and Se and Sp CI and more.

3. The add-in https://community.jmp.com/t5/JMP-Add-Ins/Performance-Summary-for-Diagnostic-Tests/ta-p/22524 is a simpler add-in that just does the performance measures portion of the add-in in #2.

4. You can always get the Se (or Sp) CI using the distribution platform using summary table with a column for 0/1 and a column for counts of each and then use distribution with column 1 (a nominal column) as the Y and the column of counts as the Freq then select CI from the red triangle menu (you can use Redo>Automatic Recalc to look at different results).