cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Discussions

Solve problems, and share tips and tricks with other JMP users.
%3CLINGO-SUB%20id%3D%22lingo-sub-282010%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3EROC%20AUC%20confidence%20interval%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-282010%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3EHi%2C%3C%2FP%3E%0A%3CP%3EIs%20it%20possible%20to%20calculate%20the%2095%25%20confidence%20interval%20of%20a%20ROC%20AUC%20%3F%3C%2FP%3E%0A%3CP%3EI%20found%20a%20add-in%20that%20was%20supposed%20to%20to%20so%20but%20does%20not%20seem%20to%20work%20for%20this%20option%3A%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fcommunity.jmp.com%2Ft5%2FJMP-Blog%2FJMP-add-in-for-medical-diagnostic-performance%2Fm-p%2F30157%23U30157%22%20class%3D%22lia-mention-container-editor-message%20lia-img-icon-blog-thread%20lia-fa-icon%20lia-fa-blog%20lia-fa-thread%20lia-fa%22%20target%3D%22_blank%22%3EJMP%20add-in%20for%20medical%20diagnostic%20performance%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThanks%20for%20your%20help%2C%3C%2FP%3E%0A%3CP%3EAnne%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-282010%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CLINGO-LABEL%3EOther%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-282160%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3ERe%3A%20ROC%20AUC%20confidence%20interval%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-282160%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3EHi%20Anne%2C%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThat%20was%20an%20add-in%20I%20had%20created...I%20have%20kept%20this%20one%20running%20over%20the%20years%20(%3CA%20href%3D%22https%3A%2F%2Fcommunity.jmp.com%2Ft5%2FJMP-Add-Ins%2FPerformance-Summary-for-Diagnostic-Tests%2Fta-p%2F22524%22%20target%3D%22_self%22%3EIVD%20performance%3C%2FA%3E%26nbsp%3B)%20but%20not%20the%20one%20with%20the%20AUC%20confidence%20intervals.%20Now%20I%20tend%20to%20use%20bootstrap%20CI%20in%20JMP%20Pro.%20%26nbsp%3BWithout%20pro%20you%20could%20build%20your%20self%20a%20calculator%20table%20using%20column%20formulas%20to%20calculate%20your%20interval%20-%20there%20is%20more%20than%20one%20way%20to%20get%20at%20the%20confidence%20intervals%20so%20you%20would%20need%20to%20decide%20on%20the%20method.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThis%20add-in%20has%20the%20AUC%20and%20more%20(%3CA%20href%3D%22https%3A%2F%2Fcommunity.jmp.com%2Ft5%2FJMP-Add-Ins%2FExploring-Model-Classification-Thresholds%2Fta-p%2F66964%22%20target%3D%22_self%22%3EThreshold%20Explorer).%3C%2FA%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EHowever%20that%20may%20be%20more%20than%20what%20you%20need%20and%20can%20be%20slow%20to%20run.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EKaren%3C%2FP%3E%3C%2FLINGO-BODY%3E
Choose Language Hide Translation Bar
aberquin
Level I

ROC AUC confidence interval

Hi,

Is it possible to calculate the 95% confidence interval of a ROC AUC ?

I found a add-in that was supposed to to so but does not seem to work for this option:  

 

Thanks for your help,

Anne

1 ACCEPTED SOLUTION

Accepted Solutions
KarenC
Super User (Alumni)

Re: ROC AUC confidence interval

Hi Anne,

 

That was an add-in I had created...I have kept this one running over the years (IVD performance ) but not the one with the AUC confidence intervals. Now I tend to use bootstrap CI in JMP Pro.  Without pro you could build your self a calculator table using column formulas to calculate your interval - there is more than one way to get at the confidence intervals so you would need to decide on the method.

 

This add-in has the AUC and more (Threshold Explorer).

 

However that may be more than what you need and can be slow to run.

 

Karen

View solution in original post

1 REPLY 1
KarenC
Super User (Alumni)

Re: ROC AUC confidence interval

Hi Anne,

 

That was an add-in I had created...I have kept this one running over the years (IVD performance ) but not the one with the AUC confidence intervals. Now I tend to use bootstrap CI in JMP Pro.  Without pro you could build your self a calculator table using column formulas to calculate your interval - there is more than one way to get at the confidence intervals so you would need to decide on the method.

 

This add-in has the AUC and more (Threshold Explorer).

 

However that may be more than what you need and can be slow to run.

 

Karen

Recommended Articles