Table 2:

AUC values for diagnostic accuracy of 9 radiologists without and with output of ANN

Observer	Without ANN	With ANN	Difference	P^*
Precertification radiologists
A	0.891	0.945	0.054	< .001
B	0.840	0.938	0.098	< .001
C	0.850	0.950	0.099	< .001
D	0.897	0.947	0.057	< .001
Average	0.870	0.947	0.077
Board certified radiologists
E	0.935	0.972	0.037	< .001
F	0.887	0.915	0.028	< .001
G	0.965	0.979	0.015	< .001
H	0.917	0.940	0.023	< .001
I	0.911	0.922	0.010	< .001
Average	0.923	0.946	0.023
Overall average	0.899	0.946	0.047	< .001

Note:—AUC indicates area under the curve; ANN, artificial neural network;.
* Statistically significant with jackknife method by use of DBM MRMC (multiple readers and multiple cases algorithm developed by Metz et al^12–16).