<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>0120-1751</journal-id>
<journal-title><![CDATA[Revista Colombiana de Estadística]]></journal-title>
<abbrev-journal-title><![CDATA[Rev.Colomb.Estad.]]></abbrev-journal-title>
<issn>0120-1751</issn>
<publisher>
<publisher-name><![CDATA[Departamento de Estadística - Universidad Nacional de Colombia.]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S0120-17512011000100007</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[Nonparametric Cutoff Point Estimation for Diagnostic Decisions with Weighted Errors]]></article-title>
<article-title xml:lang="es"><![CDATA[Estimación no paramétrica del punto de corte asociado a una decisión diagnóstica con errores ponderados]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[MARTÍNEZ-CAMBLOR]]></surname>
<given-names><![CDATA[PABLO]]></given-names>
</name>
<xref ref-type="aff" rid="A01"/>
</contrib>
</contrib-group>
<aff id="A01">
<institution><![CDATA[,Oficina de Investigación Biosanitaria  CAIBER]]></institution>
<addr-line><![CDATA[Oviedo ]]></addr-line>
<country>Spain</country>
</aff>
<pub-date pub-type="pub">
<day>15</day>
<month>06</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="epub">
<day>15</day>
<month>06</month>
<year>2011</year>
</pub-date>
<volume>34</volume>
<numero>1</numero>
<fpage>133</fpage>
<lpage>146</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://www.scielo.org.co/scielo.php?script=sci_arttext&amp;pid=S0120-17512011000100007&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.co/scielo.php?script=sci_abstract&amp;pid=S0120-17512011000100007&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.co/scielo.php?script=sci_pdf&amp;pid=S0120-17512011000100007&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[The study of diagnostic tests is a hot topic which has direct applications in biomedical sciences. Despite of the relevance, in a diagnostic process, of the threshold (or cutoff point) employed on the decision taken by the physician, the study and comparison of the accuracy among different diagnostic criterions has been the main field of study. In this paper, the authors are interested in the study of the involved cutoff point estimation in diagnostic tests with weighted errors. With this goal, a nonparametric smoothed utility function estimator is considered. The bootstrap and the asymptotic distributions for the related M-estimator are derived. Finally, the obtained results are applied to study the Procalcitonin level which determines whether a child within the Pediatric Intensive Care Unit (UCIP) has a virical sepsis.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[El estudio de tests diagnósticos es un tema candente con aplicaciones directas en las ciencias biomédicas. Aunque en la práctica, a la hora de tomar una decisión, los clínicos deben fijar un valor umbral (o punto de corte) a pesar de la relevancia que este valor tiene, el estudio y la comparación de la calidad entre diferentes criterios diagnósticos ha sido el principal campo de estudio. En este trabajo, los autores están interesados en el estudio de la estimación del punto de corte involucrado en un test diagnóstico con errores ponderados. Con este objetivo, se considera un estimador suavizado para una función de utilidad. Se estudian las distribuciones bootstrap y asintóticas del M-estimador resultante. Finalmente, los resultados obtenidos son aplicados al estudio de los niveles de Procalcitonina que determinan si un niño ingresado en la Unidad de Cuidados Intensivos Pediátricos (UCIP) tiene infección vírica.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[Kernel density estimator]]></kwd>
<kwd lng="en"><![CDATA[Sensitivity]]></kwd>
<kwd lng="en"><![CDATA[Specificity]]></kwd>
<kwd lng="en"><![CDATA[Threshold]]></kwd>
<kwd lng="en"><![CDATA[Utility function]]></kwd>
<kwd lng="es"><![CDATA[especificadas]]></kwd>
<kwd lng="es"><![CDATA[estimador núcleo para la densidad]]></kwd>
<kwd lng="es"><![CDATA[función de utilidad]]></kwd>
<kwd lng="es"><![CDATA[sensibilidad]]></kwd>
<kwd lng="es"><![CDATA[umbral]]></kwd>
</kwd-group>
</article-meta>
</front><body><![CDATA[ 
<font size="2" face="verdana">

    <p>
<b>
<font size="4">
    <center>
Nonparametric Cutoff Point Estimation for Diagnostic Decisions with Weighted Errors
</center>
</font>
</b>
</p>

    <p>
<b>
<font size="3">
    <center>
Estimaci&oacute;n no param&eacute;trica del punto de corte asociado a una decisi&oacute;n diagn&oacute;stica con errores ponderados
</center>
</font>
</b>
</p>

    <p>
    <center>
PABLO MART&Iacute;NEZ-CAMBLOR<sup>1</sup>
</center>
</p>

    <p>
<sup>1</sup>Oficina de Investigaci&oacute;n Biosanitaria, CAIBER, Oviedo, Spain. Universidad de Oviedo, Departamento de Estad&iacute;stica e I.O. y D.M., Oviedo, Spain. Biostatistics and Associate professor. Email: <a href="mailto:pablomc@ficyt.es">pablomc@ficyt.es</a>
    <br>
</p>

<hr size="1">

    <p>
<b>
    ]]></body>
<body><![CDATA[<center>
Abstract
</center>
</b>
</p>

    <p>
The study of diagnostic tests is a hot topic which has direct applications in biomedical sciences. Despite of the relevance, in a diagnostic process, of the threshold (or cutoff point) employed on the decision taken by the physician, the study and comparison of the accuracy among different diagnostic criterions has been the main field of study. In this paper, the authors are interested in the study of the involved cutoff point estimation in diagnostic tests with weighted errors. With this goal, a nonparametric smoothed utility function estimator is considered. The bootstrap and the asymptotic distributions for the related M-estimator are derived. Finally, the obtained results are applied to study the Procalcitonin level which determines whether a child within the Pediatric Intensive Care Unit (UCIP) has a virical sepsis.
</p>

    <p>
<b>
Key words:
</b>
Kernel density estimator,
Sensitivity,
Specificity,
Threshold,
Utility function.
</p>

<hr size="1">

    <p>
<b>
    <center>
Resumen
</center>
</b>
</p>

    <p>
El estudio de tests diagn&oacute;sticos es un tema candente con aplicaciones directas en las ciencias biom&eacute;dicas. Aunque en la pr&aacute;ctica, a la hora de tomar una decisi&oacute;n, los cl&iacute;nicos deben fijar un valor umbral (o punto de corte) a pesar de la relevancia que este valor tiene, el estudio y la comparaci&oacute;n de la calidad entre diferentes criterios diagn&oacute;sticos ha sido el principal campo de estudio. En este trabajo, los autores est&aacute;n interesados en el estudio de la estimaci&oacute;n del punto de corte involucrado en un test diagn&oacute;stico con errores ponderados. Con este objetivo, se considera un estimador suavizado para una funci&oacute;n de utilidad. Se estudian las distribuciones <i>bootstrap</i> y asint&oacute;ticas del M-estimador resultante. Finalmente, los resultados obtenidos son aplicados al estudio de los niveles de Procalcitonina que determinan si un ni&ntilde;o ingresado en la Unidad de Cuidados Intensivos Pedi&aacute;tricos (UCIP) tiene infecci&oacute;n v&iacute;rica.
</p>

    <p>
<b>
Palabras clave:
</b>
especificadas,
estimador n&uacute;cleo para la densidad,
funci&oacute;n de utilidad,
sensibilidad,
umbral.
</p>

<hr size="1">

    <p>
Texto completo disponible en <a href="pdf/rce/v34n1/v34n1a07.pdf">PDF</a>
</p>

<hr size="1">

    <p>
<b>
<font size="3">
References
</font>
</b>
</p>


    <!-- ref --><p>
1. Airola, A., Pahikkala, T., Waegeman, W., De Baets, B. & Salakoski, T. (2011), `An experimental comparison of cross-validation techniques for estimating the area under the ROC curve´, <i>Computational Statistics & Data Analysis</i> <b>55</b>(4), 1828-1844.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000022&pid=S0120-1751201100010000700001&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
2. Cao, R. (1990), Aplicaciones y nuevos resultados del M\&#39;etodo Bootstrap en la estimaci\&#39;on no param\&#39;etrica de curvas, PhD thesis, University of Santiago de Compostela, Santiago de Compostela, Spain.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000023&pid=S0120-1751201100010000700002&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
3. Chin-Ying, L., Tian, L. & Schisterman, E. F. (2011), `Exact confidence interval estimation for the Youden index and its corresponding optimal cut-point´, <i>Computational Statistics & Data Analysis</i>. In Press, Corrected Proof. DOI: 10.1016/j.csda.2010.11.023.
*<a href="http://www.sciencedirect.com/science/article/B6V8V-51N223Y-1/2/9ac9b12dcddcf280e599a152375ca56c">http://www.sciencedirect.com/science/article/B6V8V-51N223Y-1/2/9ac9b12dcddcf280e599a152375ca56c</a>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000024&pid=S0120-1751201100010000700003&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
4. Efron, B. & Tibshirani, R. J. (1993), <i>An Introduction to the Bootstrap</i>, Chapman and Hall, London, United Kingdom.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000025&pid=S0120-1751201100010000700004&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
5. Fluss, R., Faraggi, D. & Reiser, B. (2005), `Estimation of the Youden index and its associated cutoff point´, <i>Biometrical Journal</i> <b>47</b>(4), 458-472.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000026&pid=S0120-1751201100010000700005&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
6. Green, D. M. & Swets, J. A. (1966), <i>Signal Detection Theory and Psychophysics</i>, Wiley, New York, United States.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000027&pid=S0120-1751201100010000700006&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
7. Hall, P., DiCiccio, J. T. & Romano, J. P. (1989), `On smoothing and the bootstrap´, <i>Annals of Statistics</i> <b>17</b>, 692-702.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000028&pid=S0120-1751201100010000700007&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
8. Hand, D. J. (2009), `Measuring classifier performance: A coherent alternative to the area under the ROC curve´, <i>Machine Learning - ML</i> <b>77</b>(1), 103-123.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000029&pid=S0120-1751201100010000700008&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
9. Huang, J. & Ling, C. X. (2005), `Using AUC and accuracy in evaluating learning algorithms´, <i>IEEE Transactions on Knowledge and Data Engineering</i> <b>17</b>(3), 299-310.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000030&pid=S0120-1751201100010000700009&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
10. Krzanowski, W. J. & Hand, D. J. (2009), <i>ROC Curves for Continuous Data</i>, Chapman and Hal, New York, United States.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000031&pid=S0120-1751201100010000700010&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
11. L\&#39;opez-de-Ulibarri, I., Cao, R., Cadarso-Su\&#39;arez, C. & Lado, M. J. (2008), `Nonparametric estimation of conditional ROC curves: application to discrimination tasks in computarized detection of early breast cancer´, <i>Computational Statistics & Data Analysis</i> <b>52</b>(5), 2623-2631.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000032&pid=S0120-1751201100010000700011&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
12. Lee, W. C. & Hsiao, C. K. (1998), `Alternative summary indices for the receiver operating characteristic curve´, <i>Epidemiology</i> <b>7</b>, 605-611.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000033&pid=S0120-1751201100010000700012&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
13. Liu, R. & Yang, L. (2008), `Kernel estimation of multivariate cumulative distribution function´, <i>Journal of Nonparametric Statistics</i> <b>20</b>(8), 661-667.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000034&pid=S0120-1751201100010000700013&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
14. Mart\&#39;\inez-Camblor, P. & De U\~na-\&#39;Alvarez, J. (2009), Studying the bandwidth in k-sample smooth tests, Technical Report 09, Universidad de Vigo, Vigo, Spain.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000035&pid=S0120-1751201100010000700014&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
15. Mart\&#39;\inez-Camblor, P. & Y\&#39;a\~nez-Juan, A. (2009), `Testing the equality of diagnostic effectiveness of one measure with respect to k different features´, <i>Journal of Applied Statistics</i> <b>36</b>(4), 359-367.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000036&pid=S0120-1751201100010000700015&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
16. Mugdadi, A. R. & Ghebregiorgis, G. S. (2005), `The kernel distribution estimator of functions of random variables´, <i>Journal of Nonparametric Statistics</i> <b>17</b>(7), 807-818.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000037&pid=S0120-1751201100010000700016&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
17. Nadaraya, E. A. (1962), `Some new estimates for distribution functions´, <i>Theory Probability Application</i> <b>9</b>, 497-500.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000038&pid=S0120-1751201100010000700017&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
18. Rey, C., Los Arcos, M., Concha, A., Medina, A., Prieto, S., Mart\&#39;\inez-Camblor, P. & Prieto, B. (2007), `Procalcitonin and C-reactive protein as markers of systemic inflammatory response syndrome severity in critically ill children´, <i>Intensive Care Medicine</i> <b>33</b>(3), 477-484.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000039&pid=S0120-1751201100010000700018&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
19. Rodr\&#39;\iguez-\&#39;Alvarez, M. X., Tahoces, P. G., Cadarso-Su\&#39;arez, C. & Lado, M. J. (2011), `Comparative study of ROC regression techniques-applications for the computer-aided diagnostic system in breast cancer detection´, <i>Computational Statistics & Data Analysis</i> <b>55</b>(1), 888-902.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000040&pid=S0120-1751201100010000700019&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
20. Rosenblatt, M. (1956), `Remarks on some nonparametric estimates of a density function´, <i>Annals of Mathematical Statistics</i> <b>17</b>, 832-837.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000041&pid=S0120-1751201100010000700020&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
21. Silverman, B. W. (1978), `Weak and strong uniform consistency of the density estimation and its derivatives´, <i>Annals of Statistics</i> <b>6</b>, 1177-1184.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000042&pid=S0120-1751201100010000700021&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
22. Silverman, B. W. (1986), <i>Density Estimation for Statistics and Data Analysis</i>, Chapman and Hall, New York, United States.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000043&pid=S0120-1751201100010000700022&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><!-- ref --><p>
23. Youden, W. J. (1950), `Index for rating diagnostic test´, <i>Cancer</i> <b>3</b>, 32-35.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000044&pid=S0120-1751201100010000700023&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --><center>
<b>&#91;Recibido en junio de 2010. Aceptado en diciembre de 2010&#93;</b>
</center>
<hr size="1">

    <p>
Este art&iacute;culo se puede citar en <i>LaTeX</i> utilizando la siguiente referencia bibliogr&aacute;fica de <i>BibTeX</i>:
</p>
<code><font size="2">@ARTICLE{RCEv34n1a07,    <br>
 &nbsp;&nbsp;&nbsp; AUTHOR &nbsp;= {Mart&iacute;nez-Camblor, Pablo},    <br>
 &nbsp;&nbsp;&nbsp; TITLE &nbsp; = {{Nonparametric Cutoff Point Estimation for Diagnostic Decisions with Weighted Errors}},    <br>
 &nbsp;&nbsp;&nbsp; JOURNAL = {Revista Colombiana de Estad&iacute;stica},    <br>
&nbsp;&nbsp;&nbsp; YEAR &nbsp;&nbsp; = {2011},    <br>
&nbsp;&nbsp;&nbsp; volume &nbsp;= {34},    <br>
&nbsp;&nbsp;&nbsp; number &nbsp;= {1},    ]]></body>
<body><![CDATA[<br>
&nbsp;&nbsp;&nbsp; pages &nbsp; = {133-146}    <br>
}</font></code>

<hr size="1">
</font>
     ]]></body><back>
<ref-list>
<ref id="B1">
<label>1</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Airola]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Pahikkala]]></surname>
<given-names><![CDATA[T.]]></given-names>
</name>
<name>
<surname><![CDATA[Waegeman]]></surname>
<given-names><![CDATA[W.]]></given-names>
</name>
<name>
<surname><![CDATA[De Baets]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
<name>
<surname><![CDATA[Salakoski]]></surname>
<given-names><![CDATA[T.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`An experimental comparison of cross-validation techniques for estimating the area under the ROC curve´]]></article-title>
<source><![CDATA[Computational Statistics & Data Analysis]]></source>
<year>2011</year>
<volume>55</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>1828-1844</page-range></nlm-citation>
</ref>
<ref id="B2">
<label>2</label><nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Cao]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
</person-group>
<source><![CDATA[Aplicaciones y nuevos resultados del M\&#39;etodo Bootstrap en la estimaci\&#39;on no param\&#39;etrica de curvas]]></source>
<year>1990</year>
</nlm-citation>
</ref>
<ref id="B3">
<label>3</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Chin-Ying]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[Tian]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[Schisterman]]></surname>
<given-names><![CDATA[E. F.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Exact confidence interval estimation for the Youden index and its corresponding optimal cut-point´]]></article-title>
<source><![CDATA[Computational Statistics & Data Analysis]]></source>
<year>2011</year>
</nlm-citation>
</ref>
<ref id="B4">
<label>4</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Efron]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
<name>
<surname><![CDATA[Tibshirani]]></surname>
<given-names><![CDATA[R. J.]]></given-names>
</name>
</person-group>
<source><![CDATA[An Introduction to the Bootstrap]]></source>
<year>1993</year>
<publisher-loc><![CDATA[London ]]></publisher-loc>
<publisher-name><![CDATA[Chapman and Hall]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B5">
<label>5</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Fluss]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Faraggi]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[Reiser]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Estimation of the Youden index and its associated cutoff point´]]></article-title>
<source><![CDATA[Biometrical Journal]]></source>
<year>2005</year>
<volume>47</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>458-472</page-range></nlm-citation>
</ref>
<ref id="B6">
<label>6</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Green]]></surname>
<given-names><![CDATA[D. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Swets]]></surname>
<given-names><![CDATA[J. A.]]></given-names>
</name>
</person-group>
<source><![CDATA[Signal Detection Theory and Psychophysics]]></source>
<year>1966</year>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[Wiley]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B7">
<label>7</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hall]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[DiCiccio]]></surname>
<given-names><![CDATA[J. T.]]></given-names>
</name>
<name>
<surname><![CDATA[Romano]]></surname>
<given-names><![CDATA[J. P.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`On smoothing and the bootstrap´]]></article-title>
<source><![CDATA[Annals of Statistics]]></source>
<year>1989</year>
<volume>17</volume>
<page-range>692-702</page-range></nlm-citation>
</ref>
<ref id="B8">
<label>8</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hand]]></surname>
<given-names><![CDATA[D. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Measuring classifier performance: A coherent alternative to the area under the ROC curve´]]></article-title>
<source><![CDATA[Machine Learning - ML]]></source>
<year>2009</year>
<volume>77</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>103-123</page-range></nlm-citation>
</ref>
<ref id="B9">
<label>9</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Huang]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Ling]]></surname>
<given-names><![CDATA[C. X.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Using AUC and accuracy in evaluating learning algorithms´]]></article-title>
<source><![CDATA[IEEE Transactions on Knowledge and Data Engineering]]></source>
<year>2005</year>
<volume>17</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>299-310</page-range></nlm-citation>
</ref>
<ref id="B10">
<label>10</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Krzanowski]]></surname>
<given-names><![CDATA[W. J.]]></given-names>
</name>
<name>
<surname><![CDATA[Hand]]></surname>
<given-names><![CDATA[D. J.]]></given-names>
</name>
</person-group>
<source><![CDATA[ROC Curves for Continuous Data]]></source>
<year>2009</year>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[Chapman and Hal]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B11">
<label>11</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[L\'opez-de-Ulibarri]]></surname>
<given-names><![CDATA[I.]]></given-names>
</name>
<name>
<surname><![CDATA[Cao]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Cadarso-Su\'arez]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Lado]]></surname>
<given-names><![CDATA[M. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Nonparametric estimation of conditional ROC curves: application to discrimination tasks in computarized detection of early breast cancer´]]></article-title>
<source><![CDATA[Computational Statistics & Data Analysis]]></source>
<year>2008</year>
<volume>52</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>2623-2631</page-range></nlm-citation>
</ref>
<ref id="B12">
<label>12</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Lee]]></surname>
<given-names><![CDATA[W. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Hsiao]]></surname>
<given-names><![CDATA[C. K.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Alternative summary indices for the receiver operating characteristic curve´]]></article-title>
<source><![CDATA[Epidemiology]]></source>
<year>1998</year>
<volume>7</volume>
<page-range>605-611</page-range></nlm-citation>
</ref>
<ref id="B13">
<label>13</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Liu]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Yang]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Kernel estimation of multivariate cumulative distribution function´]]></article-title>
<source><![CDATA[Journal of Nonparametric Statistics]]></source>
<year>2008</year>
<volume>20</volume>
<numero>8</numero>
<issue>8</issue>
<page-range>661-667</page-range></nlm-citation>
</ref>
<ref id="B14">
<label>14</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Mart\'\inez-Camblor]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[De U\~na-\'Alvarez]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<source><![CDATA[Studying the bandwidth in k-sample smooth tests]]></source>
<year>2009</year>
<publisher-loc><![CDATA[Vigo ]]></publisher-loc>
<publisher-name><![CDATA[Universidad de Vigo]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B15">
<label>15</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Mart\'\inez-Camblor]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[Y\'a\~nez-Juan]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Testing the equality of diagnostic effectiveness of one measure with respect to k different features´]]></article-title>
<source><![CDATA[Journal of Applied Statistics]]></source>
<year>2009</year>
<volume>36</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>359-367</page-range></nlm-citation>
</ref>
<ref id="B16">
<label>16</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Mugdadi]]></surname>
<given-names><![CDATA[A. R.]]></given-names>
</name>
<name>
<surname><![CDATA[Ghebregiorgis]]></surname>
<given-names><![CDATA[G. S.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`The kernel distribution estimator of functions of random variables´]]></article-title>
<source><![CDATA[Journal of Nonparametric Statistics]]></source>
<year>2005</year>
<volume>17</volume>
<numero>7</numero>
<issue>7</issue>
<page-range>807-818</page-range></nlm-citation>
</ref>
<ref id="B17">
<label>17</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Nadaraya]]></surname>
<given-names><![CDATA[E. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Some new estimates for distribution functions´]]></article-title>
<source><![CDATA[Theory Probability Application]]></source>
<year>1962</year>
<volume>9</volume>
<page-range>497-500</page-range></nlm-citation>
</ref>
<ref id="B18">
<label>18</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rey]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Los Arcos]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Concha]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Medina]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Prieto]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Mart\'\inez-Camblor]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[Prieto]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Procalcitonin and C-reactive protein as markers of systemic inflammatory response syndrome severity in critically ill children´]]></article-title>
<source><![CDATA[Intensive Care Medicine]]></source>
<year>2007</year>
<volume>33</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>477-484</page-range></nlm-citation>
</ref>
<ref id="B19">
<label>19</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rodr\'\iguez-\'Alvarez]]></surname>
<given-names><![CDATA[M. X.]]></given-names>
</name>
<name>
<surname><![CDATA[Tahoces]]></surname>
<given-names><![CDATA[P. G.]]></given-names>
</name>
<name>
<surname><![CDATA[Cadarso-Su\'arez]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Lado]]></surname>
<given-names><![CDATA[M. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Comparative study of ROC regression techniques-applications for the computer-aided diagnostic system in breast cancer detection´]]></article-title>
<source><![CDATA[Computational Statistics & Data Analysis]]></source>
<year>2011</year>
<volume>55</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>888-902</page-range></nlm-citation>
</ref>
<ref id="B20">
<label>20</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rosenblatt]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Remarks on some nonparametric estimates of a density function´]]></article-title>
<source><![CDATA[Annals of Mathematical Statistics]]></source>
<year>1956</year>
<volume>17</volume>
<page-range>832-837</page-range></nlm-citation>
</ref>
<ref id="B21">
<label>21</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Silverman]]></surname>
<given-names><![CDATA[B. W.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Weak and strong uniform consistency of the density estimation and its derivatives´]]></article-title>
<source><![CDATA[Annals of Statistics]]></source>
<year>1978</year>
<volume>6</volume>
<page-range>1177-1184</page-range></nlm-citation>
</ref>
<ref id="B22">
<label>22</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Silverman]]></surname>
<given-names><![CDATA[B. W.]]></given-names>
</name>
</person-group>
<source><![CDATA[Density Estimation for Statistics and Data Analysis]]></source>
<year>1986</year>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[Chapman and Hall]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B23">
<label>23</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Youden]]></surname>
<given-names><![CDATA[W. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[`Index for rating diagnostic test´]]></article-title>
<source><![CDATA[Cancer]]></source>
<year>1950</year>
<volume>3</volume>
<page-range>32-35</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
