Please use this identifier to cite or link to this item:

Title: Re-scaling of model evaluation measures to allow direct comparison of their values
Authors: Barbosa, A. Márcia
Keywords: model evaluation
model accuracy
Issue Date: 2015
Citation: Barbosa A.M. (2015) Re-scaling of model evaluation measures to allow direct comparison of their values. Journal of Brief Ideas, 10.5281/zenodo.15487
Abstract: Species distribution models are increasingly used in ecology, biogeography and climate change research, and are usually complemented with one or more metrics evaluating their performance. Not all metrics vary within the same scale of measurement: for example, Cohen’s kappa and the true skill statistic (TSS) may range between -1 and 1, while most other widely used metrics range only between 0 and 1. Values of different measures are thus not directly comparable, and e.g. a kappa or TSS value of 0.6 does not denote (although it may at first sight suggest) lower discriminative accuracy than an area under the curve (AUC) of 0.8. Yet, these measures are often presented side by side without a clear acknowledgement of this scale difference. I propose clearly acknowledging such difference, or else using a simple formula to standardize these measures so that their values can be compared more directly. The following equation converts an evaluation score that ranges from -1 to 1 into its corresponding value in the 0-to-1 scale: (score+1)/2. Conversion can also be done the other way around with 2(score-0.5). This standardization is implemented in the modEvA* package for R (currently available on R-Forge), both as an independent function and as an option within other functions that compute and compare model evaluation measures.
Type: article
Appears in Collections:CIBIO-UE - Publicações - Artigos em Revistas Internacionais Sem Arbitragem Científica

Files in This Item:

File Description SizeFormat
Barbosa 2015 Rescaling eval measures - JBI.pdf184.81 kBAdobe PDFView/Open
FacebookTwitterDeliciousLinkedInDiggGoogle BookmarksMySpaceOrkut
Formato BibTex mendeley Endnote Logotipo do DeGóis 

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.


Dspace Dspace
DSpace Software, version 1.6.2 Copyright © 2002-2008 MIT and Hewlett-Packard - Feedback
UEvora B-On Curriculum DeGois