Nestedness has been widely reported for both metacommunities and networks of interacting species. Even though the concept of this ecological pattern has been well-defined, there are several metrics by which it can be quantified. We noted that current metrics do not correctly quantify two major properties of nestedness: (1) whether marginal totals (i.e. fills) differ among columns and/or among rows, and (2) whether the presences (1's) in less-filled columns and rows coincide, respectively, with those found in the more-filled columns and rows. We propose a new metric directly based on these properties and compare its behavior with that of the most used metrics, using a set of model matrices ranging from highly-nested to alternative structures in which no nestedness should be detected. We also used an empirical dataset to explore possible biases generated by the metrics as well as to evaluate correlations between metrics. We found that nestedness has been quantified by metrics that inappropriately detect this pattern, even for matrices in which there is no nestedness. In addition, the most used metrics are prone to type I statistical errors while our new metric has better statistical properties and consistently rejects a nested pattern for different types of random matrices. The analysis of the empirical data showed that two nestedness metrics, matrix temperature and the discrepancy measure, tend to overestimate the degrees of nestedness in metacommunities. We emphasize and discuss some implications of these biases for the theoretical understanding of the processes shaping species interaction networks and metacommunity structure.117812271239