April Wright recently published a cool paper looking at how to bring morphological analyses of evolutionary relationships into the Bayesian realm. This is her take on it – enjoy!
Author Bio: My name is April Wright, and I’m a graduate student in David Hillis’ lab at the University of Texas at Austin. I’m largely interested in the estimation and use of phylogenetic trees to answer questions about evolution. Particularly, I’m investigating how we can make the best possible use of our fossils in an era increasingly dominated by genome-scale data. You might say I’m a little bit of a ‘small data’ scientist, though my questions often involve a multitude of small data sets.
Today I’d like to talk a little bit about a recent paper I published as part of my PhD thesis work.
What We Did
We performed a bunch of simulations of morphological data sets to look at whether parsimony or likelihood-based phylogenetic analyses perform better. This is important, as the majority of current morphological analyses exclusively use parsimony. We used an empirical tree borrowed from a 2011 paper by Alex Pyron (see Figure One), and simulated matrices of characters along said tree. We picked this tree because it reflects the complexity of many paleontological trees: extinction events resulting in short tips, mixes of long and short branches, and polytomies where evolutionary relationships are unresolved.
From our data sets, we simulated distributions of missing data by removing characters from our matrices. We don’t expect every character to have an equal probabilty of preservation. We might expect that fast-evolving characters, like digits, to be lost more easily, for example. So we imposed biased missing data to look at the impact of systemically underrepresenting certain characters.
We built trees using the Mk model in MrBayes (for Bayesian trees) and PAUP (for parsimony trees). We used the Robinson-Foulds metric (a measure of distance between different trees) to compare how many nodes in each tree were incorrectly estimated.
What We Found
Consistently, Bayesian estimation performed better. In Figure 4 (below), we can see that Bayesian estimation pretty consistently produces less errors than parsimony. In Figure 6 (below), we can see that this result is more striking in smaller data sets. We also found, per Figure 5 in the paper, that the characters that are missing makes a big difference. Missing fast-evolving characters, which display parallelisms and reversals, is not as harmful as missing slower characters, which are more parsimony-informative. This is not too surprising, but characters that display homoplasy provide background information on the overall rate of evolution in the tree and other parameters in likelihood-based analysis. They are still informative under likelihood-based analyses.
Practical Recommendations
Our results suggest a few practical steps for paleontologists.
- Bayesian models are worth learning to use.
- The effect of using Bayesian analysis is not as effective at reducing error as increasing the number of characters. But it is effective at improving the accuracy of phylogenetic estimation.
- It’s important to pay attention not just to what data you have, but what data are missing. Missing data have been a hot topic in phylogeny for ages. Does it matter? Does it not? Our answer is a clear ‘Yes, missing data matter’. But under-representation of some characters is worse than others.
The Future
The other two parts of my thesis are also about morphology. One, which will be in review soon, focuses on the use of hyperpriors to relax some of the assumptions of the Bayesian model for topology estimation from discrete morphological data. This study uses empirical data sets to locate situations in which more complex models of character evolution fit the data better, and uses simulations to assess if better model fit translates into more accurate estimation. I’m also working on techniques to discover appropriate partition schemes in morphological data sets. Partitioning allows us to estimate different model parameters for different subset of our data.
We certainly look forward to all of this in the future from April! In the mean time, if you have any comments, please do leave them below.
emanuel tschopp
interesting! what about a comparison with TNT? if I remember right, NT was shown to perform better than PAUP, maybe to a similar degree than MrBayes?
cheers,
Emanuel
James Albert
Looking at Fig. 3 of the published paper we see the Mk model performs better (less error) than MP at high rates, but the two methods do not differ at middle rates or low rates. Mk with no missing data does about the same as MP with missing data, and Mk with lots of missing data about the same as MP with missing data.
This is very similar to the well-known problem of the “Felsenstein zone” of “long branch attraction”, but in this case, it’s the attraction of branches with high-rates, really because they are longer over a given time period.
Since we never know the real rates (the results in this paper are based on simulations), the question is: which method should we choose?
The answer comes down to how frequent are long branches and/or high rates. A wise morphological systematist should always be alert to large phenotypic gaps.
The Mv model does not solve this problem, but it might highlight cases where convergence led to an incorrect tree. Note Mv saturates at 50%.
Are the days of MP numbered? I for one will continue to use MP as a fast and relatively efficient heuristic for mapping characters to trees and seeing how alternative character codings affect the tree, in e.g. MacClade or Mesquite. It’s fast (immediate) and very useful. Mk takes time and effort to run, and so would be good to use for a formal run. Perhaps the two should be used in combination.
James
Mike Taylor
I have nothing of substance to add; only to say that this looks like important work with practical implications. Thanks to April for doing the work (and publishing in PLOS ONE where we can all read it), and to Jon for hosting the blog.
Mike Taylor
I suppose the next step would be a to do this across a wide variety of different trees.