- Research article
- Open Access
Efficient context-dependent model building based on clustering posterior distributions for non-coding sequences
- Guy Baele^{1, 2, 3},
- Yves Van de Peer^{2, 3}Email author and
- Stijn Vansteelandt^{1}
https://doi.org/10.1186/1471-2148-9-87
© Baele et al; licensee BioMed Central Ltd. 2009
- Received: 02 January 2009
- Accepted: 30 April 2009
- Published: 30 April 2009
Abstract
Background
Many recent studies that relax the assumption of independent evolution of sites have done so at the expense of a drastic increase in the number of substitution parameters. While additional parameters cannot be avoided to model context-dependent evolution, a large increase in model dimensionality is only justified when accompanied with careful model-building strategies that guard against overfitting. An increased dimensionality leads to increases in numerical computations of the models, increased convergence times in Bayesian Markov chain Monte Carlo algorithms and even more tedious Bayes Factor calculations.
Results
We have developed two model-search algorithms which reduce the number of Bayes Factor calculations by clustering posterior densities to decide on the equality of substitution behavior in different contexts. The selected model's fit is evaluated using a Bayes Factor, which we calculate via model-switch thermodynamic integration. To reduce computation time and to increase the precision of this integration, we propose to split the calculations over different computers and to appropriately calibrate the individual runs. Using the proposed strategies, we find, in a dataset of primate Ancestral Repeats, that careful modeling of context-dependent evolution may increase model fit considerably and that the combination of a context-dependent model with the assumption of varying rates across sites offers even larger improvements in terms of model fit. Using a smaller nuclear SSU rRNA dataset, we show that context-dependence may only become detectable upon applying model-building strategies.
Conclusion
While context-dependent evolutionary models can increase the model fit over traditional independent evolutionary models, such complex models will often contain too many parameters. Justification for the added parameters is thus required so that only those parameters that model evolutionary processes previously unaccounted for are added to the evolutionary model. To obtain an optimal balance between the number of parameters in a context-dependent model and the performance in terms of model fit, we have designed two parameter-reduction strategies and we have shown that model fit can be greatly improved by reducing the number of parameters in a context-dependent evolutionary model.
Keywords
- Marginal Likelihood
- Rate Class
- Thermodynamic Integration
- Posterior Variance
- Substitution Behavior
Background
The past decades have seen the rise of increasingly complex models to describe evolution, both in coding and in non-coding datasets, using a range of different inferential methods of varying complexity. More accurate mathematical models of molecular sequence evolution continue to be developed for good reasons. First, the additional complexity of such models can lead to the identification of important evolutionary processes that would be missed with simpler models. Such discoveries may increase our understanding of molecular evolution. Second, using more accurate models may help to infer biological factors, such as phylogenetic topologies and branch lengths, more reliably. This may arise from the improved ability of those complex models to account for factors that simpler models neglect and whose influence on observed data might otherwise be misinterpreted [1].
Currently, the importance of modeling varying rates across sites in recovering the correct tree topology is well-known (see e.g. [2]). Acknowledging that the evolutionary rate at different sites might differ may, however, not be sufficient. Takezaki and Gojobori [3] used concatenated sequences of all protein-coding genes in mitochondria to recover the phylogeny of 28 vertebrate species. When the tree was rooted by lampreys or lampreys and sea urchins, the root of the vertebrate tree was incorrectly placed in the maximum-likelihood tree even when accounting for varying rates across sites. The authors suggest the importance of using the appropriate model for probabilities of substitution among different amino acids or nucleotides, as well as the assumption of varying rates across sites. Several other studies confirm the importance of using appropriate evolutionary models (see e.g. [4, 5]).
In this article, we focus specifically on relaxing the assumption of site-independent evolution, motivated by the fact that a number of empirical studies have found this assumption to be overly restrictive (e.g. [6–11]). Also the detection of the CpG-methylation-deamination process in mammalian data has given rise to many context-dependent studies (for an overview of such so-called CpG-related studies, studies using codon-based models, as well as the empirical studies mentioned, see [12]). In our previous work [12], we have introduced a context-dependent approach using data augmentation which builds upon standard evolutionary models, but incorporates site dependencies across the entire tree by letting the evolutionary parameters in these models depend upon the ancestral states at the two immediate flanking sites. Indeed, once that ancestral sequences have been estimated, the evolution of a given site across a branch is allowed to depend upon the identities of its immediate flanking bases at the start (i.e. the ancestor) of that branch. The use of existing evolutionary models avoids the need for introducing new and high-dimensional evolutionary models for site-dependent evolution, such as those proposed by Siepel and Haussler [13] and Hwang and Green [14]. Indeed, using a general time-reversible (GTR) model, which contains six evolutionary parameters on top of the four base frequencies used in the model, for each of the 16 neighboring base compositions results in a total of 96 parameters (although the GTR model is often regarded to have five free parameters, which results in 80 parameters instead of 96). This number of parameters does not include the set of four stationary equilibrium frequencies, which is assumed to be context-independent. Using a Markov chain Monte Carlo approach with data augmentation, one may then infer the evolutionary parameters under the resulting model for a large genomic dataset under a fixed tree topology. Previous analyses [12] based on this model have revealed large variations in substitution behavior dependent upon the neighbouring base composition.
Bayes Factors greater (smaller) than 1 suggest evidence in favor of M_{1} (M_{0}). In this paper, we will use log Bayes Factors, which are typically divided into 4 categories depending on their value: from 0 to 1, indicating nothing worth reporting; from 1 to 3, indicating positive evidence of one model over the other; from 3 to 5, indicating strong evidence of one model over the other; and larger than 5, indicating significant (or very strong) evidence of one model over the other [16].
We have chosen to calculate Bayes Factors using thermodynamic integration [18], since the harmonic mean estimator of the marginal likelihood systematically favors parameter-rich models. Thermodynamic integration is a generalization of the bridge sampling approach and is therefore often referred to as 'path-sampling' (see e.g. [19–21]). Lartillot and Phillipe [18] present two methods to calculate the Bayes Factor between two models. Using their so-called annealing or melting approach one model at a time is evaluated, resulting in a marginal likelihood for each model. The ratio of these individual marginal likelihoods then yields a Bayes Factor. When this approach yields marginal likelihoods with large error estimates, the resulting log Bayes Factor can be inaccurate. This can be avoided by using model-switch thermodynamic integration, which directly calculates the log Bayes Factor (Lartillot and Philippe, 2006). By construction, this approach results in lower error estimates for the Bayes Factor and allows one to make use of the additivity property of the logarithmic function to calculate Bayes Factors [22].
Unfortunately, building models based on Bayes Factor-based model comparisons is not feasible because calculating Bayes Factors requires vast amounts of computation time. In view of this, we reduce the number of model evaluations by proposing two schemes for clustering posterior density estimates from different evolutionary contexts (and thus for merging these contexts). To evaluate the fit of the resulting model, a Bayes Factor must be calculated. We propose 2 adaptations of the thermodynamic integration method proposed by Lartillot and Philippe [18] to make this practically feasible. First, we show how the Bayes Factor calculation can be performed in parallel independent runs on different nodes in a cluster system, thus greatly reducing the time needed to obtain results. Second, we show that these independent runs can be adjusted depending on the part of the integrand that is being integrated to allow for more intensive calculations in hard-to-evaluate parts of the integrand in the model-switch integration procedure, resulting in more accurate (log) Bayes Factor estimates.
Methods
Data
We analyze two datasets which we have discussed in earlier work [12]. The first dataset consists of 10 sequences from vertebrate species, each consisting of 114,726 sites, and is analyzed using the following rooted tree topology (((((Human, Chimpanzee), Gorilla), Orang-utan), ((Baboon, Macaque), Vervet)), ((Marmoset, Dusky Titi), Squirrel Monkey)). We refer to this dataset as the 'Ancestral Repeats' dataset. The second dataset consists of 20 small subunit (SSU) rRNA genes (nuclear), consists of 1,619 sites for each sequence and is analyzed using the 50% majority rule posterior consensus tree obtained under the general time-reversible model. This dataset contains the following sequences: Cyanophora paradoxa, Nephroselmis olivacea, Chlamydomonas moewusii, Volvox carteri, Paulschulzia pseudovolvox, Coleochaete orbicularis 2651, Coleochaete solute 32d1, Coleochaete irregularis 3d2, Coleochaete sieminskiana 10d1, Zygnema peliosporum, Mougeotia sp 758, Gonatozygon monotaenium 1253, Onychonema sp 832, Cosmocladium perissum 2447, Lychnothamnus barbatus 159, Nitellopsis obtusa F131B, Chara connivens F140, Lamprothamnium macropogon X695, Arabidopsis thaliana and Taxus mairei. We refer to this dataset as the 'Nuclear SSU rRNA' dataset.
Evolutionary models
with π = {π_{ A }, π_{ C }, π_{ G }, π_{ T }} the set of base frequencies and rAC, rAG, rAT, rCG, rCT and rGT the evolutionary substitution parameters. As in our previous work (Baele et al., 2008), let θ = {2π_{ A }π_{ G }rAG, 2π_{ A }π _{ C }rAC, 2π_{ A }π_{ T }rAT, 2π_{ G }π_{ C }rCG, 2π_{ G }π_{ T }rGT, 2π_{ C }π_{ T }rCT} be the terms of the scaling formula that binds the parameters of the model and T be the set of branch lengths with t_{ b }(t_{ b }≥ 0) one arbitrary branch length and μ a hyperparameter in the prior for t_{ b }in T. As in Baele et al. (2008), the following prior distributions q(·) were chosen for our analysis, with Γ(.) the Gamma function:
π ~ Dirichlet (1,1,1,1), q (π) = Γ (4) on ,
θ ~ Dirichlet (1,1,1,1,1,1), q (θ) = Γ (6) on ,
t_{ b }|μ ~ Exponential (μ), for each t_{ b }in T
and
μ ~ Inv-gamma (2.1, 1.1), , μ > 0.
Branch lengths are assumed i.i.d. given μ. When the model allows for the presence of multiple contexts of evolution, each context is assumed to have its own prior, independently of other contexts.
As there are 16 possible neighboring base combinations, we use a distinct GTR model per neighboring base composition, thus increasing the number of evolutionary contexts from 1 to16 for a full context-dependent model (Baele et al., 2008). The goal of this article is to reduce the dimension of such a model in an accurate and computationally efficient manner, by sharing parameters between contexts, which will improve the fit to the data. Note that the independent GTR model will be used as the reference model (i.e. the model to which all other models will be compared) throughout the remainder of this paper.
Thermodynamic integration – split calculation
The split-calculation approach discussed in this section can be skipped by the less technically-minded people.
Different context-dependent models can be compared in terms of model fit with the independent GTR model by calculating the appropriate (log) Bayes Factors. One may use model-switch thermodynamic integration for this purpose [18]. This is a computationally intensive approach which yields reliable estimates for the (log) ratio of the marginal likelihoods corresponding to two models. Below, we explain how one can use a split calculation approach to make this integration procedure computationally more tractable.
This expectation E_{ β }[U(θ)]may be approximated with a sample average once a sample of random draws from p_{ β }(θ) is obtained using MCMC. The integration problem is now simplified to the problem of integrating w.r.t. a scalar parameter β, which is relatively easily handled by numerical approximation using the composite trapezoidal rule.
assuming independence between the successive draws from the chain. The total error on the log Bayes Factor equals σ = σ_{ d }+ 1.645 σ_{ s }, with σ_{ s }the square root of the sampling variance [18]. In general, a sufficiently long burn-in is necessary to obtain reliable estimates and low error margins.
Data augmentation
where L_{ X }|M_{ i }is the complete data likelihood under model M_{ i }when X ∈ {A, C, G, T} is the value augmented for the considered ancestral site. This result in a probability for each nucleotide to be inferred at a given site, with the four probabilities summing to one. The ancestral sequences are then updated sequentially, i.e. one site at a time, from top to bottom in the considered tree and from the first site moving along the sequence up to the last site, each ancestral site is updated during each update cycle.
When β equals 0 (1), the ancestral sequences are random draws from the posterior distribution of Y_{ mis }under M_{0} (M_{1}). At certain ancestral positions, this may result in imputed values with small likelihoods under M_{1} (M_{0}), which in turn leads to larger differences between the log likelihoods of the two models. Because of this, the contributions of the model-switch integration scheme to the log Bayes Factor are most tedious to calculate when β is close to 0 and 1, which is why we use smaller update steps for β in those situations. In the case of an observed data likelihood, which involves summing over all missing ancestral nucleotides, this situation does not occur.
Evolutionary rate augmentation
where r_{ i }represents the rate of site i, which is being augmented, r_{-i}represents the set of rates for all remaining sites, β represents the current position along the path between the two posterior distributions, and is the complete data likelihood under the rates-across-sites model M_{1} when X ∈ {r_{1},..., r_{ n }} is the value imputed for the considered missing rate. Note that, when comparing model M_{1} with a model which assumes equal rates, only the rate parameters indexing M_{1} need to be updated with a new set of rates at each model-switch iteration in the calculation of a Bayes Factor.
Context reduction
Our context-dependent model consists of 16 possibly different GTR models, one for each neighbouring base composition (a.k.a. 'evolutionary context'). In practice, it is likely that the evolutionary processes are similar in a number of neighboring base compositions, or that the data are insufficiently informative to distinguish these. This suggests reducing the model's dimensionality by merging contexts, which may subsequently lead to evolutionary models with reduced parameter uncertainty which fit the data better than the independent model. Unfortunately, the time-consuming calculation of Bayes Factors makes exhaustive model search using Bayes Factors currently prohibiting. In view of this, we have sampled 1,000 values of each of the 96 parameters in our full context-dependent model from the Markov chain every 50^{th} iteration after an initial burn-in of 50,000 iterations. On the basis of the 1,000 values for each of the six parameters per context, the first two principal components are calculated and displayed in a scatterplot, thus resulting in 16 six-dimensional clusters each consisting of one context.
The location of certain contexts in such a scatterplot may indicate strong differences between some contexts, but not between others, and may thus be informative of contexts that can meaningfully be merged. However, this is not always the case partly because information is inevitably lost by considering only two principal components. Using a scatterplot matrix of the first three principal components might add information, but would still require arbitrary decisions from the researcher on the clustering of different contexts. In this section, we therefore propose two algorithmic, automated methods for clustering contexts by progressive agglomeration. Each decision taken by these algorithms is then confirmed by calculating the corresponding log Bayes Factor.
A likelihood-based reduction approach
- 1.
Reduce the number of contexts with 1 by merging 2 contexts. Calculate the likelihood of the corresponding model. Repeat this for all pairs of contexts.
- 2.
Select the highest likelihood obtained in the previous step, merge the two corresponding clusters and recalculate the empirical mean and variance-covariance matrix of the parameters corresponding to the merged clusters. To make the calculations more feasible, we do not enforce to run a Markov chain for each newly obtained model to infer new estimates of the posterior means and variance-covariance matrices.
- 3.
Iterate steps 1 and 2 until only one cluster remains.
Through the remainder of this work, we define a cluster as the merge of two or more evolutionary contexts. As the merging of clusters progresses, the likelihood will gradually decrease in value. This is expected as the parameter estimates can be better approximated by context-specific means and variance-covariance matrices instead of cluster-specific means and variance-covariance matrices. Since the likelihood only decreases (and additionally depends on the chosen number of samples in an arbitrary fashion), it cannot be used to determine the optimal number of clusters/contexts. In terms of the (log) Bayes Factor, it is typically expected that the model fit will first gradually increase, reach an optimum, and then decrease. In each step of the algorithm, we therefore calculate the Bayes Factor corresponding to the selected model. In principle, the algorithm can be stopped when the Bayes Factors decrease convincingly with additional context reductions.
In each step of the above algorithm, the number of parameters in the model decreases with 6. Since each step selects the clustering which minimizes the decrease in log likelihood, this approach is likely to detect a model with near-optimal (log) Bayes Factor.
A graph-based reduction approach
While the parameter-reduction approach of the previous section has a statistical basis, it is likely to yield models with suboptimal fit. Indeed, the likelihood-based approach systematically favors merging two separate contexts over merging a context with already merged contexts (to build clusters with three or more contexts). Consider a scenario of two proposed clusters, one already containing two contexts and being expanded with a third context, and one containing a single context and being merged with another context. These two clusters will each have one mean and one variance-covariance matrix to represent the parameter estimates. However, the three-context cluster is not represented so easily with this reduced parameterization due to the increased variance of the three-contexts cluster. Such an increase in variance leads to a drastic decrease of the likelihood which implies that merging small clusters will tend to be preferred over expanding existing clusters.
- 1.
Calculate the likelihoods of all possible pair wise context reductions (120 in total), starting from the initial clustering of each context separately (which yielded the initial likelihood).
- 2.
Use the difference between the newly obtained likelihoods and the initial likelihood as edge costs in a fully connected undirected graph of 16 nodes. Similar contexts will be connected by low-cost edges while dissimilar contexts will be connected by high-cost edges. The cost function then consists of the sum of each edge that participates in a cluster (i.e. one edge for a cluster of two contexts, three edges for a cluster of three contexts, six edges for a cluster of four contexts ...).
- 3.
Sort the 120 likelihood differences, smallest differences first (each difference corresponds with a merge of two clusters).
- 4.
Using the sorted list, merge the clusters following the order proposed by the list. If the proposed merge is between two contexts which both have not yet participated in a merge operation, proceed with merging them and color the two nodes and the connecting edge in the graph. If at least one of the contexts is already colored in the graph, proceed with the merging of the clusters if the resulting fully interconnected network in the graph (i.e. between the contexts to be merged) yields the lowest value for the cost function of the possible networks of similar structure (i.e. the fully connected networks with an equal amount of nodes) that have not yet been colored (see the Results section for a practical example). If there is a lower-cost alternative, do not merge the clusters and proceed with the following entry from the list, until only one cluster remains. The objective of this graph-based approach is thus not simply to minimize the cost function, but to minimize the cost function conditional on the proposed new clustering. This means that when a proposed merge is accepted, it was the cheapest merge possible between competing networks of similar structure.
This graph-based reduction approach has the advantage that it does not need additional Markov chains to be run. Given the costs of the various reductions and their order to be evaluated in, determined in the first two steps, the algorithm attempts to cluster those contexts closest to one another, with the enforced constraints that only competing clusters of the same composition are compared. This should result in larger clusters and thus possibly in larger improvements of the model fit.
Results and discussion
The Ancestral Repeats dataset
Approaches Compared
Comparison of single versus composite run Bayes Factor estimation.
Annealing Integration | |||||
---|---|---|---|---|---|
δβ = 0.001 | Integration interval | Q.E. | σ_{d} | σ_{s} | total error |
Q = 200 | 0.00 – 0.10 | -121.7 | 11.7 | 2.0 | 14.9 |
0.10 – 0.20 | 57.3 | 0.1 | 0.4 | 0.7 | |
0.20 – 0.30 | 68.9 | 0.0 | 0.2 | 0.4 | |
0.30 – 0.40 | 74.3 | 0.0 | 0.2 | 0.3 | |
0.40 – 0.50 | 77.8 | 0.0 | 0.2 | 0.3 | |
0.50 – 0.60 | 80.6 | 0.0 | 0.1 | 0.2 | |
0.60 – 0.70 | 82.1 | 0.0 | 0.1 | 0.2 | |
0.70 – 0.80 | 83.9 | 0.0 | 0.1 | 0.2 | |
0.80 – 0.90 | 87.0 | 0.0 | 0.2 | 0.3 | |
0.90 – 1.00 | 102.7 | 1.3 | 1.5 | 3.8 | |
Total | 0.00 – 1.00 | 592.9 | 13.2 | 4.9 | 21.3 |
Composite Run log Bayes Factor: 592.9 | |||||
Composite Run Confidence Interval: [571.6; 614.2] | |||||
Single Run log Bayes Factor: 592.7. σ_{d} = 13.4. σ_{s} = 2.5. σ = 17.6 | |||||
Single Run Confidence Interval: [575.1; 610.2] | |||||
Melting Integration | |||||
δβ = 0.001 | Integration interval | Q.E. | σ_{d} | σ_{s} | total error |
Q = 200 | 1.00 – 0.90 | 121.7 | 8.2 | 3.3 | 13.7 |
0.90 – 0.80 | 87.5 | 0.0 | 0.2 | 0.3 | |
0.80 – 0.70 | 84.5 | 0.0 | 0.1 | 0.2 | |
0.70 – 0.60 | 82.7 | 0.0 | 0.1 | 0.2 | |
0.60 – 0.50 | 80.8 | 0.0 | 0.1 | 0.2 | |
0.50 – 0.40 | 77.9 | 0.0 | 0.2 | 0.3 | |
0.40 – 0.30 | 74.5 | 0.0 | 0.2 | 0.3 | |
0.30 – 0.20 | 69.1 | 0.0 | 0.2 | 0.4 | |
0.20 – 0.10 | 58.1 | 0.1 | 0.4 | 0.7 | |
0.10 – 0.00 | -42.9 | 3.2 | 1.4 | 5.6 | |
Total | 1.00 – 0.00 | 693.8 | 11.7 | 6.2 | 21.9 |
Composite Run log Bayes Factor: 693.8 | |||||
Composite Run Confidence Interval: [671.9; 715.7] | |||||
Single Run log Bayes Factor: 693.6. σ_{d} = 12.3. σ_{s} = 3.6. σ = 18.3 | |||||
Single Run Confidence Interval: [675.3; 711.9] |
As can be seen from Table 1, running 200 full chain updates at each value of β works well only in the integration interval [0.1;0.9]. Indeed, the quasistatic estimates in both directions produce very similar results when β is in the interval [0.1;0.9]. However, as a result of the ancestral data augmentation, the same settings for β should not be applied when one of the models converges to its prior, i.e. in the integration intervals [0.0;0.1] and [0.9;1.0] for β, as the ancestral sites imputed in those intervals converge towards essentially arbitrary data for one of the models and yield very small values for the log likelihood. This makes it more difficult and time-consuming to yield similar and reliable estimates for both directions of the model-switch integration scheme. We have therefore opted to split our calculations into 20 sections, each with the same amount of chain updates (Q = 200), but using a larger number of updates for β as the chain progresses closer to one of the prior distributions. A referee remarked that Lepage et al. [24] have used a sigmoidal schedule for β to circumvent this problem.
Split calculation for the annealing model-switch integration.
δβ | Integration interval | Q.E. | σ_{d} | σ_{s} | total error |
---|---|---|---|---|---|
0.0001 | 0.00–0.01 | -71.7 | 1.0 | 0.5 | 1.8 |
0.0001 | 0.01–0.02 | -16.8 | 0.1 | 0.2 | 0.4 |
0.0002 | 0.02–0.04 | -8.8 | 0.0 | 0.2 | 0.4 |
0.0002 | 0.04–0.06 | 0.8 | 0.0 | 0.2 | 0.3 |
0.0002 | 0.06–0.08 | 5.5 | 0.0 | 0.1 | 0.2 |
0.0002 | 0.08–0.10 | 7.9 | 0.0 | 0.1 | 0.2 |
0.001 | 0.10–0.20 | 57.3 | 0.1 | 0.4 | 0.7 |
0.001 | 0.20–0.30 | 68.9 | 0.0 | 0.2 | 0.4 |
0.001 | 0.30–0.40 | 74.3 | 0.0 | 0.2 | 0.3 |
0.001 | 0.40–0.50 | 77.8 | 0.0 | 0.2 | 0.3 |
0.001 | 0.50–0.60 | 80.6 | 0.0 | 0.1 | 0.2 |
0.001 | 0.60–0.70 | 82.1 | 0.0 | 0.1 | 0.2 |
0.001 | 0.70–0.80 | 83.9 | 0.0 | 0.1 | 0.2 |
0.001 | 0.80–0.90 | 87.0 | 0.0 | 0.2 | 0.3 |
0.0002 | 0.90–0.92 | 17.9 | 0.0 | 0.0 | 0.1 |
0.0002 | 0.92–0.94 | 18.0 | 0.0 | 0.0 | 0.1 |
0.0002 | 0.94–0.96 | 18.4 | 0.0 | 0.1 | 0.1 |
0.0002 | 0.96–0.98 | 19.1 | 0.0 | 0.1 | 0.2 |
0.0001 | 0.98–0.99 | 10.3 | 0.0 | 0.1 | 0.2 |
0.0001 | 0.99–1.00 | 18.1 | 0.3 | 0.5 | 1.1 |
Total | 0.00–1.00 | 630.7 | 1.6 | 3.6 | 7.5 |
Composite Run log Bayes Factor: 630.7 | |||||
Composite Run Confidence Interval: [623.2; 638.2] |
Split calculation for the melting model-switch integration.
δβ | Integration interval | Q.E. | σ_{d} | σ_{s} | total error |
---|---|---|---|---|---|
0.0001 | 1.00–0.99 | 22.0 | 1.2 | 0.6 | 2.2 |
0.0001 | 0.99–0.98 | 10.2 | 0.0 | 0.1 | 0.2 |
0.0002 | 0.98–0.96 | 19.2 | 0.0 | 0.1 | 0.2 |
0.0002 | 0.96–0.94 | 18.5 | 0.0 | 0.1 | 0.1 |
0.0002 | 0.94–0.92 | 18.1 | 0.0 | 0.0 | 0.1 |
0.0002 | 0.92–0.90 | 17.8 | 0.0 | 0.0 | 0.1 |
0.001 | 0.90–0.80 | 87.5 | 0.0 | 0.2 | 0.3 |
0.001 | 0.80–0.70 | 84.5 | 0.0 | 0.1 | 0.2 |
0.001 | 0.70–0.60 | 82.7 | 0.0 | 0.1 | 0.2 |
0.001 | 0.60–0.50 | 80.8 | 0.0 | 0.1 | 0.2 |
0.001 | 0.50–0.40 | 77.9 | 0.0 | 0.2 | 0.3 |
0.001 | 0.40–0.30 | 74.5 | 0.0 | 0.2 | 0.3 |
0.001 | 0.30–0.20 | 69.1 | 0.0 | 0.2 | 0.4 |
0.001 | 0.20–0.10 | 58.1 | 0.1 | 0.4 | 0.7 |
0.0002 | 0.10–0.08 | 8.0 | 0.0 | 0.1 | 0.2 |
0.0002 | 0.08–0.06 | 5.6 | 0.0 | 0.1 | 0.2 |
0.0002 | 0.06–0.04 | 1.3 | 0.0 | 0.2 | 0.3 |
0.0002 | 0.04–0.02 | -8.7 | 0.1 | 0.2 | 0.5 |
0.0001 | 0.02–0.01 | -15.5 | 0.1 | 0.2 | 0.4 |
0.0001 | 0.01–0.00 | -57.8 | 0.6 | 0.4 | 1.2 |
Total | 0.00–1.00 | 653.7 | 2.3 | 3.6 | 8.2 |
Composite Run log Bayes Factor: 653.7 | |||||
Composite Run Confidence Interval: [645.5; 661.9] |
Varying rates across sites and CpG effects
Number of discrete rate classes when assuming varying rates across sites and the resulting increase in model fit obtained.
Model | Contexts | Annealing | Melting | log BF |
---|---|---|---|---|
GTR+G4 | 1 (7) | [334.8; 348.4] | [362.5; 376.7] | 355.6 |
GTR+G5 | 1 (7) | [334.1; 348.1] | [360.4; 374.7] | 354.3 |
GTR+G6 | 1 (7) | [333.6; 347.8] | [361.3; 375.7] | 354.6 |
GTR+G7 | 1 (7) | [332.9; 347.1] | [361.6; 375.9] | 354.4 |
GTR+G8 | 1 (7) | [334.0; 348.0] | [363.7; 378.3] | 356.0 |
GTR | 1 (6) | - | - | 0 |
The previous results show that allowing for varying rates across sites drastically increases model fit compared to assuming equal rates for all sites. Analysis of the data using the context-dependent evolutionary model has further shown that substitution behavior is heavily dependent upon the neighbouring base composition [12]. A well-known context-dependent substitution process is the 5-methylcytosine deamination process (i.e., the CpG effect), which has been the subject of several studies (see e.g. [26–28]). We have calculated the log Bayes Factor of two different CpG effects. We have modeled the traditional CpG effect where the substitution behavior of a site can differ from the other sites when the 3' neighbor is guanine. The mean log Bayes Factor for this model, which contains a mere 12 parameters, equals 137.8 (annealing: [127.1; 141.0], melting: [137.0; 146.2]), a significant improvement in terms of model fit compared to the independent model. We have also modeled a CpG effect that is dependent upon its 5' neighbor, i.e. those sites with guanine as a 3' neighbor are assumed to have a different substitution behavior depending on the 5' neighbor. Such a model has 30 parameters and a mean log Bayes Factor of 157.8 when compared to the independent GTR model (annealing: [142.7; 155.0], melting: [159.6; 173.8]), i.e. this model is preferred over both the model assuming the traditional CpG effect and the independent model. However, the log Bayes Factor of 642.2 attained by the full context-dependent model (as compared to the independent GTR model) suggests that many more complex evolutionary patterns exist besides the CpG effect.
The likelihood-based reduction approach: results
Stepwise context reduction for the Ancestral Repeats dataset using the likelihood-based approach.
Model | Contexts | Annealing | Melting | log BF |
---|---|---|---|---|
GTR16C | 16 (96) | [623.2; 638.2] | [645.5; 661.9] | 642.2 |
GTR15C | 15 (90) | [658.0; 672.1] | [665.0; 682.0] | 669.2 |
GTR14C | 14 (84) | [651.9; 668.4] | [664.3; 678.9] | 665.9 |
GTR13C | 13 (78) | [661.7; 675.9] | [672.6; 686.4] | 674.2 |
GTR12C | 12 (72) | [679.8; 694.7] | [695.8; 714.7] | 696.3 |
GTR11C | 11 (66) | [676.5; 692.7] | [694.4; 709.7] | 693.3 |
GTR10C | 10 (60) | [686.0; 700.1] | [698.9; 715.5] | 700.1 |
GTR9C | 9 (54) | [675.3; 689.0] | [685.5; 701.1] | 687.7 |
GTR8C | 8 (48) | [656.7; 669.7] | [678.5; 695.6] | 675.1 |
GTR | 1 (6) | - | - | 0 |
The graph-based reduction approach: results
As predicted above, the likelihood-based reduction approach favors small clusters. To confirm this assumption, we have re-run a Markov chain using a context-dependent model consisting of the optimal number of 10 clusters derived using the likelihood-based approach. Using the parameter estimates from this model, we have calculated the posterior variances of the (yellow) cluster containing the AXC, GXA and GXC contexts and compared them to the empirical variances obtained from merging these three contexts but not re-running the chain. The actual posterior variances were much smaller, equaling merely between 3% and 24% of the empirical variances that were used. However, calculating these posterior variances is practically not feasible for fast model building because running a new Markov chain for the Ancestral Repeats dataset takes about 4 days per run. Further, the result of each run needs to be awaited to decide upon the next step in the clustering algorithm, which greatly increases the time needed to obtain an optimal context-dependent model.
Determining the reduction path for the graph-based reduction approach.
Step | Context 1 | Context 2 | Log likelihood difference | Performed | Model |
---|---|---|---|---|---|
1 | CXC | TXC | 872.10 | YES | GTR15C |
2 | GXG | TXG | 1064.87 | YES | GTR14C |
3 | GXT | TXC | 1300.93 | YES | GTR13C |
4 | CXC | GXC | 1524.96 | YES | GTR12C |
5 | AXC | GXC | 1750.50 | NO | |
6 | GXC | TXC | 1777.24 | SKIP | |
7 | AXT | CXG | 1868.77 | YES | GTR11C |
8 | CXC | GXT | 1925.79 | SKIP | |
9 | CXA | GXT | 1928.98 | YES | GTR10C |
10 | GXC | GXT | 1940.97 | SKIP | |
11 | GXA | TXG | 1961.01 | YES | GTR9C |
12 | AXC | GXA | 1964.73 | YES | GTR8C |
13 | GXA | GXG | 1973.80 | SKIP | |
14 | AXC | CXG | 1983.92 | YES | GTR7C |
15 | AXC | TXG | 2043.25 | SKIP | |
16 | CXA | GXC | 2047.72 | SKIP | |
17 | AXC | GXG | 2211.16 | SKIP | |
18 | CXG | TXG | 2302.08 | SKIP | |
19 | CXG | GXG | 2341.46 | SKIP | |
20 | CXG | GXC | 2343.32 | YES | GTR6C |
21 | AXC | AXT | 2352.48 | SKIP | |
22 | GXT | TXA | 2363.72 | YES | GTR5C |
... | ... | ... | ... | ... | ... |
Stepwise context reduction for the Ancestral Repeats dataset using the graph-based approach.
Model | Contexts | Annealing | Melting | log BF |
---|---|---|---|---|
GTR16C | 16 (96) | [623.2; 638.2] | [645.5; 661.9] | 642.2 |
GTR15C | 15 (90) | [658.0; 672.1] | [665.0; 682.0] | 669.2 |
GTR14C | 14 (84) | [651.9; 668.4] | [664.3; 678.9] | 665.9 |
GTR13C | 13 (78) | [664.9; 679.6] | [676.4; 693.1] | 678.5 |
GTR12C | 12 (72) | [673.3; 689.1] | [685.3; 701.7] | 687.4 |
GTR11C | 11 (66) | [682.3; 697.9] | [693.5; 710.4] | 696.0 |
GTR10C | 10 (60) | [677.5; 693.4] | [697.5; 710.3] | 694.7 |
GTR9C | 9 (56) | [693.7; 707.6] | [710.4; 724.6] | 709.1 |
GTR8C | 8 (48) | [699.3; 711.7] | [712.4; 727.5] | 712.7 |
GTR7C | 7 (42) | [686.5; 700.0] | [705.1; 719.3] | 702.7 |
GTR6C | 6 (36) | [650.6; 663.0] | [651.2; 664.8] | 657.4 |
GTR5C | 5 (30) | [641.4; 652.3] | [639.2; 649.2] | 645.5 |
GTR | 1 (6) | - | - | 0 |
To illustrate step 4 of the algorithm (see the Materials & Methods section), we discuss the 5^{th} step of the graph-based reduction approach. The 4^{th} iteration has yielded a model allowing for twelve clusters: a first cluster consists of four contexts (CXC, GXC, GXT and TXC), a second cluster consists of two contexts (GXG and TXG) and ten other clusters consist of a single context. To calculate the current clustering cost, the cost of the branch connecting contexts GXG and TXG (1064.87 units) is added to the cost of all the interconnecting branches between the CXC, GXC, GXT and TXC contexts (see Table 6): CXC-GXC (1524.96), CXC-GXT (1925.79), CXC-TXC (872.10), GXC-GXT (1940.97), GXC-TXC (1777.24) and GXT-TXC (1300.93). The clustering in step 4 thus has a cost of 10,406.86 units. The proposed step in the 5^{th} iteration to expand the four-contexts cluster (CXC, GXC, GXT and TXC) with a fifth context, i.e. AXC, then results in a cost of 20,124.32 units. However, expanding the four-context cluster with CXA instead of AXC yields a cost of 19,423.12 units, as the CXA context lies reasonably close to all four contexts whereas AXC lies mainly close to the GXC context. Therefore, the four-context cluster is not expanded in this 5^{th} iteration.
We have concluded earlier (see Table 4) that using more than four rate classes for the discrete approximation does not yield clear improvements in model fit. Hence, we have combined the optimal model, obtained with the graph-based reduction approach, with the assumption of varying rates across sites using four rate classes. We have compared this reduced model with varying rates across sites to the full context-dependent model with varying rates across sites (also with four rate classes). The full context-dependent model yields a log Bayes Factor of 960.1 (annealing: [935.5; 959.4], melting: [690.9; 984.6]), thereby clearly outperforming the full context-dependent model with equal rates (with a log Bayes Factor of 642.2) and the independent model with varying rates across sites (with a log Bayes Factor of 355.6). Further, the optimal model yields an even higher log Bayes Factor of 1029.8 (annealing: [1001.8; 1022.4], melting: [1037.0; 1058.1]), thereby conserving the increase in model fit obtained with equal rates (see Table 7).
Interpretation of the optimal model
The graph-based reduction approach yields the best performing context-dependent model for the Ancestral Repeats dataset, but the interpretation of the clustering of neighboring base compositions is far from obvious. To gain insight, we have studied the parameter estimates of the GTR model for the 16 neighboring base compositions, which have been reported and discussed in previous work (Baele et al., 2008). In a first step, we try to determine why the five contexts AXA, AXG, CXT, TXA and TXT are clustered separately in the 'optimal' context-dependent model. The AXA and AXG contexts have much higher rCT parameter estimates than all other contexts. For the AXG context, this could be attributed to a CpG effect, conditional on the preceding adenine. This might mean that, for the AXA context, a non-CpG methylation process is present although we are unaware of earlier reports of such a process in the AXA context. In previous work (see [12]), we already elaborated on the possibility of a TpA effect, especially in the AXA context. Such an effect could occur conditional on the preceding base, as is the case for the CpG effect.
Non-CpG methylation is the subject of many discussions in mammalian evolution. Woodcock et al. [29] reported that 55% of all methylation in human spleen DNA could be at dinucleotides other than CpG. In their analysis of mammalian DNA, Ramsahoye et al. [30] found that embryonic stem cells, but not somatic tissues, have significant cytosine-5 methylation at CpA and, to a lesser extent, at CpT. However, high relative rates between C and T have been observed in aligned gene/pseudogene sequences of human DNA in the past [31]. The reason for the separate clustering of the CXT and TXT contexts seems to be the lower than average (and again, than all other contexts) rCT parameter estimates (or the higher than average rAG parameter estimates). When considering that the CXT and TXT contexts can be found on the complementary strand of the AXG and AXA contexts, this makes perfect sense. This complementarity aspect is actually dominantly present in Figure 6 when considering the green and red clusters. Indeed, the green cluster contains contexts AXC, GXA, GXG and TXG while the red cluster contains all the complementary contexts, resp. GXT, TXC, CXC and CXA, further augmented with GXC. This latter context, along with the other symmetrical contexts (i.e. whose complementary context is the context itself) AXT, CXG and TXA correspond to a zero first principal component in Figure 6. This first principal component has a loading of 0.73 for the rAG parameter and -0.68 for the rCT parameter, with loadings for the other parameters all below 0.03. Hence, this principal component roughly measures the differences between the rAG and rCT parameter estimates. This explains why most of the clustering patterns in Figures 3 and 6 are retrieved in the rAG and rCT parameter estimates.
Only the separate TXA context cannot be explained using the transition estimates. Because both the rAG and rCT parameter estimates for this context are lower than average, the transversion estimates must be studied (see [12], online supplementary material). The TXA context has the highest rAT and rGT parameter estimates of all 16 contexts and the rAC parameter estimates are also above average, which seems to lead to a significantly differing evolutionary behavior when compared to all other contexts. This observation reinforces our opinion that modeling different substitution behavior of the transition parameters (as is mainly the case when modeling CpG effects) cannot by far account for the complexity of mammalian DNA evolution. Indeed, the separate clustering of the TXA context suggests that modeling different substitution behavior of the transversion parameters depending on the nearest neighbors can increase model fit. This is supported by a clear preference of the six-cluster model (GTR6C in Table 7), clustering TXA separately, over the five-cluster model (GTR5C in Table 7), which includes TXA in a large cluster with 11 other contexts.
We have already shown that modeling CpG effects, both dependent and independent of the preceding base, does not even come close to modeling a full context-dependence scheme based on the flanking bases in terms of model fit. The evolutionary patterns of sites with guanine as the 3' neighbor can nonetheless be seen to lie close in the principal components plot (see Figure 6). All four occurrences lie in the lower left section of the plot, even though only the GXG and TXG contexts are effectively clustered together. This reinforces our finding that CpG effects are only one aspect of context-dependent evolution and that CpG effects are dependent of the preceding base, with adenine being the most influential 5' neighbor resulting in a separate cluster. In terms of the transition parameter estimates, the CXG context has lower (higher) rCT (rAG) parameter estimates than both GXG and TXG, which explains why only GXG and TXG are clustered together. Apart from a small difference in the rCG parameter estimates, both contexts are very similar in their parameter estimates. The same goes for the AXT and CXG contexts, which only differ in the rCG parameter estimates. However, the cluster containing both GXG and TXG also contains the GXA and AXC contexts, meaning that this cluster (like all clusters determined) does not contain all the contexts with either identical 5' or 3' neighboring bases, i.e. the cluster containing GXG and TXG does not contain the AXG and CXG contexts. The GXA context differs from the GXG and TXG contexts in its parameter estimates for rCT and rAC, and a small difference for rAT. The transversion estimates of the AXC context yield no drastically differing observations when compared to those of the other three contexts in the cluster. The difference seems to lie in the transition parameters, where the AXC context is observed to have decreased rCT parameter estimates compared to the other contexts in the cluster.
One cluster left for discussion is the one containing the CXA, CXC, GXC, GXT and TXC contexts. Different from those sites with guanine as the 3' neighbor, those sites with cytosine as the 3' neighbor are clustered closer to one another, with CXC, GXC and TXC being part of the same cluster and thus only AXC being part of another cluster. In other words, as is the case when the 3' neighbor is guanine, those sites with adenine as their 5' neighbor are positioned away from the other occurrences with the same 3' neighbor. Apart from the rCG parameter estimates, the different contexts show only small differences in the parameter estimates. The CXA context has lower rCG parameter estimates than the other contexts in the cluster, which might explain why CXA is the last context to be added to the cluster in the graph-based reduction approach.
The Nuclear SSU rRNA dataset
The likelihood-based reduction approach: results
Given the larger increase in model fit brought about by the graph-based reduction approach for the Ancestral Repeats dataset, we have opted to test this method on a previously analyzed nuclear small subunit ribosomal RNA dataset [12]. As this dataset is much smaller than the Ancestral Repeats dataset, calculation of the necessary log Bayes Factors is much faster and does not require applying our split calculation approach for the thermodynamic integration method. Instead, we have used a larger number of chain updates (Q = 1000) while increasing or decreasing β by 0.001 throughout the whole integration interval.
Stepwise context reduction for the nuclear SSU rRNA dataset using the likelihood-based approach.
Model | Contexts | Annealing | Melting | log BF |
---|---|---|---|---|
GTR16C | 16 (96) | [-21.25; -15.74] | [-19.29; -14.31] | -17.65 |
GTR15C | 15 (90) | [-17.17; -13.45] | [-14.19; -10.30] | -13.78 |
GTR14C | 14 (84) | [-14.05; -10.21] | [-10.09; -5.13] | -9.87 |
GTR13C | 13 (78) | [-11.07; -7.85] | [-6.80; -3.42] | -7.28 |
GTR12C | 12 (72) | [-2.61; 1.25] | [-0.71; 3.31] | 0.31 |
GTR11C | 11 (66) | [-0.11; 3.55] | [0.62; 3.77] | 1.96 |
GTR10C | 10 (60) | [-2.33; 1.28] | [8.76; 13.06] | 5.19 |
GTR9C | 9 (54) | [6.94; 10.27] | [9.03; 13.94] | 10.05 |
GTR8C | 8 (48) | [9.54; 12.82] | [12.12; 16.21] | 12.67 |
GTR7C | 7 (42) | [12.80; 16.45] | [18.26; 22.96] | 17.62 |
GTR6C | 6 (36) | [13.75; 16.89] | [21.71; 26.13] | 19.62 |
GTR5C | 5 (30) | [15.87; 18.89] | [17.86; 22.19] | 18.70 |
GTR4C | 4 (24) | [13.03; 16.88] | [17.38; 20.71] | 17.00 |
GTR3C | 3 (18) | [9.43; 12.63] | [12.61; 15.66] | 12.58 |
GTR2C | 2 (12) | [11.69; 15.19] | [12.84; 16.58] | 14.08 |
GTR | 1 (6) | - | - | 0 |
The extended likelihood-based reduction approach: results
Because the nuclear SSU rRNA dataset is relatively small, it is feasible to re-estimate the evolutionary parameters after each merge of contexts or clusters. This allows for a more accurate calculation of the posterior variances for each cluster of contexts and may result in a different context-dependent model. We call this approach the extended likelihood-based reduction approach and compare its results to the regular likelihood-based reduction approach. Note that re-estimating a posterior variance would take over four days of computation time in the Ancestral Repeats dataset, which in turn would lead to over sixty days of computation time in total until all Bayes Factor calculations can be started.
Stepwise context reduction for the nuclear SSU rRNA dataset using the extended likelihood-based approach.
Model | Contexts | Annealing | Melting | log BF |
---|---|---|---|---|
GTR16C | 16 (96) | [-21.25; -15.74] | [-19.29; -14.31] | -17.65 |
GTR15C | 15 (90) | [-17.17; -13.45] | [-14.19; -10.30] | -13.78 |
GTR14C | 14 (84) | [-14.05; -10.21] | [-10.09; -5.13] | -9.87 |
GTR13C | 13 (78) | [-9.48; -6.19] | [-7.70; -3.72] | -6.77 |
GTR12C | 12 (72) | [-6.99; -3.70] | [-3.84; -0.05] | -3.62 |
GTR11C | 11 (66) | [-0.60; 2.92] | [2.97; 7.62] | 3.23 |
GTR10C | 10 (60) | [4.85; 8.77] | [6.62; 11.95] | 8.05 |
GTR9C | 9 (54) | [9.05; 12.46] | [8.55; 13.02] | 10.77 |
GTR8C | 8 (48) | [8.07; 11.26] | [8.68; 12.44] | 10.11 |
GTR7C | 7 (42) | [15.82; 19.60] | [15.09; 21.19] | 17.93 |
GTR6C | 6 (36) | [13.75; 16.89] | [21.71; 26.13] | 19.62 |
GTR5C | 5 (30) | [15.87; 18.89] | [17.86; 22.19] | 18.70 |
GTR4C | 4 (24) | [14.10; 17.69] | [14.30; 18.90] | 16.25 |
GTR3C | 3 (18) | [11.20; 14.99] | [15.22; 18.24] | 14.91 |
GTR2C | 2 (12) | [8.37; 11.57] | [13.14; 17.04] | 12.53 |
GTR | 1 (6) | - | - | 0 |
The graph-based reduction approach: results
Stepwise context reduction for the nuclear SSU rRNA dataset using the graph-based approach.
Model | Contexts | Annealing | Melting | log BF |
---|---|---|---|---|
GTR16C | 16 (96) | [-21.25; -15.74] | [-19.29; -14.31] | -17.65 |
GTR15C | 15 (90) | [-17.17; -13.45] | [-14.19; -10.30] | -13.78 |
GTR14C | 14 (84) | [-14.05; -10.21] | [-10.09; -5.13] | -9.87 |
GTR13C | 13 (78) | [-7.29; -4.07] | [-8.00; -3.25] | -5.65 |
GTR12C | 12 (72) | [-2.61; 1.25] | [-0.71; 3.31] | 0.31 |
GTR11C | 11 (66) | [1.75; 5.55] | [6.05; 9.25] | 5.65 |
GTR10C | 10 (60) | [3.50; 7.11] | [5.53; 10.37] | 6.63 |
GTR9C | 9 (54) | [2.79; 6.32] | [8.24; 12.51] | 7.47 |
GTR8C | 8 (48) | [8.43; 12.07] | [10.37; 13.48] | 11.09 |
GTR7C | 7 (42) | [4.21; 7.25] | [9.53; 13.04] | 8.51 |
GTR6C | 6 (36) | [11.71; 14.99] | [12.83; 17.55] | 14.27 |
GTR5C | 5 (30) | [8.97; 12.70] | [10.10; 14.86] | 11.66 |
GTR4C | 4 (24) | [11.44; 15.02] | [12.18; 16.35] | 13.75 |
GTR3C | 3 (18) | [15.30; 17.92] | [14.86; 18.11] | 16.55 |
GTR2C | 2 (12) | [-1.61; 2.74] | [1.04; 5.31] | 1.87 |
GTR | 1 (6) | - | - | 0 |
Interpretation of the optimal model
The optimal model for the nuclear SSU rRNA dataset consists of six clusters and has 36 parameters. The reasons for this specific clustering scenario can be identified by considering the parameter estimates for the 96 parameters of the model, as reported in earlier work [12]. The fact that there is support for the presence of CpG effects in this dataset only leads to the clustering of contexts AXG and GXG while TXG is clustered with TXC and CXG with GXC. The TXG context has higher estimates for the rGT parameter and its substitution behavior bears more resemblance to that of TXC. The CXG context has much higher rAG estimates compared to the AXG and GXG contexts, with the highest rAG estimates for the CXA and CXT contexts which are clustered together. The larger clusters are harder to explain as there are more differences between the individual parameters. For example, it can be seen that the largest cluster has more or less average estimates for all six parameters, although this is not the case for the rAT parameter where the contexts with higher estimates are clustered together with the exception of the TXC context.
Note that the increases in terms of model fit of these context-dependencies (as expressed through the log Bayes Factor) might seem less relevant in this dataset given the drastic increase brought about by assuming varying rates across sites, i.e. a log Bayes Factor of 499.10 units compared to the independent GTR model (see [12]). In other datasets (e.g. the Ancestral Repeats dataset), however, the opposite is true. Hence, a context-dependent model might also be useful for those datasets where no drastic increases in terms of model fit are brought about by assuming varying rates across sites, such as the frequently analyzed dataset of six ψη-globin pseudogenes [32] which originally appeared in the work of Miyamoto et al. [33].
Conclusion
In this work, we have introduced a parallelization of the model-switch integration method, as proposed by Lartillot and Philippe [18], to accurately calculate Bayes Factors for model comparisons on large datasets. The main advantage of our approach consists of the ability to split the calculations of the Bayes Factors over different computers, to minimize the time to yield results at the cost of only a slightly larger variation around the actual estimates. Given the increase in computation power using cluster computing during recent years, the ability to split certain calculations over different computers is a valuable aid in analyzing large datasets, such as the one studied in this work. Using thermodynamic integration with bidirectional checks, we have evaluated 28 models against the independent GTR model for the Ancestral Repeats dataset, a large dataset consisting of 10 sequences each containing 114,726 sites. As indicated by Lartillot and Philippe [18], thermodynamic integration requires tremendous amounts of CPU time.
Calculations for all the log Bayes Factors for the Ancestral Repeats dataset reported in this work were split over 20 processors, using the settings shown in Tables 2 and 3. Calculating one of these 20 integration intervals takes about 5 days on an Intel Xeon 2.4 Ghz processor. Given that bidirectional checks were performed and that 28 models were evaluated, this amounts to over 15 years of computation time that was used to obtain the log Bayes Factors and the corresponding confidence intervals for the Ancestral Repeats dataset. Given the magnitude of the improvements shown by our models, we did not have to use the most stringent settings for the thermodynamic integration method, which would obviously have increased computational demands even more.
Using this split-calculation approach, we have shown that significant improvements in terms of model fit (calculated through the use of Bayes Factors) of context-dependent models are possible, by optimizing the performance-parameter tradeoff. Indeed, standard context-dependent models tend to estimate too many parameters, reducing the amount of data present to estimate each pattern accurately. Furthermore, many parameters in such context-dependent models might be nearly equal to one another, meaning that several parameters in the model may just as well be replaced by one single parameter.
Using both our likelihood- and graph-based clustering approaches, we have shown that evolutionary patterns in the Ancestral Repeats dataset do not solely depend upon a similar identity of either the 5' or 3' neighboring base. We have shown that even CpG effects depend upon the 5' neighbor of the site under consideration and that many more substitution patterns are present in the data, as the CpG effect yields a much smaller increase in model fit than the full context-dependent model. The clustering results of our optimal context-dependent model, obtained through our graph-based reduction approach, confirm this finding. No cluster contains all four occurrences of the neighboring base combinations, conditional on either 5' or 3' neighboring base. At most, three contexts with either a similar 5' or 3' neighboring base are clustered together, i.e. CXC, GXC and TXC appear in a cluster together with CXA and GXT.
In contrast with the calculation for the Ancestral Repeats dataset, each model comparison for the nuclear SSU rRNA dataset could be performed in a single run of 5 days. Using the likelihood- and graph-based reduction approaches, we calculated all 15 reduction steps from the full context-dependent model to the independent model and found that the optimal clustering scheme contains six clusters. The likelihood-based approach yields the largest improvement in terms of model fit for this nuclear SSU rRNA dataset and also overthrows the initial conclusion that a full context-dependent model does not explain the data better than an independent model. This clearly illustrates that great care must be taken when building complex models that contain many parameters. A similar conclusion can be drawn for other context-dependent approaches (see e.g. [13, 14]) than the one used in this paper [12].
One might argue that the visualization of the different contexts on a scatter plot (see Figures 3, 6, 8 and 10) along with the credibility intervals for all the available parameters of the context-dependent model (see [12]) provide enough clues to determine an optimal clustering scenario. While certain aspects of the optimal clustering scenario may be retrieved through the use of visualization aids, many other aspects of the clustering would then depend upon subjective decisions, thereby reducing reproducibility. To avoid the need for subjective decisions and restriction to the first two principal components, we have presented two automatic approaches which we found to yield better context-dependent models in a straightforward manner.
The approaches discussed in this work can be used with different underlying evolutionary models. While we have assumed context-dependent evolution using 16 different GTR models in this work, we have assumed the equilibrium frequencies to be context-independent. In other words, we assume a stationary equilibrium distribution for the base frequencies. Such an assumption may be overly restrictive and its relaxation in a context-dependent framework may result in a larger increase in terms of model fit at the expense of increased computation times.
The computational complexity of the model selection approaches presented in this paper may be reduced by using a reversible jump MCMC (RJMCMC) approach [35]. By designing appropriate trans-dimensional jumps, flexible increases and decreases of the number of evolutionary contexts can be implemented. Analyzing the posterior distribution of the identities of the models that are required can then identify the optimal combination of contexts to be used in subsequent analyses.
Finally, the approaches discussed in this work can be applied to a wider range of problems whereby decisions on the equality of parameter values must be taken. For instance, when assuming branch- or lineage-specific evolutionary models (using the independence assumption), the number of models may initially be too large as not each branch or lineage may require a specific model differing from all other models present in the analysis.
Declarations
Acknowledgements
We would like to thank Tom Degroote for his assistance with our departmental cluster and Stijn De Smet for his assistance in using the BEgrid (Belgian Grid for Research) infrastructure. The last author acknowledges support from IAP research network grant nr. P06/03 from the Belgian government (Belgian Science Policy).
Authors’ Affiliations
References
- Goldman N, Whelan S: A novel use of equilibrium frequencies in models of sequence evolution. Mol Biol Evol. 2002, 19: 1821-1831.View ArticlePubMedGoogle Scholar
- Yang Z: Among-site rate variation and its impact on phylogenetic analyses. Trends Ecol Evol. 1996, 11: 367-372. 10.1016/0169-5347(96)10041-0.View ArticlePubMedGoogle Scholar
- Takezaki N, Gojobori T: Correct and incorrect vertebrate phylogenies obtained by the entire mitochondrial DNA sequences. Mol Biol Evol. 1999, 16: 590-601.View ArticlePubMedGoogle Scholar
- Cunningham CW, Zhu H, Hillis DM: Best-fit maximum-likelihood models for phylogenetic inference: empirical tests with known phylogenies. Evolution. 1998, 52: 978-987. 10.2307/2411230.View ArticleGoogle Scholar
- Posada D, Crandall K: Selecting models of nucleotide substitution: an application to Human Immunodeficiency Virus 1 (HIV-1). Mol Biol Evol. 2001, 18: 897-906.View ArticlePubMedGoogle Scholar
- Morton BR: Neighbouring base composition and transversion/transition bias in a comparison of rice and maize chloroplast noncoding regions. Proc Natl Acad Sci. 1995, 92: 9717-9721. 10.1073/pnas.92.21.9717.PubMed CentralView ArticlePubMedGoogle Scholar
- Morton BR: The influence of neighbouring base composition on substitutions in plant chloroplast coding sequences. Mol Biol Evol. 1997, 14: 189-194.View ArticleGoogle Scholar
- Morton BR, Clegg MT: Neighbouring base composition is strongly correlated with base substitution bias in a region of the chloroplast genome. J Mol Evol. 1995, 41: 597-603. 10.1007/BF00175818.View ArticlePubMedGoogle Scholar
- Morton BR, Oberholzer VM, Clegg MT: The influence of specific neighbouring bases on substitution bias in noncoding regions of the plant chloroplast genome. J Mol Evol. 1997, 45: 227-231. 10.1007/PL00006224.View ArticlePubMedGoogle Scholar
- Bulmer M: Neighbouring base effects on substitution rates in pseudogenes. Mol Biol Evol. 1986, 3: 322-329.PubMedGoogle Scholar
- Blake RD, Hess ST, Nicholson-Tuell J: The influence of nearest neighbours on the rate and pattern of spontaneous points mutations. J Mol Evol. 1992, 34: 189-200. 10.1007/BF00162968.View ArticlePubMedGoogle Scholar
- Baele G, Peer Van de Y, Vansteelandt S: A model-based approach to study nearest-neighbor influences reveals complex substitution patterns in non-coding sequences. Syst Biol. 2008, 57: 675-692. 10.1080/10635150802422324.View ArticlePubMedGoogle Scholar
- Siepel A, Haussler D: Phylogenetic estimation of context-dependent substitution rates by maximum likelihood. Mol Biol Evol. 2004, 21: 468-488. 10.1093/molbev/msh039.View ArticlePubMedGoogle Scholar
- Hwang DG, Green P: Bayesian Markov chain Monte Carlo sequence analysis reveals varying neutral substitution patterns in mammalian evolution. Proc Natl Acad Sci USA. 2004, 101: 13994-14001. 10.1073/pnas.0404142101.PubMed CentralView ArticlePubMedGoogle Scholar
- Steel M: Should phylogenetic models be trying to 'fit an elephant'?. Trends Genet. 2005, 21: 307-309. 10.1016/j.tig.2005.04.001.View ArticlePubMedGoogle Scholar
- Kass RE, Raftery AE: Bayes factors. J Am Stat Assoc. 1995, 90: 773-795. 10.2307/2291091.View ArticleGoogle Scholar
- Jeffreys H: Some tests of significance treated by theory of probability. Proceedings of the Cambridge Philosophical Society. 1935, 31: 203-222. 10.1017/S030500410001330X.View ArticleGoogle Scholar
- Lartillot N, Philippe H: Computing Bayes factors using thermodynamic integration. Syst Biol. 2006, 55: 195-207. 10.1080/10635150500433722.View ArticlePubMedGoogle Scholar
- Ogata Y: A Monte Carlo method for high dimensional integration. Num Math. 1989, 55: 137-157. 10.1007/BF01406511.View ArticleGoogle Scholar
- Gelman A, Meng X-L: Simulating normalizing constants: From importance sampling to bridge sampling to path sampling. Stat Sci. 1998, 13: 163-185. 10.1214/ss/1028905934.View ArticleGoogle Scholar
- Neal RM: Markov chain sampling methods for Dirichlet process mixture models. J Comput Graph Stat. 2000, 9: 249-265. 10.2307/1390653.Google Scholar
- Rodrigue N, Philippe H, Lartillot N: Assessing site-interdependent phylogenetic models of sequence evolution. Mol Biol Evol. 2006, 23: 1762-1775. 10.1093/molbev/msl041.View ArticlePubMedGoogle Scholar
- Lanave C, Preparata G, Saccone C, Serio G: A new method for calculating evolutionary substitution rates. J Mol Evol. 1984, 20: 86-93. 10.1007/BF02101990.View ArticlePubMedGoogle Scholar
- Lepage T, Bryant D, Philippe H, Lartillot N: A general comparison of relaxed molecular clock models. Mol Biol Evol. 2007, 24: 2669-2680. 10.1093/molbev/msm193.View ArticlePubMedGoogle Scholar
- Yang Z: Maximum likelihood phylogenetic estimation from DNA sequences with variable rates over sites: approximate methods. J Mol Evol. 1994, 39: 306-314. 10.1007/BF00160154.View ArticlePubMedGoogle Scholar
- Fryxell KJ, Zuckerkandl E: Cytosine deamination plays a primary role in the evolution of mammalian isochores. Mol Biol Evol. 2000, 17: 1371-1383.View ArticlePubMedGoogle Scholar
- Arndt PF, Burge CB, Hwa T: DNA sequence evolution with neighbor-dependent mutation. J Comp Biol. 2003, 10: 313-322. 10.1089/10665270360688039.View ArticleGoogle Scholar
- Arndt PF, Hwa T: Identification and measurement of neighbor-dependent nucleotide substitution processes. Bioinformatics. 2005, 21: 2322-2328. 10.1093/bioinformatics/bti376.View ArticlePubMedGoogle Scholar
- Woodcock DM, Crowther PJ, Diver WP: The majority of methylated deoxycytidines in human DNA are not in the CpG dinucleotide. Biochem Biophys Res Commun. 1987, 145: 888-894. 10.1016/0006-291X(87)91048-5.View ArticlePubMedGoogle Scholar
- Ramsahoye BH, Biniszkiewicz D, Lyko F, Clark V, Bird AP, Jaenisch R: Non-CpG methylation is prevalent in embryonic stem cells and may be mediated by DNA methyltransferase 3a. Proc Natl Acad Sci USA. 2000, 97: 5237-5242. 10.1073/pnas.97.10.5237.PubMed CentralView ArticlePubMedGoogle Scholar
- Hess ST, Blake JD, Blake RD: Wide variations in neighbor-dependent substitution rates. J Mol Biol. 1994, 236: 1022-1033. 10.1016/0022-2836(94)90009-4.View ArticlePubMedGoogle Scholar
- Yang Z: Estimating the pattern of nucleotide substitution. J Mol Evol. 1994, 39: 105-111.PubMedGoogle Scholar
- Miyamoto MM, Slighton JL, Goodman M: Phylogenetic relations of humans and African apes from DNA sequences in the ψη-globin region. Science. 1987, 238: 369-373. 10.1126/science.3116671.View ArticlePubMedGoogle Scholar
- Peeters A, Coolsaet K, Brinkmann G, Van Cleemput N, Fack V: GrInvIn in a nutshell. J Math Chem. 2008, 45: 471-477. 10.1007/s10910-008-9420-5.View ArticleGoogle Scholar
- Green PJ: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika. 1995, 82: 711-732. 10.1093/biomet/82.4.711.View ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.