Skip to main content
  • Facebook
  • Twitter
  • YouTube
  • LinkedIn
  • Google Plus
  • Other GSA Resources
    • Genetics Society of America
    • Genetics
    • Genes to Genomes: The GSA Blog
    • GSA Conferences
    • GeneticsCareers.org
  • Log in
G3: Genes | Genomes | Genetics

Main menu

  • HOME
  • ISSUES
    • Current Issue
    • Early Online
    • Archive
  • ABOUT
    • About the journal
    • Why publish with us?
    • Editorial board
    • Contact us
  • SERIES
    • Genetics of Immunity
    • Genetics of Sex
    • Genomic Prediction
    • Multiparental Populations
  • ARTICLE TYPES
    • About Article Types
    • Genome Reports
    • Meeting Reports
    • Mutant Screen Reports
    • Software and Data Resources
  • PUBLISH & REVIEW
    • Scope & publication policies
    • Submission & review process
    • Article types
    • Prepare your manuscript
    • Submit your manuscript
    • After acceptance
    • Guidelines for reviewers
  • SUBSCRIBE
    • Email alerts
    • RSS feeds
  • Other GSA Resources
    • Genetics Society of America
    • Genetics
    • Genes to Genomes: The GSA Blog
    • GSA Conferences
    • GeneticsCareers.org

User menu

Search

  • Advanced search
G3: Genes | Genomes | Genetics

Advanced Search

  • HOME
  • ISSUES
    • Current Issue
    • Early Online
    • Archive
  • ABOUT
    • About the journal
    • Why publish with us?
    • Editorial board
    • Contact us
  • SERIES
    • Genetics of Immunity
    • Genetics of Sex
    • Genomic Prediction
    • Multiparental Populations
  • ARTICLE TYPES
    • About Article Types
    • Genome Reports
    • Meeting Reports
    • Mutant Screen Reports
    • Software and Data Resources
  • PUBLISH & REVIEW
    • Scope & publication policies
    • Submission & review process
    • Article types
    • Prepare your manuscript
    • Submit your manuscript
    • After acceptance
    • Guidelines for reviewers
  • SUBSCRIBE
    • Email alerts
    • RSS feeds
Previous ArticleNext Article

rSalvador: An R Package for the Fluctuation Experiment

Qi Zheng
G3: Genes, Genomes, Genetics December 1, 2017 vol. 7 no. 12 3849-3856; https://doi.org/10.1534/g3.117.300120
Qi Zheng
Department of Epidemiology and Biostatistics, Texas A&M School of Public Health, College Station, Texas 77843
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: qzheng@sph.tamhsc.edu
  • Article
  • Figures & Data
  • Info & Metrics
Loading

Abstract

The past few years have seen a surge of novel applications of the Luria-Delbrück fluctuation assay protocol in bacterial research. Appropriate analysis of fluctuation assay data often requires computational methods that are unavailable in the popular web tool FALCOR. This paper introduces an R package named rSalvador to bring improvements to the field. The paper focuses on rSalvador’s capabilities to alleviate three kinds of problems found in recent investigations: (i) resorting to partial plating without properly accounting for the effects of partial plating; (ii) conducting attendant fitness assays without incorporating mutants’ relative fitness in subsequent data analysis; and (iii) comparing mutation rates using methods that are in general inapplicable to fluctuation assay data. In addition, the paper touches on rSalvador’s capabilities to estimate sample size and the difficulties related to parameter nonidentifiability.

  • Luria-Delbrück protocol
  • practical nonidentifiability
  • likelihood ratio test

Nearly 75 yr ago, Luria and Delbrück (1943) proposed an experimental protocol that today is known variously as the fluctuation test, the fluctuation experiment, and the fluctuation assay. This innovative experimental protocol is so far the preferred method for determining microbial mutation rates in the laboratory. Because computational methods for inferring mutation rates from fluctuation assay data seemed complicated to most biologists, for over half a century the fluctuation experiment had been an investigative tool only for mathematically minded biologists or biologists who could find adequate computational assistance. The advent of SALVADOR (Zheng 2002), a package written in the Wolfram language (Wolfram Research, Inc. 2016), induced a surge of applications of the fluctuation experiment by investigators who otherwise would not have considered the classical protocol. However, because SALVADOR runs in the proprietary Mathematica (Wolfram Research, Inc. 2016) environment, it raised a new, albeit lesser, barrier to the widespread use of the fluctuation experiment. It was Hall et al. (2009) who helped bench scientists break free from the shackles of proprietary software. Their web tool, FALCOR, enables investigators to perform basic analysis of fluctuation assay data in a way no more arduous than calculating the sample mean and sample SD. Numerous researchers, empowered by this convenient web tool, used the fluctuation experiment in tandem with DNA sequencing techniques in their research. As a result, an astonishing flood of novel applications of the fluctuation experiment followed. FALCOR was an effective catalyst for a marriage between the classical fluctuation experiment and modern DNA sequencing techniques.

With FALCOR’s popularity came a disturbing irony. As noted in a recent review (Zheng 2015b), FALCOR offers only methods that were reviewed in 2000 (Rosche and Foster 2000). Many applications require methods that either were developed after 2000 or are to be developed. Researchers who acquainted themselves with the analysis of fluctuation assay data via FALCOR were often under the impression that all fluctuation assay data could be analyzed by a standardized approach, which Hall et al. (2009) advocated. Owing to this mistaken perception, investigators in a large fraction of recent studies adopted a common method to analyze their fluctuation assay data, paying little attention to important features that distinguished their experiments. A conscientious practitioner would then be baffled when Ycart (2013) sounded a note of warning, in stark contrast to the sanguine views of Hall et al. (2009). The rhetorical question “Can estimates be trusted?”, sparked by a common mathematical assumption about cell life spans, seemed to obliterate bench scientists’ hopes for a practical way to analyze fluctuation assay data on their own. Moreover, Hamon and Ycart (2012) voiced their complaints about the extensive numerical problems that were supposedly caused by the maximum likelihood method. Besides clarifying the disquieting confusion prompted by these issues, the present article uses rSalvador 1.7 (Zheng 2017a) to guide readers in the analysis of their fluctuation assay data.

rSalvador was first released in April 2014. It was written as an R package, but the most compute-intensive parts, as in SALVADOR, were coded in the C programming language. rSalvador is not merely an R adaptation of SALVADOR, for it affords new methods developed after the last release of SALVADOR. This article describes rSalvador’s capabilities by focusing on three kinds of inadequacies commonly found in recent analyses of fluctuation assay data. The three kinds of inadequacies are: (i) resorting to partial plating without properly accounting for the effects of partial plating; (ii) conducting attendant fitness assays without accounting for mutants’ relative fitness when calculating estimates of mutation rates; and (iii) comparing mutation rates using methods that are in general inapplicable to fluctuation assay data.

Relevant Assumptions

The fluctuation experiment is conceptually simple. Although neither mutations nor mutants are directly observable, a mutant can be made visible by allowing it to form a colony on a solid culture. As a result, analysis of fluctuation assay data revolves around inferring the number of mutations from the number of mutants in a test tube. This challenging task relies critically on mathematical models that bridge the gap between mutations and mutants. Like mathematical models for any other purposes, a mathematical model for fluctuation assay data depends on simplifying assumptions. Acquiring a sound understanding of the key assumptions not only helps experimentalists to better design experiments, but also enables them to analyze their data more confidently. Major assumptions underlying common mathematical models for fluctuation assay data include the following.

  • A1. Cells (nonmutants and mutant alike) undergo unimpeded growth in a liquid culture (contained in a test tube). In other words, cells are in logarithmic phase (also known as exponential phase).

  • A2. When a cell divides, the probability is a constant p that one of the two daughter cells is a mutant. The probability is 1 − p that both daughter cells are nonmutants. Therefore, there is no possibility of a nonmutant splitting into two daughter mutants.

  • A3. Mutants grow at the same rate as nonmutants. As a consequence, the relative fitness is unity.

  • A4. Back mutation is negligible, and hence is not considered.

  • A5. Cell death is negligible, and hence is not considered. As Kendal and Frost (1988) rightly asserted, this assumption is not a problem when dealing with bacterial cells (in contrast to somatic cells). But there is an important exception. When the Luria-Delbrück protocol is used to study antibiotic-induced mutations, as in the study of Cairns et al. (2017), cells must grow in the presence of an antibiotic. The dose administered should be sufficiently low so as not to cause considerable death of nonmutants. Otherwise, owing to death of large numbers of nonmutants, unimpeded growth of antibiotic-resistant mutants will grossly inflate the mutant frequency. This caution should not be confused with the use of a lethal dose of an antibiotic after the cells are plated, as a selective agent.

  • A6. Every mutant exiting prior to plating is capable of growing into a colony after the plating process. In other words, the plating efficiency is perfect.

  • A7. Cell life span obeys the negative exponential distribution.

  • A8. The total numbers of nonmutants immediately before plating, denoted by Nt, are approximately the same across tubes within an experiment.

  • A9. Nonmutants die immediately after plating. In other words, selection after plating is so lethal that postplating mutation is negligible. Note that postplating mutation was of interest to Lang and Murray (2008), and to Ford et al. (2013).

  • A10. When a nonmutant undergoes a mutation, the resulting daughter mutant is capable of immediately manifesting the mutation’s phenotype. This assumption thus excludes the possibility of phenotypic delay, a concept that can be traced to Newcombe (1948).

  • A11. N0, the number of cells used to seed a test tube, is small enough to guarantee that the N0 seeding cells contain no mutants.

A useful mutation model yields a so-called mutant distribution, which describes the probability distribution of the number of mutants, and which usually involves a parameter customarily denoted by m, the expected number of mutations per tube. Once an accurate estimate Embedded Image of m is inferred from fluctuation assay data using an appropriate mutant distribution, the mutation rate is determined byEmbedded Image(1)For a detailed discussion of the mutation rate p, the reader is referred to Zheng (2017c).

Almost by definition, a simplifying assumption is a deviation from biological reality. One is doomed to disappointment when checking any of the above assumptions outside the context of what the fluctuation experiment aims to achieve. As the point of the fluctuation experiment is to estimate the fundamental parameter m, the validity of the assumptions (A1)–(A11) should be assessed by whether they allow acceptable estimates of m to be extracted from fluctuation assay data. Although limited research has been conducted in this regard, the assumptions seem to be less worrisome than originally thought. For example, the assumption (A7), the most contrived at first glance, was recently found to be an acceptable assumption.

A peculiar feature of all mutant distributions is a lack of explicit analytic expressions. A mutant distribution must therefore be identified by its probability generating function (PGF). If Y denotes the random number of mutants, the PGF of Y is the function Embedded Image defined by Embedded Image. rSalvador encompasses five mutation distributions. The first mutant distribution is due to Lea and Coulson (1949). This distribution depends on all the above 11 assumptions, and its PGF isEmbedded Image(2)Here, Embedded Image is strictly less than unity (Zheng 2002). But φ is assumed to be unity by convention. Strictly speaking, the Lea-Coulson mutant distribution refers to the special case where the PGF is of the form Embedded Image(3)Nádas et al. (1996) were the first to suspect that setting ∅ = 1 could have adverse effects on the estimation of m. However, in practice, ∅ > 0.999 almost always holds true. Under such a condition, the effects of ∅ are negligible. rSalvador is the only software tool that permits the user to specify a value smaller than unity for ∅, mainly for educational purposes.

The second mutant distribution resulted from an attempt to relax the assumption (A3) by Mandelbrot (1974). Because Koch (1982) made a similar attempt to allow for differential growth rates between nonmutants and mutants, the mutant distribution is usually called the Mandelbrot-Koch distribution. The following PGF is a generalization of the PGF Embedded Image

Embedded Image.(4)Here B denotes the usual beta function. The parameter w is relative fitness, that is, the ratio of the growth rate of mutants to that of nonmutants.

The third mutant distribution can be traced to Armitage (1952), who was the first to attempt to relax the assumption (A6). The resulting mutant distribution was further studied by Stewart et al. (1990). The PGF of that distribution is

Embedded Image(5)Here, ξ = Embedded Image / (1− Embedded Image). The parameter ϵ is called the plating efficiency, which denotes the portion of culture plated or the probability that a mutant forms a visible colony after the plating process.

The fourth mutant distribution is a special case of the relatively new Embedded Image distribution (Zheng 2010). The Embedded Image distribution has two parameters, A and k, and is denoted by Embedded Image The PGF of a Embedded Image variable is

Embedded Image(6)The Embedded Image distribution’s usefulness lies in its ability to relax the assumption (A8).

The last mutant distribution derives from Haldane’s mutation model (Zheng 2005). Because cell growth is synchronous in the Haldane model, cell life spans are nonrandom. This is in violation of the assumption (A7). The Haldane mutant distribution is indexed by the mutation rate p and the number of elapsed cell generations g. rSalvador includes the Haldane model mainly for educational purposes, and it relies on algorithms developed by Zheng (2007).

Classical Analysis

In most published applications of the fluctuation experiment, inference about m relied on the Lea-Coulson mutant distribution (Lea and Coulson 1949) defined by the PGF Embedded Image given in Equation (3). The Lea-Coulson distribution owes its popularity partly to the work by Ma et al. (1992). SALVADOR 1.0 (Zheng 2002) was the first publicly available software package allowing the user to calculate maximum likelihood (ML) estimates of m under the Lea-Coulson model. The web tool FALCOR (Hall et al. 2009) rendered this capability more easily accessible to bench scientists. But FALCOR does not automate the process of computing confidence intervals (C.I.s) for m. As a result, the user is forced to compute C.I.s outside FALCOR by following instructions given on FALCOR’s website.

rSalvador has a unique advantage. Since SALVADOR 2.0 (Zheng 2005), the expected Fisher information has been replaced by the observed Fisher information in all algorithms for computing point and interval estimates of m. As a consequence, all C.I.s produced by SALVADOR (or rSalvador) are based on the likelihood ratio method. Efron and Hinkley (1978) were among the first to observe that likelihood ratio C.I.s are preferable to the commonly used Wald-type C.I.s. Raue et al. (2009) referred to likelihood ratio C.I.s as finite sample C.I.s, to underscore the superiority of likelihood ratio C.I.s over Wald-type C.I.s. rSalvador (including SALVADOR) is so far the only fluctuation assay tool that advocates likelihood ratio C.I.s. One distinctive feature of the likelihood ratio C.I. for m is that it is usually asymmetric about the ML estimate of m. As an example, consider the well-known Demerec data (Demerec 1945). The ML point estimate of m is

> newton.LD(demerec.data)

[1] 10.84383

But a 95% likelihood ratio C.I. for m is

> confint.LD(demerec.data)

[1] 8.650538 13.194765

The center of this C.I. is at 10.92, not 10.84—the ML estimate of m. Unlike the Wald-type C.I.s, a likelihood ratio C.I. requires iterative computing. The user can view the iterative process by setting the option show.iter = T in the above command.

As an educational feature, rSalvador allows the user to specify an arbitrary value between 0 and 1 for the parameter φ given in Equation (2). In the Demerec experiment, N0 = 90 and Nt = 1.9 × 108 (Zheng 2002). However, if the experiment were terminated prematurely at Nt = 900, one would have φ = 1 − 90/900 = 0.9. A noticeably different estimate of m would result, as predicted by Nádas et al. (1996).

> newton.LD(demerec.data,phi = 0.9)

[1] 18.92394

The simple Lea-Coulson model relies on each of the assumptions (A1)–(A11), which may belie the model’s practical usefulness. One source of skepticism is the assumption (A7), as cell life spans do not obey the negative exponential distribution. It was this assumption that triggered the rhetorical question “Can estimates be trusted?” In a study of the Haldane model, Zheng (2007) compared the Lea-Coulson model with the Haldane model and found that the two models produced comparable estimates of mutation rates. This finding suggests that the assumption (A7) is acceptable, because the two models assume drastically different cell life distributions. A simulation study by Ycart (2013) reached essentially the same conclusion. Still, Ycart (2013) suggested using a cell life distribution derived from a particular yeast study as a universal cell life distribution. In response to Ycart’s suggestion, Gillet-Markowska et al. (2015) emphasize that “there is no universal cellular division time model as it depends on experimental conditions like the strain or the media.”

Accounting for Relative Fitness

Classical analysis of fluctuation assay data excludes the possibility of differential growth rates between mutants and nonmutants. Recognition of the importance of allowing for this possibility can be traced to Lieb (1951), who highlighted the P0 method of Luria and Delbrück (1943) for its capability to accommodate differential growth rates. Using the mutant distribution defined by the PGF in Equation (4), Zheng (2002) developed algorithms for computing ML estimates of m and w. These algorithms rely on the expected Fisher information that must be computed by truncating infinite series. Because computing infinite series could be prohibitively expensive in practice, Zheng (2005) improved these algorithms by replacing the expected Fisher information with the observed Fisher information, which not only obviated the problem of infinite series but also made possible the computation of likelihood ratio C.I.s. A comparison between Equations (32) and (46) in Zheng (2005) clarifies the distinction between the expected and the observed Fisher information. The elegant work of Efron and Hinkley (1978) provides helpful information on this topic.

However, Hamon and Ycart (2012) drew renewed attention to the Mandelbrot-Koch model by making the following observation.

Indeed, the likelihood and its derivatives can be computed by iterative algorithms: theoretically at least, the problem could be considered solved. This is not so in practice, mainly because the multiple sums that must be computed by the optimization algorithm make it quite unstable. According to the numerous tests that we have made, the ML estimates cannot be reliably computed for samples whose maximum exceeds 1000.

Such a disastrous outcome is unreproducible, as it was an artifact of the computer code of Hamon and Ycart. The improved algorithms for computing ML estimates given by Zheng (2005) had been thoroughly tested using simulated fluctuation experiments in which the maximum mutant counts far exceeded 5000. A diagnostic clue to the enigma is on p. 1258 of Hamon and Ycart (2012) below an expression for the expected Fisher information, denoted by I (α, ρ).

Fortunately the partial sums increase, so that when computing the inverse I−1(α, ρ) the sum of the first m terms yields conservative confidence intervals; yet we do not consider it satisfactory.

Unaware of the advantages of using the observed Fisher information, Hamon and Ycart (2012) still used algorithms reliant on the expected Fisher information to compute ML estimates. This then-outdated practice led to an exaggerated sense of disaster, so Hamon and Ycart recommended the generating function (GF) method as a remedy. They envisioned future experiments in which cultures would contain enormous numbers of mutants to allow the experimentalist to harness the GF method’s potential. This would imply the abandonment of the Luria-Delbrück protocol, as large numbers of mutants must be directly counted, without the aid of plating. Such views caused confusion. For example, a simulation study of the GF method led Gillet-Markowska et al. (2015) to emphasize the importance of avoiding exceedingly large mutant counts.

[T]he precision on the estimation of m (and by consequence the estimation of μ) is higher for the smallest values of m. Therefore, users should not outgrow the cultures in order to limit the number of mutants that grow on selective plates.

The exploration of the GF method by Hamon and Ycart (2012) offers valuable lessons, which I here illustrate using the experimental data given in Table 3 of Rosche and Foster (2000). Eight of the 60 mutant counts were excluded in the analysis by Hamon and Ycart (2012), but I shall use the intact data. One reason for choosing this data set is that it contains the largest mutant count ever reported—3000. At least three versions of the GF method are available: that given by Hamon and Ycart (2012) via the R code attendant to their paper, that given by the web tool bz-rates (Gillet-Markowska et al. 2015), and that given by the R package flan (Mazoyer et al. 2017). ML estimates of m and w, along with estimates produced by the three versions of the GF method, are displayed in Figure 1. Judging by the contours of the log-likelihood function, the ML method outperforms all three versions of the GF method. The large mutant count did not derail the ML method, contradicting the observation of Hamon and Ycart (2012).

Figure 1
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1

Contours of the log-likelihood function for the data given in Table 3 of Rosche and Foster (2000). The four colored dots represent estimates of m and w. The green dot indicates the ML estimates, the blue dot indicates the GF estimates via flan, the purple dot indicates the GF estimates via bz-rates, and the red dot indicates the GF estimates by an earlier implementation of the GF method.

> newton.joint.MK(cairns.foster.data)

[1] 1.3027909 0.7281044

Likelihood ratio C.I.s for m and w can be computed separately as follows.

> confint.profile.m(cairns.foster.data)

[1] 0.9855115 1.6749828

> confint.profile.w(cairns.foster.data)

[1] 0.5209636 1.0298620

The exploration of the GF method drew attention to the issue of parameter identifiability. Only recently did investigators in systems biology and related fields recognize practical identifiability as a problem distinct from the better-known problem of structural identifiability (Raue et al. 2009). Practical identifiability considers the effects of the amount and quality of data. Computational difficulties encountered with the Mandelbrot-Koch mutant distribution may also be viewed as practical nonidentifiability. The inability to estimate w in the examples given by Mazoyer et al. (2017) is indicative of practical nonidentifiability. In addition, the C.I.s that extend to zero in these examples are a symptom of the same problem. No multi-parameter mutant distribution seems to be immune to practical nonidentifiability. Angerer (2001) was perhaps the first to document computational difficulties that were due to practical nonidentifiability. In my own simulation exploration of the mutant distribution used by Lang and Murray (2008) and by Ford et al. (2013), I also found practical nonidentifiability a stubborn problem.

A motivation for studying the GF method was to improve the estimation of the fitness parameter w. Simulation suggests that it is uneconomical (in terms of sample size) to use the Luria-Delbrück protocol as a tool for measuring bacterial fitness. The traditional fitness assay (also known as the competition assay) is a more efficient tool, which has been increasingly conducted in tandem with fluctuation assays in recent studies (Scanlan et al. 2015). The Mandelbrot-Koch mutant distribution enables the investigator to incorporate information on w in the analysis of fluctuation assay data. For instance, if a fitness assay yields an estimated w of 0.73 in the above example, one obtains an estimate of m by

> newton.MK(cairns.foster.data,w = 0.73)

[1] 1.30215

In the absence of attendant fitness assays, the investigator may use joint ML estimation cautiously as a tool to obtain an estimate of m adjusted for the nuisance parameter w. In doing so, the issue of parameter identifiability should be kept in mind. While the ML approach is unsuitable for unrealistically large mutant counts, it remains the method of choice for real-world applications. An experimentalist is rarely able to count 500 mutant colonies per culture (Boe et al. 1994), let alone 5000 mutant colonies per culture. The experimentalist resorts to partial plating if a poorly designed experiment yields unwieldy mutant counts.

Accounting for Plating Efficiency

When an experimentalist plates only a portion of each culture, we refer to the actually plated proportion as the experiment’s plating efficiency, often denoted by ϵ. A culture before plating is densely populated by cells, but mutants constitute only a minute fraction of the cell population. As a result, mutants are sparsely and randomly dispersed in the culture. If 10% (i.e., Embedded Image) of a culture is plated, in general, the experimentalist does not transfer exactly 10% of the mutants onto a selective culture—the actual number of mutants transferred is a random number. Although a liquid culture resides in a three-dimensional tube, the randomness induced by partial plating is more easily understood by analogy with a slice of raisin bread, as illustrated by Figure 2.

Figure 2
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2

This diagram draws an analogy between a three-dimensional liquid culture and a slice of raisin bread, to help explain the randomness induced by partial plating. The green points, each symbolizing a mutant, are randomly dispersed in the square area. The two circles indicate two possible ways of sampling (plating) an equal portion of the square area that represents a three-dimensional liquid culture.

Partial plating is common, as it is a practical measure to circumvent overwhelmingly large mutant counts. For example, except for one experiment, all experiments reported by Luria and Delbrück (1943) had a plating efficiency smaller than unity. Their experiment 16 is perhaps the best known by biology students. In that experiment a portion of 0.08 ml was plated from each of the twenty 0.2-ml cultures. Hence, the plating efficiency was Embedded Image. The popular genetics textbook of Griffiths et al. (2000, p. 481) missed the partial plating feature of that experiment. A recent tutorial (Meneely 2016, p. 373) also mistakenly omitted the partial plating feature of the same experiment. Because 11 of the 20 cultures had no mutants, the tutorial argues by the P0 method that the mean number of mutations per culture is m ∼ 0.6.

Why is the above claim incorrect? There is a crucial distinction between the number of zero mutant counts and the number of actual null cultures—cultures having no mutants prior to plating. Suppose a culture contains one mutant prior to plating. When 40% of that culture is plated, the mutant has a 60% chance of not being counted. Thus, a zero mutant count may result from a nonnull culture. In other words, the experimentalist is uncertain about the number of actual null cultures. To account for this additional source of uncertainty, one can apply a modified P0 method, which was proposed by Stewart et al. (1990, p. 184).

> p0.LD.plating(luria.16.data,e = 0.4)

[1] 0.9786801

Hence, the mean number of mutations per culture is Embedded Image not 0.60. Luria and Delbrück reported that each culture contained 5.6 × 108 bacteria. Is this the number of cells in the plated portion or in the whole culture? To remove the ambiguity, note that Luria and Delbrück also reported an average mutant count of 28.4 mutants per culture. Because the mean number of the observed mutants in the plated portion was 11.35, the meaning of “per culture” is now clear. There must be 5.6 × 108 cells in the whole culture. That is, Nt = 5.6 × 108. Therefore, the mutation rate is p = 0.98/Nt = 1.75 × 10−9 mutations per cell division, according to Equation (1).

rSalvador relies on the mutant distribution defined by the PGF Embedded Image in Equation (5) to compute ML estimates and likelihood ratio C.I.s for the fundamental parameter m. It employs the algorithms developed by Zheng (2008). For example, an ML estimate of m for Luria and Delbrück’s experiment 16 is

> newton.LD.plating(luria.16.data,e = 0.4)

[1] 1.18636

and an LR-based 95% C.I. for m is

> confint.LD.plating(luria.16.data,e = 0.4)

[1] 0.5803079 2.0908012

Many recent investigators were unappreciative toward the effects of partial plating. For example, in the reanalysis of the experiments of Luria and Delbrück (1943), Hamon and Ycart (2012, Table 1) and Ycart (2013, Table 3) ignored the effects of partial plating. In the reanalysis of data from David (1970) and from Werngren and Hoffner (2003), Ycart and Veziris (2014) also disregarded the effects of partial plating. Moreover, unusual care may be required to determine the plating efficiency of an experiment that involves sophisticated procedures such as culture condensation. For instance, the plating efficiency in the study by Werngren and Hoffner (2003) was 0.4, as explained in Zheng (2016a, p. 357). But at first glance the plating efficiency may seem to be 0.2, as was assumed by Mazoyer et al. (2017).

Investigators who were aware of the effects of partial plating often relied on an adjustment due to Stewart et al. (1990), as this was the only approach recommended on the FALCOR web site. To apply the Stewart approach, the experimentalist first computes an initial estimate m* of m by assuming perfect plating efficiency.

> newton.LD(recent.expt)

[1] 15.36162

Because the adjustment factor is Embedded Image, an estimate of m is Embedded Image× A = 15.36 × 21.5 = 330.24. Note that this estimate of m is ∼56% of the corresponding ML estimate (593.6). The reason for this inadequacy of the Stewart approach was given by Zheng (2015b). The above discussion is limited to cases where w = 1. Gillet-Markowska et al. (2015) proposed applying the Stewart method also to cases where w ≠ 1, which is inappropriate in view of the above example. rSalvador currently is unable to deal with such cases.

Comparing Mutation Rates

Rarely did a researcher perform fluctuation experiments solely to estimate mutation rates. The researcher’s task is often to compare mutation rates across strains or under distinct experimental conditions. Early investigators applied a modified t-test to accomplish this task. This practice can lead to misleading p-values (Zheng 2015a). Recent investigators turned to the Mann-Whitney test (Ford et al. 2013), which also is inappropriate. When applying the Mann-Whitney test to fluctuation assay data, the investigator actually compares the mean numbers of mutations (m) between two experiments, not the two mutation rates that need comparing. To compare mutation rates, the investigator must take into consideration the final cell numbers Nt. It is a common feature that Nt values are consistent within each group (e.g., a strain or a particular experimental condition), but they differ noticeably between groups.

rSalvador provides two approaches to mutation rate comparison. The recommended approach is the likelihood ratio test (LRT) for fluctuation assay data, developed by Zheng (2016a). The second is purely empirical; it tests for equality of two mutation rates by checking whether two 84% C.I.s for the mutation rates overlap. If the two 84% C.I.s overlap, the test is not significant at the 5% level. Empirical evidence supporting the latter approach can be found in Zheng (2015a). Consider now the following two experiments from the study of Krašovec et al. (2014) (data were kindly provided by R. Krašovec).

expt1 = c(0, 2, 0, 3, 0, 15, 21, 0, 1, 0, 0,

4, 4, 1, 3, 2, 1, 0, 0, 0, 1, 0, 9, 0)

expt2 = c(8, 2, 4, 3, 6, 11, 2, 2, 0, 13, 6, 8)

The investigators measured the relative fitness in both experiments and obtained w1 = 1.47 and w2 = 1.45. They also measured the two Embedded Image values: Nt,1 = 2.27 × 108 and Nt,2 = 5.15 × 108. A Mann-Whitney test would yield a p-value of 0.01. But this p-value is misleading, as cells in the second population underwent about twice as many cell divisions as cells in the first population (the precise ratio is R = Nt,2 / Nt,1 = 2.29). The LRT approach gives a likelihood ratio statistic of 0.19, corresponding to an approximate p-value of 0.66.

> LRT.MK(expt1,expt2,w1 = 1.47,w2 = 1.45,R = 2.29)

[1] 0.1924875 0.6608543

Not surprisingly, the 84% C.I.s for the two mutation rates overlap.

> confint.MK(expt1,w = 1.47)/2.27e8

[1] 1.798407e–09 5.244954e–09

> confint.MK(expt2,w = 1.45)/5.15e8

[1] 2.155918e–09 6.105526e–09

Both approaches are applicable to cases where partial plating is adopted. Consider mutant count data from the first (strains H37Rv) and third (strain E 729/94) experiments in the study of Werngren and Hoffner (2003). The plating efficiencies in both experiments were 0.4. The final cell density for the H37Rv strain was 2.3 × 108 cells per ml and that for the E 729/94 strain was 1.3 × 108 cells per ml. Because cultures in both experiments were of the same size (5 ml), the ratio of the two Nt values is therefore R = 1.3/2.3. An LRT gives a p-value of 0.62.

> LRT.LD.plating(wh.data[[1]], wh.data[[3]], e1 = 0.4,

e2 = 0.4, R = 1.3/2.3)

[1] 0.2435538 0.6216511

Mazoyer et al. (2017) proposed a new method based on asymptotic normality of estimated mutation rates. The following simulation study compares statistical power of the three methods. Seven groups of 20-culture fluctuation experiments were simulated using the Lea-Coulson mutant distribution. Each group comprises 10,000 experiments. In the baseline group, Nt = 2 × 108 and the mutation rate is 1.0 × 10−8 . In the other groups, Nt = 1 × 108 and the mutation rates are k × 10−8 for Embedded Image and 3.0. In all groups, N0 = 50. Each experiment in the baseline group is compared with the corresponding experiments (i.e., experiments having the same serial number) in all other six groups. Table 1 shows statistical power of the three methods at the 5% significance level. The LRT method and the method of checking overlapping of 84% C.I.s performed almost equally well, but the asymptotic normality method was less powerful.

View this table:
  • View inline
  • View popup
Table 1 Statistical power (Lea-Coulson model)

Accounting for Variability in Nt

There was deep concern that variability in Nt among cultures could interfere with the analysis of fluctuation assay data (Rosche and Foster 2000). However, findings in a recent study (Zheng 2016b) have somewhat lessened worries about that issue. In practice, the experimentalist can use a few cultures to gauge the variability in Nt by calculating the coefficient of variation (CV) for Nt. The new study found that a CV of 0.2 or smaller has a negligible effect on the estimation of mutation rates. More importantly, larger CVs for Nt were rarely encountered in practice. Therefore, if the experimentalist is facing a more critical issue, e.g., partial plating, consideration of variability in Nt should give way to addressing the more critical issue.

Several methods to account for variability in Nt were reviewed in Zheng (2016b). For example, FALCOR refers to a method that requires the experimentalist to measure Nt for all cultures, which often is too laborious to be practical. rSalvador offers a method based on the Embedded Image distribution defined by the PGF Embedded Image in Equation (6). The Embedded Image method assumes that the expected number of mutations in a culture is proportional to the Nt of that culture. It further assumes that, conditional on a culture’s Nt, the number of mutants in that culture obeys a Lea-Coulson distribution. If the CV for Nt in an experiment is C, then, under additional mild assumptions, the unconditional distribution of the number of mutants is a Embedded Image distribution (Zheng 2016b). Here, m0 is regarded as the overall mean number of mutations per culture, and one can use rSalvador to make inferences about the parameter m0. If Embedded Imageis an estimate of m0, then an estimate of the mutation rate is Embedded Image, where Embedded Image is the mean of Nt of all cultures in the experiment.

As an example, suppose that the CV for Nt in the Demerec experiment (Demerec 1945) is 0.15. Point and interval estimates of m0 are obtained as follows.

> newton.B0(demerec.data,cv = 0.15)

[1] 11.09696

> confint.B0(demerec.data,cv = 0.15)

[1] 8.765365 13.665749

Determining Sample Size

The question of “How many cultures are needed” must have been asked by investigators countless times, but it has received little attention in the literature. Investigators often choose a sample size on the basis of a published example in which the sample size was determined intuitively. There were no guidelines for determining sample size until recently (Zheng 2017b).

In planning an experiment, the investigator may form a preliminary idea about the magnitude of m. A large m may reduce the sample size, but it may result in cultures containing more mutants than the investigator is able to count. Zheng (2017b) proposed the following η500 index to guide experimental design:

Embedded Image(7)As a rule of thumb, the experimentalist may choose η500 < 0.01. Thus, the experimentalist allows no >1% of the cultures to have >500 mutants per culture. As an illustration, assume that the mutation rate to be determined is in the neighborhood of 2 × 10−7 mutations per cell division. Assume further that the mutants have a relative fitness of 0.75. If the investigator plans to allow the final number of cells per culture to reach 2 × 107, then m would be ∼4.0 according to Equation (1). Therefore, the η500 index is

> 1 – sum(prob.MK(m = 4,w = 0.75, n = 500))

[1] 0.001243678

But if the mutants have a relative fitness of 1.2, the η500 index will be larger.

> 1 – sum(prob.MK(m = 4,w = 1.2, n = 500))

[1] 0.02221585

If the anticipated value of m meets the η500 criterion, the experimentalist determines a required sample size by choosing an appropriate ψ score. The ψ score was introduced by Zheng (2017b) as a convenient yardstick for judging the quality of C.I.s. The ψ score is defined by

Embedded Image(8)Consider a case where Embedded Image has been determined via a fitness assay. The experimentalist further believes that Embedded Image Choosing a ψ score of 0.25 would lead to an estimated sample size of 31.

> samp.size.MK(m = 4,w = 0.75,psi = 0.25)

[1] 31

If an anticipated value of m is large enough to lead to an unacceptable η500 index, the experimentalist may resort to partial plating. For example, in the case where Embedded Image and Embedded Image the η500 index is

> 1 – sum(prob.MK(m = 50,w = 1,n = 500))

[1] 0.1894214

However, by plating 10% of each culture, the experimentalist reduces η500 to

> 1 – sum(prob.LD.plating(m = 50,e = 0.1,n = 500))

[1] 0.01086645

And the corresponding sample size is

> samp.size.LD.plating(m = 50,e = 0.1)

[1] 15

Conclusions

Methodological advances made in the past 74 yr have presented the experimentalist with a bewildering array of methods to analyze fluctuation assay data. By providing concrete examples, this article helps the reader make an informed decision about which method is the most appropriate for a given experiment. All discussed methods are approximate, as the underlying mathematical models inevitably depend on simplifying assumptions. Further research will no doubt lead to more flexible methods by relaxing or dropping one or other of these assumptions, e.g., the assumptions (A1)–(A11). However, it is impossible to construct a comprehensive mathematical model by discarding all the 11 assumptions. Even if this herculean feat were accomplished someday, the resultant model would possess these two characteristics: it would still be an approximation to the infinitely complex biological reality, and it would be too cumbersome to be useful in practice. Researchers investigating a challenging biological problem should also play an active part in choosing an appropriate method to analyze their fluctuation assay data, treating the task as an existing, integral part of their research endeavor, not merely as an inescapable, tedious last leg of a long scientific journey.

Acknowledgments

I express my heartfelt appreciation to four referees and the communicating editor, whose comments helped me reshape an earlier draft of the manuscript. I am also indebted to Texas A&M High Performance Research Computing, which allowed me to spend above half a million computing hours in testing rSalvador via simulation. The open-access publishing fees for this article have been covered by the Texas A&M University Open Access to Knowledge Fund (OAKFund), supported by the University Libraries and the office of the Vice President for Research.

Footnotes

  • Communicating editor: J. Ross-Ibarra

  • Received August 5, 2017.
  • Accepted October 24, 2017.
  • Copyright © 2017 Zheng

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Literature Cited

  1. ↵
    1. Angerer W. P.
    , 2001 A note on the evaluation of fluctuation experiments. Mutat. Res. 479: 207–224.
    OpenUrlPubMed
  2. ↵
    1. Armitage P.
    , 1952 The statistical theory of bacterial populations subject to mutation. J. R. Stat. Ser. B 14: 1–44.
    OpenUrl
  3. ↵
    1. Boe L.,
    2. Tolker-Nielsen T.,
    3. Eegholm K.-M.,
    4. Spliid H.,
    5. Vrang A.
    , 1994 Fluctuation analysis of mutations to nalidixic acid resistance in Escherichia coli. J. Bacteriol. 176: 2781–2787.
    OpenUrlAbstract/FREE Full Text
  4. ↵
    1. Cairns J.,
    2. Becks L.,
    3. Jalavuori M.,
    4. Hiltunen T.
    , 2017 Sublethal streptomycin concentrations and lytic bacteriophage together promote resistance evolution. Philos. Trans. R. Soc. Lond. B Biol. Sci. 372: 20160040.
    OpenUrlAbstract/FREE Full Text
  5. ↵
    1. David H. L.
    , 1970 Probability distribution of drug-resistant mutants in unselected populations of Mycobacterium tuberculosis. Appl. Microbiol. 20: 810–814.
    OpenUrlPubMedWeb of Science
  6. ↵
    1. Demerec M.
    , 1945 Production of Staphylococcus strains resistant to various concentrations of penicillin. Proc. Natl. Acad. Sci. USA 31: 16–24.
    OpenUrlFREE Full Text
  7. ↵
    1. Efron B.,
    2. Hinkley D. V.
    , 1978 Assessing the accuracy of the maximum likelihood estimator: observed vs. expected Fisher information. Biometrika 65: 457–458.
    OpenUrlCrossRefWeb of Science
  8. ↵
    1. Ford C. B.,
    2. Shah R. R.,
    3. Meada M. K.,
    4. Gagneux S.,
    5. Murray M. B.,
    6. et al.
    , 2013 Mycobacterium tuberculosis mutation rate estimates from different lineages predict substantial differences in the emergence of drug-resistant tuberculosis. Nat. Genet. 45: 784–790.
    OpenUrlCrossRefPubMed
  9. ↵
    1. Gillet-Markowska A.,
    2. Louvel G.,
    3. Fischer G.
    , 2015 bz-rates: a web-tool to estimate mutation rates from fluctuation analysis. G3 (Bethesda) 5: 2323–2327.
    OpenUrl
  10. ↵
    1. Griffiths A. J. F.,
    2. Miller J. H.,
    3. Suzuki D. T.,
    4. Lewontin R. C.,
    5. Gelbart W. M.
    , 2000 An Introduction to Genetic Analysis, Ed. 7. W.H. Freeman and Company, New York.
  11. ↵
    1. Hall B. M.,
    2. Ma C.-X.,
    3. Liang P.,
    4. Singh K. K.
    , 2009 Fluctuation AnaLysis CalculatOR: a web tool for the determination of mutation rate using Luria-Delbrück fluctuation analysis. Bioinformatics 25: 1564–1565.
    OpenUrlCrossRefPubMedWeb of Science
  12. ↵
    1. Hamon A.,
    2. Ycart B.
    , 2012 Statistics for the Luria-Delbrück distribution. Electron. J. Stat. 6: 1251–1271.
    OpenUrlCrossRef
  13. ↵
    1. Kendal W. S.,
    2. Frost P.
    , 1988 Pitfalls and practice of Luria-Delbrück fluctuation analysis: a review. Cancer Res. 48: 1060–1065.
    OpenUrlAbstract/FREE Full Text
  14. ↵
    1. Koch A. L.
    , 1982 Mutation and growth rates from Luria-Delbrück fluctuation tests. Mutat. Res. 95: 129–143.
    OpenUrlCrossRef
  15. ↵
    1. Krašovec R.,
    2. Belavkin R. V.,
    3. Aston J. A. D.,
    4. Channon A.,
    5. Aston E.,
    6. et al.
    , 2014 Mutation rate plasticity in rifampicin resistance depends on Escherichia coli cell-cell interactions. Nat. Commun. 5: 3742.
    OpenUrlCrossRefPubMed
  16. ↵
    1. Lang G. I.,
    2. Murray A. W.
    , 2008 Estimating the per-base-pair mutation rate in the yeast Saccharomyces cerevisiae. Genetics 178: 67–82.
    OpenUrlAbstract/FREE Full Text
  17. ↵
    1. Lea E. A.,
    2. Coulson C. A.
    , 1949 The distribution of the numbers of mutants in bacterial populations. J. Genet. 49: 264–285.
    OpenUrlCrossRefPubMedWeb of Science
  18. ↵
    1. Lieb M.
    , 1951 Forward and reverse mutation in a histidine-requiring strain of Escherichia coli. Genetics 36: 460–477.
    OpenUrlFREE Full Text
  19. ↵
    1. Luria S. E.,
    2. Delbrück M.
    , 1943 Mutations of bacteria from virus sensitivity to virus resistance. Genetics 28: 491–511.
    OpenUrlFREE Full Text
  20. ↵
    1. Ma W. T.,
    2. Sandri G. vH.,
    3. Sarkar S.
    , 1992 Analysis of the Luria and Delbrück distribution using discrete convolution powers. J. Appl. Probab. 29: 255–267.
    OpenUrlCrossRefWeb of Science
  21. ↵
    1. Mandelbrot B.
    , 1974 A population birth-and-mutation process, I: explicit distributions for the number of mutants in an old culture of bacteria. J. Appl. Probab. 11: 437–444.
    OpenUrlCrossRef
  22. ↵
    1. Mazoyer A.,
    2. Drouilhet R.,
    3. Despréaux S.,
    4. Ycart B.
    , 2017 flan: an R package for inference on mutation models. R J. 9: 334–351.
    OpenUrl
  23. ↵
    1. Meneely P. M.
    , 2016 Pick your Poisson: an educational primer for Luria and Delbrück’s classic paper. Genetics 202: 371–375.
    OpenUrlAbstract/FREE Full Text
  24. ↵
    1. Nádas A.,
    2. Goncharova E. I.,
    3. Rossman T. G.
    , 1996 Mutations and infinity: improved statistical methods for estimating spontaneous rates. Environ. Mol. Mutagen. 28: 90–99.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Newcombe H. B.
    , 1948 Delayed phenotypic expression of spontaneous mutations in Escherichia coli. Genetics 33: 447–476.
    OpenUrlFREE Full Text
  26. ↵
    1. Raue A.,
    2. Kreuta C.,
    3. Maiwald T.,
    4. Bachmann J.,
    5. Schilling M.,
    6. et al.
    , 2009 Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood. Bioinformatics 25: 1923–1929.
    OpenUrlCrossRefPubMedWeb of Science
  27. ↵
    1. Rosche W. A.,
    2. Foster P. L.
    , 2000 Determining mutation rates in bacterial populations. Methods 20: 4–17.
    OpenUrlCrossRefPubMedWeb of Science
  28. ↵
    1. Scanlan P. D.,
    2. Hall A. R.,
    3. Blackshields G.,
    4. Friman V.-P.,
    5. Davis M. R. Jr.,
    6. et al.
    , 2015 Coevolution with bacteriophage drives genome-wide host evolution and constrains the acquisition of abiotic-beneficial mutations. Mol. Biol. Evol. 32: 1425–1435.
    OpenUrlCrossRefPubMed
  29. ↵
    1. Stewart F. M.,
    2. Gordon D. M.,
    3. Levin B. R.
    , 1990 Fluctuation analysis: the probability distribution of the number of mutants under different conditions. Genetics 124: 175–185.
    OpenUrlAbstract/FREE Full Text
  30. ↵
    1. Werngren J.,
    2. Hoffner S. E.
    , 2003 Drug-susceptible Mycobacterium tuberculosis Beijing genotype does not develop mutation-conferred resistance to rifampin at an elevated rate. J. Clin. Microbiol. 41: 1520–1524.
    OpenUrlAbstract/FREE Full Text
  31. ↵
    1. Wolfram Research, Inc.
    , 2016 Mathematica, Version 11.0. Wolfram Research, Inc., Champaign, IL.
  32. ↵
    1. Ycart B.
    , 2013 Fluctuation analysis: can estimates be trusted? PLoS One 8: e80958.
    OpenUrlCrossRefPubMed
  33. ↵
    1. Ycart B.,
    2. Veziris N.
    , 2014 Unbiased estimation of mutation rates under fluctuating final counts. PLoS One 9: e101434.
    OpenUrlCrossRefPubMed
  34. ↵
    1. Zheng Q.
    , 2002 Statistical and algorithmic methods for fluctuation analysis with SALVADOR as an implementation. Math. Biosci. 176: 237–252.
    OpenUrlCrossRefPubMedWeb of Science
  35. ↵
    1. Zheng Q.
    , 2005 New algorithms for Luria-Delbrück fluctuation analysis. Math. Biosci. 196: 198–214.
    OpenUrlCrossRefPubMedWeb of Science
  36. ↵
    1. Zheng Q.
    , 2007 On Haldane’s formulation of Luria and Delbrück’s mutation model. Math. Biosci. 209: 500–513.
    OpenUrlCrossRefPubMed
  37. ↵
    1. Zheng Q.
    , 2008 A note on plating efficiency in fluctuation experiments. Math. Biosci. 216: 150–153.
    OpenUrlCrossRefPubMed
  38. ↵
    1. Zheng Q.
    , 2010 A new discrete distribution induced by the Luria-Delbrück mutation model. Statistics 44: 529–540.
    OpenUrl
  39. ↵
    1. Zheng Q.
    , 2015a Methods for comparing mutation rates using fluctuation assay data. Mutat. Res. Fundam. Mol. Mech. Mutagen. 777: 20–22.
    OpenUrl
  40. ↵
    1. Zheng Q.
    , 2015b A new practical guide to the Luria-Delbrück protocol. Mutat. Res. Fundam. Mol. Mech. Mutagen. 781: 7–13.
    OpenUrl
  41. ↵
    1. Zheng Q.
    , 2016a Comparing mutation rates under the Luria-Delbrück protocol. Genetica 144: 351–359.
    OpenUrlCrossRef
  42. ↵
    1. Zheng Q.
    , 2016b A second look at the final number of cells in a fluctuation experiment. J. Theor. Biol. 401: 54–63.
    OpenUrl
  43. ↵
    1. Zheng Q.
    , 2017a rSalvador: an R tool for the Luria-Delbrück fluctuation assay. Available at: http://eeeeeric.github.io/rSalvador. Accessed: November 11, 2017.
  44. ↵
    1. Zheng Q.
    , 2017b Sample size determination for the fluctuation experiment. Mutat. Res. Fundam. Mol. Mech. Mutagen. 795: 10–14.
    OpenUrl
  45. ↵
    1. Zheng Q.
    , 2017c Toward a unique definition of the mutation rate. Bull. Math. Biol. 79: 683–692.
    OpenUrl
View Abstract
Previous ArticleNext Article
Back to top

PUBLICATION INFORMATION

Volume 7 Issue 12, December 2017

G3: Genes|Genomes|Genetics: 7 (12)

ARTICLE CLASSIFICATION

Software and Data Resources
View this article with LENS
Email

Thank you for sharing this G3: Genes | Genomes | Genetics article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
rSalvador: An R Package for the Fluctuation Experiment
(Your Name) has forwarded a page to you from G3: Genes | Genomes | Genetics
(Your Name) thought you would be interested in this article in G3: Genes | Genomes | Genetics.
Print
Alerts
Enter your email below to set up alert notifications for new article, or to manage your existing alerts.
SIGN UP OR SIGN IN WITH YOUR EMAIL
View PDF
Share

rSalvador: An R Package for the Fluctuation Experiment

Qi Zheng
G3: Genes, Genomes, Genetics December 1, 2017 vol. 7 no. 12 3849-3856; https://doi.org/10.1534/g3.117.300120
Qi Zheng
Department of Epidemiology and Biostatistics, Texas A&M School of Public Health, College Station, Texas 77843
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: qzheng@sph.tamhsc.edu
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation

rSalvador: An R Package for the Fluctuation Experiment

Qi Zheng
G3: Genes, Genomes, Genetics December 1, 2017 vol. 7 no. 12 3849-3856; https://doi.org/10.1534/g3.117.300120
Qi Zheng
Department of Epidemiology and Biostatistics, Texas A&M School of Public Health, College Station, Texas 77843
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: qzheng@sph.tamhsc.edu

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Related Articles

Cited By

More in this TOC Section

  • pSBVB: A Versatile Simulation Tool To Evaluate Genomic Selection in Polyploid Species
  • polyRAD: Genotype Calling with Uncertainty from Sequencing Data in Polyploids and Diploids
  • OCMA: Fast, Memory-Efficient Factorization of Prohibitively Large Relationship Matrices
Show more Software and Data Resources
  • Top
  • Article
    • Abstract
    • Relevant Assumptions
    • Classical Analysis
    • Accounting for Relative Fitness
    • Accounting for Plating Efficiency
    • Comparing Mutation Rates
    • Accounting for Variability in Nt
    • Determining Sample Size
    • Acknowledgments
    • Footnotes
    • Literature Cited
  • Figures & Data
  • Info & Metrics

GSA

The Genetics Society of America (GSA), founded in 1931, is the professional membership organization for scientific researchers and educators in the field of genetics. Our members work to advance knowledge in the basic mechanisms of inheritance, from the molecular to the population level.

Online ISSN: 2160-1836

  • For Authors
  • For Reviewers
  • For Advertisers
  • Submit a Manuscript
  • Editorial Board
  • Press Releases

SPPA Logo

GET CONNECTED

RSS  Subscribe with RSS.

email  Subscribe via email. Sign up to receive alert notifications of new articles.

  • Facebook
  • Twitter
  • YouTube
  • LinkedIn
  • Google Plus

Copyright © 2019 by the Genetics Society of America

  • About G3
  • Terms of use
  • Permissions
  • Contact us
  • International access