MG-RAST
MG-RAST is an open-source web application server that suggests automatic phylogenetic and functional analysis of metagenomes.[1] It is also one of the biggest repositories for metagenomic data. The name is an abbreviation of Metagenomic Rapid Annotations using Subsystems Technology. The pipeline automatically produces functional assignments to the sequences that belong to the metagenome by performing sequence comparisons to databases in both nucleotide and amino-acid levels. The applications supply phylogenetic and functional assignments of the metagenome being analysed, as well as tools for comparing different metagenomes. It also provides a RESTful API for programmatic access.
| Original author(s) | Argonne National Laboratory, University of Chicago, San Diego State University |
|---|---|
| Developer(s) | F. Meyer, D. Paarmann, M. D'Souza, R. Olson, E.M. Glass, M. Kubal, T. Paczian, A. Rodriguez, R. Stevens, A. Wilke, J. Wilkening, R.A. Edwards |
| Initial release | 2008 |
| Stable release | 4.0
/ 15 November 2016 |
| Type | Bioinformatics |
| Website | http://metagenomics.anl.gov/ |
The server was created and maintained by Argonne National Laboratory from the University of Chicago. In December 29 of 2016, the system had analyzed 60 terabase-pairs of data from more than 150,000 data sets. Among the analyzed data sets, more than 23,000 are available to the public.
Currently, the computational resources are provided by the DOE Magellan cloud at Argonne National Laboratory, Amazon EC2 Web services, and a number of traditional clusters.
Background
MG-RAST has been developed in an effort to have a free, public resource for the analysis and the storage of metagenome sequence data. The service removes one of the primary bottlenecks in metagenome analysis: the availability of high-performance computing for annotating data.[2]
Metagenomic and metatranscriptomic studies involve the processing of large datasets, and therefore they can require computationally expensive analysis. Nowadays, scientists are able to generate such volumes of data because, in recent years, the sequencing costs have reduced dramatically. This fact has shifted the limiting factor to the computing costs:for instance, a recent study of the University of Maryland, estimated a cost of more than $5 million per terabase using their CLOVR metagenome analysis pipeline.[3] As the size and number of sequence datasets continue to increase, costs related to their analysis will continue to rise.
Additionally, MG-RAST also works as a repository tool for metagenomic data. Metadata collection and interpretation is vital for genomic and metagenomic studies, and challenges in this regard include the exchange, curation, and distribution of this information. The MG-RAST system has been an early adopter of the minimal checklist standards and the expanded biome-specific environmental packages devised by the Genomics Standards Consortium, and provides an easy-to-use uploader for metadata capture at the time of data submission.[4]
Pipeline for metagenomic data analysis
The MG-RAST application offers automated quality control, annotation, comparative analysis and archiving service of metagenomic and amplicon sequences using a combination of several bioinformatics tools. The application was built to analyze metagenomic data, but it also supports amplicon (16S, 18S, and ITS) sequences and metatranscriptome (RNA-seq) sequences processing. Presently, MG-RAST is not capable of predicting coding regions from eukaryotes and therefore it is of limited use for eukaryotic metagenomes analysis.[5]
The pipeline of MG-RAST can be divided into five stages:
Data hygiene
Includes steps for quality control and artifacts removal. Firstly, low-quality regions are trimmed using SolexaQA and reads showing inappropriate lengths are removed. A dereplication step is included in the case of metagenome and metatranscriptome datasets processing. Subsequently, DRISEE (Duplicate Read Inferred Sequencing Error Estimation) is used to assess the sample sequencing error based on Artificial Duplicate Reads (ADRs) measuring. And finally, the pipeline offers the possibility of screening the reads using Bowtie aligner and removing the reads showing matches close to model organisms genomes (including fly, mouse, cow and human).
Feature extraction
MG-RAST identifies gene sequences by using a machine learning approach: FragGeneScan. Ribosomal RNA sequences are identified through an initial BLAT search against a reduced version of SILVA database.
Feature annotation
In order to identify the putative functions and annotation of the genes, MG-RAST builds clusters of proteins at 90% identity level using the UCLUST implementation in QIIME. The longest sequence of each cluster will be selected for a similarity analysis. The similarity analysis is computed through sBLAT (in which BLAT algorithm is parallelized using OpenMP). The search is computed against a protein database derived from the M5nr, which provides nonredundant integration of sequences from GenBank, SEED, IMG, UniProt, KEGG and eggNOGs databases.[6]
The reads associated to rRNA sequences are clustered at 97% identity. The longest sequence of each cluster is picked as representative and will be used for a BLAT search against the M5rna database, which integrates SILVA, Greengenes and RDP.
Profile generation
The data is integrated into a number of data products. The most important ones are the abundance profiles, which represent a pivoted and aggregated version of the similarity files.
Data loading
Finally, the obtained abundance profiles are loaded into the respective databases.
Detailed steps of the MG-RAST pipeline
| MG-RAST Pipeline | Description |
|---|---|
| qc_stats | Generate quality control statistics |
| preprocess | Preprocessing, to trim low-quality regions from FASTQ data |
| dereplication | Dereplication for shotgun metagenome data by using k-mer approach |
| screen | Removing reads that are near-exact matches to the genomes of model organisms (fly, mouse, cow and human) |
| rna detection | BLAT search against a reduced RNA database, to identifies ribosomal RNA |
| rna clustering | rRNA-similar reads are then clustered at 97% identity |
| rna sims blat | BLAT similarity search for the longest cluster representative against the M5rna database |
| genecalling | A machine learning approach, FragGeneScan, to predict coding regions in DNA sequences |
| aa filtering | Filter proteins |
| aa clustering | Cluster proteins at 90% identity level using uclust |
| aa sims blat | BLAT similarity analysis to identify protein |
| aa sims annotation | Sequence similarity against protein database from the M5nr |
| rna sims annotation | Sequence similarity against RNA database from the M5rna |
| index sim seq | Index sequence similarity to data sources |
| md5 annotation summary | Generate summary report md5 annotation, function annotation, organism annotation, LCAa annotation, ontology annotation and source annotation |
| function annotation summary | Generate summary report md5 annotation, function annotation, organism annotation, LCAa annotation, ontology annotation and source annotation |
| organism annotation summary | Generate summary report md5 annotation, function annotation, organism annotation, LCAa annotation, ontology annotation and source annotation |
| lca annotation summary | Generate summary report md5 annotation, function annotation, organism annotation, LCAa annotation, ontology annotation and source annotation |
| ontology annotation summary | Generate summary report md5 annotation, function annotation, organism annotation, LCAa annotation, ontology annotation and source annotation |
| source annotation summary | Generate summary report md5 annotation, function annotation, organism annotation, LCAa annotation, ontology annotation and source annotation |
| md5 summary load | Load summary report to the project |
| function summary load | Load summary report to the project |
| organism summary load | Load summary report to the project |
| lca summary load | Load summary report to the project |
| ontology summary load | Load summary report to the project |
| done stage | |
| notify job completion | Send notification to user via email |
MG-RAST utilities
Besides metagenome analysis, MG-RAST can also be used for data discovery. The visualization or comparison of metagenomes profiles and data sets can be implemented in a wide variety of modes; the web interface allows selecting data based on criteria like composition, sequences quality, functionality or sample type and offers several ways to compute statistical inferences and ecological analyses. The profiles for the metagenomes can be visualized and compared by using barcharts, trees, spreadsheet-like tables, heatmaps, PCoA, rarefaction plots, circular recruitment plot, and KEGG maps.
See also
References
- Meyer, F; Paarmann, D; D'Souza, M; Olson, R; Glass, EM; Kubal, M; Paczian, T; Rodriguez, A; Stevens, R; Wilke, A; Wilkening, J; Edwards, RA (2008). "The metagenomics RAST server – a public resource for the automatic phylogenetic and functional analysis of metagenomes". BMC Bioinformatics. 9 (1): 386. doi:10.1186/1471-2105-9-386. ISSN 1471-2105. PMC 2563014. PMID 18803844.
- Meyer, F.; Paarmann, D.; D'Souza, M.; Olson, R.; Glass, EM; Kubal, M.; Paczian, T.; Rodriguez, A.; Stevens, R. (2008-01-01). "The metagenomics RAST server – a public resource for the automatic phylogenetic and functional analysis of metagenomes". BMC Bioinformatics. 9: 386. doi:10.1186/1471-2105-9-386. ISSN 1471-2105. PMC 2563014. PMID 18803844.
- Angiuoli, Samuel V.; Matalka, Malcolm; Gussman, Aaron; Galens, Kevin; Vangala, Mahesh; Riley, David R.; Arze, Cesar; White, James R.; White, Owen (2011-01-01). "CloVR: A virtual machine for automated and portable sequence analysis from the desktop using cloud computing". BMC Bioinformatics. 12: 356. doi:10.1186/1471-2105-12-356. ISSN 1471-2105. PMC 3228541. PMID 21878105.
- Field, Dawn; Amaral-Zettler, Linda; Cochrane, Guy; Cole, James R.; Dawyndt, Peter; Garrity, George M.; Gilbert, Jack; Glöckner, Frank Oliver; Hirschman, Lynette (2011-06-21). "The Genomic Standards Consortium". PLOS Biology. 9 (6): e1001088. doi:10.1371/journal.pbio.1001088. ISSN 1545-7885. PMC 3119656. PMID 21713030.
- Keegan, Kevin P.; Glass, Elizabeth M.; Meyer, Folker (2016-01-01). MG-RAST, a Metagenomics Service for Analysis of Microbial Community Structure and Function. Methods in Molecular Biology. Vol. 1399. pp. 207–233. doi:10.1007/978-1-4939-3369-3_13. ISBN 978-1-4939-3367-9. ISSN 1940-6029. PMID 26791506.
- Wilke, Andreas; Harrison, Travis; Wilkening, Jared; Field, Dawn; Glass, Elizabeth M.; Kyrpides, Nikos; Mavrommatis, Konstantinos; Meyer, Folker (2012-01-01). "The M5nr: a novel non-redundant database containing protein sequences and annotations from multiple sources and associated tools". BMC Bioinformatics. 13: 141. doi:10.1186/1471-2105-13-141. ISSN 1471-2105. PMC 3410781. PMID 22720753.