SEARCH

SEARCH BY CITATION

These days, more and more scientists are diving into genome sequencing projects, urged by fast and cheap next-generation sequencing technologies. Only to discover that they are quickly drowning in an unfathomable sea of sequence data and gasping for help from experts to make biological sense of this ensuing disaster. Bioinformaticians and genome annotators to the rescue!

Microbial genome annotation involves primarily identifying the genes (or actually the open reading frames: ORFs) encrypted in the DNA sequence and deducing functionality of the encoded protein and RNA products (Fig. 1). First, a gene finder such as Glimmer (Delcher et al., 1999) or GeneMark (Lukashin and Borodovsky, 1998) is applied to the genome DNA sequence, producing a set of predicted protein-coding genes. These programs are quite accurate, though not perfect. The next step is to take the set of predictions and search for hits against one or more protein and/or protein domain databases using blast (Altschul et al., 1997), HMMer (Eddy, 1998) or other programs. For each gene that has a significant match, the blast output together with the annotation of the hit can be used to assign a name and function to the protein. The accuracy of this step depends not only on the annotation software, but also on the quality of the annotations already in the reference database.

image

Figure 1. A generalised flow chart of genome annotation. Statistical gene prediction: use of methods like GeneMark or Glimmer to predict protein-coding genes. General database search: searching sequence databases (typically, NCBI NR) for sequence similarity, usually using blast. Specialized database search: searching domain databases (such as Pfam, SMART and CDD), for conserved domains, genome-oriented databases (such as COGs), for identification of orthologous relationship and refined functional prediction, metabolic databases (such as KEGG) for metabolic pathway reconstruction and other database searches. Prediction of structural features: prediction of signal peptide, transmembrane segments, coiled domain and other features in putative protein functions.

Download figure to PowerPoint

Genome sequences deposited in NCBI/GenBank, EMBL and DDBJ databases (which mirror each other) are annotated by the submitting groups, who each use their own methods, criteria and thoroughness. This leads to a large diversity in annotation completeness and accuracy. Many of the first genomes published had very limited or no functional annotation, simply because there was very little genomic information in these reference databases to compare with. Most public genome annotation remains static for years, and many annotations have never been changed since their initial publication. Over the years, annotation updates may have been maintained by the submitters, but they are generally only stored in local databases such as GenProtEC/EcoGene for Escherichia coli K12 (Rudd, 2000), Genolist/Bactilist for Bacillus subtilis 168 (Lechat et al., 2008) and SGD for Saccharomyces cerevisiae (Christie et al., 2004).

Since gene functional annotation relies heavily on sequence similarity searching techniques with protein sequence databases, automatically annotated entries based on blast hits to NCBI databases can quickly become outdated. In the mean time, downstream sciences, such as comparative genomics, proteomics, transcriptomics and metabolomics, have rapidly increased our knowledge of many gene products. It is critical therefore, that genome annotations are frequently updated if the information they contain is to remain accurate, relevant and useful.

Re-annotation

  1. Top of page
  2. Re-annotation
  3. Standardized (re)-annotation databases
  4. (Re)-annotation pipelines
  5. Comparison of automatic annotation pipelines
  6. Future
  7. Acknowledgements
  8. References

Re-annotation is defined as the process of updating a previously annotated genome. Automated annotation pipelines combine many different algorithms for gene calling and protein function analysis. In some cases this is followed by manual expert curation, albeit less and less these days, which involves including experimental evidence, and using more sophisticated bioinformatics analysis, such as operon predictions, comparative genome analysis, regulatory motifs prediction, metabolic pathway reconstruction and a lot of common (biochemical) sense. Automated methods save time and resources, but will not incorporate the maximum information available from expert curators, leading to incomplete or even false designations. By contrast, manual annotation is costly and time-consuming. However, manual re-annotation of genomes can significantly reduce the propagation of annotation errors and thus reduce the time spent on flawed research. Hence, there is a need for a research community-wide review and regular update of genome interpretations.

Re-annotations can be published in literature or made available on websites. Examples of published re-annotated genomes are unfortunately rare compared with the rapidly increasing number of sequenced genomes. A first overview of re-annotated genomes was made by (Ouzounis and Karp, 2002). In Table 1 we list some more recently re-annotated microbial genomes. In the latest cases, next-generation technologies have been used for re-sequencing of the original strain prior to re-annotation. Exemplary is the re-sequencing and re-annotation of B. subtilis 168 (Barbe et al., 2009), published 12 years after the original genome paper (Kunst et al., 1997). About 2000 sequence differences were revealed, mainly single nucleotide polymorphisms (SNPs), allowing correction of some frameshifts and variation of amino acid residues prior to re-annotation (Table 1).

Table 1.  Selection of re-annotated microbial genomes.
GenomeRe-sequencingDeleted genesNew genesCorrected genesbOriginal publicationPublication
  • a.

    Includes new pseudogenes.

  • b.

    Includes corrected pseudogenes, but not genes with SNPs leading to only amino acid changes.

Eukaryotes      
 Saccharomyces cerevisiaeNo3703461996Wood et al. (2001)
 Aspergillus nidulansNo 6404942005Wortman et al. (2009)
Prokaryotes      
 Bacillus subtilis 168454 pyro, Solexa 171a3261997Barbe et al. (2009)
 Campylobacter jejuni NCTC11168No   2000Gundogdu et al. (2007)
 Escherichia coli CFT073No6082994352002Luo et al. (2009)
 Mycobacterium tuberculosis H37RvNo1082601998Camus et al. (2002)
 Zymomonas mobilis ZM4454 pyro27148a5392005Yang et al. (2009)

Standardized (re)-annotation databases

  1. Top of page
  2. Re-annotation
  3. Standardized (re)-annotation databases
  4. (Re)-annotation pipelines
  5. Comparison of automatic annotation pipelines
  6. Future
  7. Acknowledgements
  8. References

Many (re)annotation databases exist (see Table 2 for an overview), of which a few are general: DDBJ, EMBL, Pedant and NCBI GenBank. The ERGO resource is the only commercial database. Some of these databases contain manually curated and standardized gene functions (e.g. ERGO, RefSeq and Genome Reviews). Many of these databases contain gene functions compiled from various sources (e.g. GIB, GOLD, CMR, Genome Reviews, IMG, RefSeq, the SEED and ERGO).

Table 2.  Genome (re-)annotation databases.
DatabaseOrganizationDescriptionAccess/distributionReference
NCBI GenbankNational Institutes of Health, USAAn annotated collection of all publicly available DNA sequenceshttp://www.ncbi.nlm.nih.gov/GenbankBenson et al. (2009)
DDBJDDBJ (DNA Data Bank of Japan)General nucleotide databasehttp://www.ddbj.nig.ac.jp/None
EMBLEMBL-EBINucleotide sequence databasehttp://www.ebi.ac.uk/embl/None
Entrez Genome ProjectNational Institutes of Health, USACollection of complete and incomplete genome sequenceshttp://www.ncbi.nlm.nih.gov/sites/entrez?db=genomeprjNone
ERGOIntegrated Genomics, USAA systems-biology informatics toolkit for comparative genomicshttp://www.integratedgenomics.com/ergo.html Commercial licenseOverbeek et al. (2003)
Genome ReviewsEMBL-EBIUp-to-date, standardised and comprehensively annotated complete genomeshttp://www.ebi.ac.uk/GenomeReviews/Sterk et al. (2006)
RefSeqNational Institutes of Health, USAA curated non-redundant sequence databasehttp://www.ncbi.nih.gov/RefSeq/Pruitt et al. (2009)
The SEEDFellowship for integration of genomes (FIG)Subsystems approach to genome annotationhttp://www.theseed.org/wiki/index.php/Main_PageOverbeek et al. (2005)
IMGDOE Joint Genome Institute, USAIntegrated microbial genomes databasehttp://img.jgi.doe.govMarkowitz et al. (2006); Markowitz et al. (2010)
Microbes OnlineVirtual Institute for Microbial Stress and SurvivalAn integrated portal for comparative and functional genomicshttp://www.microbesonline.org/Dehal et al. (2010)
CMRJ. Craig Venter Institute (JCVI)Comprehensive Microbial Resource: display information on all of the publicly available, complete prokaryotic genomeshttp://cmr.jcvi.org/tigr-scripts/CMR/CmrHomePage.cgiDavidsen et al. (2010)
GOLDDOE Joint Genome Institute, USAGenomes On Line Databasehttp://www.genomesonline.org/Liolios et al. (2010)
Genome information broker (GIB)DDBJ (DNA Data Bank of Japan)Database of microbial genomes and some comparative genomic toolshttp://gib.genes.nig.ac.jp/Fumoto et al. (2002)
Genome AtlasCBS, Technical University of DenmarkDNA structural atlases for complete microbial genomeshttp://www.cbs.dtu.dk/services/GenomeAtlas/Hallin and Ussery (2004)
PedantMunich Information Center for Protein Sequences (MIPS)PEDANT 3 database: a Protein Extraction, Description and ANalysis Toolhttp://pedant.gsf.deRiley et al. (2005)
REGANORCeBiTec, GermanyGene prediction server and databasehttps://www.cebitec.uni-bielefeld.de/groups/brf/software/reganor/cgi-bin/reganor_upload.cgi Note: site offlineLinke et al. (2006)
BacMapUniversity of Alberta, CanadaAn interactive picture atlas of annotated bacterial genomeshttp://wishart.biology.ualberta.ca/BacMap/Stothard et al. (2005)
MOSAICINRA, FranceDatabase dedicated to the comparative genomics of bacterial strains at the intra-species levelhttp://genome.jouy.inra.fr/mosaic/Chiapello et al. (2008)
InterProEMBL-EBIIntegrative protein signature databasehttp://www.ebi.ac.uk/interpro/Hunter et al. (2009)
PfamSanger Institute, UKProtein families and domains databasehttp://pfam.sanger.ac.uk/Finn et al. (2010)
SMARTEMBL, GermanyProtein domain architecture databasehttp://smart.embl-heidelberg.de/Letunic et al. (2009)
Gene Ontology Annotation (GOA)The Gene OntologyGO controlled vocabulary of biological processeshttp://www.geneontology.org/GO.tools.annotation.shtml and http://www.ebi.ac.uk/GOA/Barrell et al. (2009)
TIGRFAMsJ. Craig Venter Institute (JCVI)Assignment of molecular function and biological processhttp://www.jcvi.org/cms/research/projects/tigrfams/overview/ Free to use hidden markov modelsSelengut et al. (2007)
Pseudogene.OrgYale Gerstein GroupA comprehensive database and comparison platform for pseudogene annotationhttp://pseudogene.orgLiu et al. (2004); Karro et al. (2007)
ExPASy ENZYMESwiss Institute for Bioinformatics (SIB)Enzyme nomenclature databasehttp://www.expasy.ch/enzyme/Bairoch (2000)
MetaCycSRI International, USADatabase of metabolic pathways and enzymeshttp://metacyc.org/Caspi et al. (2010)
KEGGKyoto Encyclopedia for Genes and Genomes: Kanehisa LaboratoriesA bioinformatics resource for linking genomes to life and the environmenthttp://www.genome.jp/kegg/Okuda et al. (2008)

Many of the previous databases make use of annotation information from InterPro protein domains, Gene Ontologies (GO; controlled vocabulary of cellular functions), and TIGRFAMs (also part of Manatee, used in IGS/JCVI annotation services). The pseudogene.org database can be used to determine whether a gene in a given genome could be a pseudogene (non-functional).

Microbes adapt to their environment by modulating parts of their metabolic and gene regulatory networks. Metabolic networks consist of gene products (enzymes) that catalyse chemical reactions where metabolic compounds are (re)used. The Enzyme Commission (EC) number is a way of classifying enzyme activity, using a nomenclature with specific numbers that are organized hierarchically to indicate the catalysed chemical reaction (ExPASy). Both the KEGG and MetaCyc databases describe the relation of gene products to metabolic pathways. In addition to (curated) annotation information, a few databases also offer bioinformatics and/or visualisation tools for comparative genomics, e.g. MOSAIC, CMR, the Seed, ERGO, GIB, xBASE, MicrobesOnline and BacMap.

(Re)-annotation pipelines

  1. Top of page
  2. Re-annotation
  3. Standardized (re)-annotation databases
  4. (Re)-annotation pipelines
  5. Comparison of automatic annotation pipelines
  6. Future
  7. Acknowledgements
  8. References

Many of the afore-mentioned databases contain annotation information that is generated by gene annotation pipelines. Table 3 lists annotation pipelines that are either offered as a service or that can be downloaded and installed locally. Locally running pipelines (AGMIAL, DIYA, Restauro-G, GenVar, SABIA, MAGPIE and GenDB) have the advantage that data can be kept confidential and that the annotation process is run on local hardware, ensuring reproducible annotation times. On-line services (IGS, IMG, JCVI, IGS, RAST, xBASE, BASys) have the advantage of simplicity and little time investment. Curation of the annotation results requires constant user interaction to view the genes in context of different annotation information. The JCVI and IGS services both use the (formerly known as TIGR) Manatee pipeline, which also uses the TIGRFAMs to detect functional domains in protein sequences. They offer the user the possibility to view and alter annotations in the respective databases they use. Similar functionality is offered by MAGE (which uses the MicroScope database) (Fig. 2), IMG-ER (uses the IMG data model as basis) and RAST (based on the Seed). The commercially available Pedant-Pro pipeline is based on the Pedant annotation pipeline with various enhancements. Usability of the MiGAP and ATCUG annotation pipelines could not be judged by us due to unavailable software (ATCUG) or website language in Japanese (MiGAP). The Taverna work-flow system allows to link different web services, and has the advantage that it can be adapted by experienced bioinformaticians. Assigning genes to metabolic pathways can be done using the KAAS service (Table 3), which annotates gene products by assigning EC numbers based on amino acid similarity to gene products with known EC numbers.

Table 3.  Genome (re-)annotation pipelines.
PipelineOrganizationDescriptionAccess/distributionReference
IGSUniversity of MarylandA FREE resource for genomics researchers and educators bringing advanced bioinformatics tools to the lab bench and the classroomhttp://ae.igs.umaryland.edu/cgi/index.cgi Free serviceNone
JCVI annotation serviceJ. Craig Venter Institute (JCVI)Free to use genome annotation servicehttp://www.jcvi.org/cms/research/projects/annotation-service/overview/ Free to use annotation serviceNone
MiGAPDatabase Center for Life Sciences (DBCLS)Microbial Genome Annotation Pipeline (MiGAP) for diverse usershttp://migap.lifesciencedb.jp/ Note: site is in Japanesehttp://www.jsbi.org/modules/journal1/index.php/GIW09/Poster/GIW09S001.pdf
MaGe/MicroScopeGENOSCOPEMagnifying Genomes: microbial genome annotation systemhttp://www.genoscope.cns.fr/agc/mage Free serviceVallenet et al. (2006); Vallenet et al. (2009)
BASysUniversity of Alberta, CanadaA web server for bacterial genome annotationhttp://wishart.biology.ualberta.ca/basys/ Free to useVan Domselaar et al. (2005)
RASTFellowship for Integration of Genomes (FIG)The RAST Server: Rapid Annotations using Subsystems Technology based on the Seedhttp://rast.nmpdr.org/ Free to use serviceAziz et al. (2008)
xBASEUniversity of Birmingham, UKBacterial genome annotation servicehttp://xbase.ac.uk/annotation/ Free to use serviceChaudhuri et al. (2008)
IMG ERJoint Genome Institute (JGI)A system for microbial genome annotation expert review and curationhttp://img.jgi.doe.gov/er Free serviceMarkowitz et al. (2009)
GenVarVirginia Bioinformatics InstituteBacterial gene annotation and comparative genomics pipelinehttp://patric.vbi.vt.edu/downloads/software/GenVar Free for non-commercial useYu et al. (2007)
Pedant-ProBiomaxGenome analysis package for comprehensive analysis of DNA and protein sequenceshttp://www.biomax.de/products/pedantpro.php Commercial licenseFrishman et al. (2001)
AGMIALINRA, FranceAn annotation strategy for prokaryote genomes as a distributed systemhttp://genome.jouy.inra.fr/agmial/ Open source licenseBryson et al. (2006)
GenDBCeBiTec, GermanyBacterial annotation systemhttp://www.cebitec.uni-bielefeld.de/groups/brf/software/gendb_info/ Free to use, stand-alone softwareMeyer et al. (2003)
DIYADIY Genomics ConsortiumA bacterial annotation pipeline for any genomics labhttps://sourceforge.net/projects/diyg/ Free to use, stand-alone softwareStewart et al. (2009)
SABIALNCC, BrazilBacterial annotation systemhttp://www.sabia.lncc.br/ Free to use, stand-alone softwareAlmeida et al. (2004)
MAGPIEGenome Prairie Project, CanadaGenome annotation systemhttp://magpie.ucalgary.ca/ Free to use, stand-alone softwareGaasterland and Sensen (1996)
Restauro-GInstitute for Advanced Biosciences, Keio UniversityA Rapid Genome Re-Annotation System for Comparative Genomicshttp://restauro-g.iab.keio.ac.jp/ Software distributed under the GNU public licenseTamaki et al. (2007)
ATUCG systemUniversidade Federal do Rio Grande do Sul, BrasilAgent-based environment for automatic annotation of GenomesNone Software should be requested at authorsNascimento and Bazzan (2005)
Taverna: annotation of genomesUniversity of ManchesterInteractive genome annotation pipeline.http://www.taverna.org.uk/introduction/taverna-in-use/annotation/annotation-of-genomes/Hull et al. (2006)
KAASKyoto Encyclopedia for Genes and Genomes (KEGG)KEGG automated annotation service for metabolic pathwayshttp://www.genome.jp/tools/kaas/ Free to use serviceMoriya et al. (2007)
image

Figure 2. Simplified prokaryotic genome database (PkGDB) relational model composed of three main components: sequence and annotation data (in green), annotation management (in blue) and functional predictions (in purple). Sequences and annotations come from public databanks, sequencing centres and specialized databases focused on model organisms. For genomes of interest, a (re)-annotation process is performed using AMIGene (Bocs et al., 2003) and leads to the creation of new ‘Genomic Objects’. Each ‘Genomic Object’ and associated functional prediction results are stored in the PkGDB. The database architecture supports integration of automatic and manual annotations, and management of a history of annotations and sequence updates. Reproduced from Vallenet and colleagues (2006).

Download figure to PowerPoint

Once gene annotations have been determined, they can be checked for inaccurate or missing gene annotations using MICheck. Hsiao and colleagues (2010) describe an algorithm for policing gene annotations, which looks for genes with poor genomic correlations with their network neighbours, and are likely to represent annotation errors. They applied their approach to identify misannotations of B. subtilis. The Artemis generic visualisation tool can be used for manual editing of annotation (Rutherford et al., 2000). Prior to submission of a DNA sequence and annotation to the NCBI genome database, the NCBI Sequin service (http://www.ncbi.nlm.nih.gov/projects/Sequin/) also facilitates checking gene annotations, making sure that certain standards and formats are used.

Comparison of automatic annotation pipelines

  1. Top of page
  2. Re-annotation
  3. Standardized (re)-annotation databases
  4. (Re)-annotation pipelines
  5. Comparison of automatic annotation pipelines
  6. Future
  7. Acknowledgements
  8. References

Genome annotations are accumulating rapidly and most genome centres depend heavily on automated annotation systems. But rarely has their output been systematically compared to determine accuracy and inherent errors. (Bakke and colleagues (2009) compared the automatic genome annotation services IMG, RAST and JCVI, and found considerable differences in gene calls (Fig. 3), features and ease of use. Each service provided multiple unique start sites and gene product calls as well as mistakes. They argue that the most efficient way to substantially decrease annotation error is to compare results from multiple annotation services. Aggregating data and displaying discrepancies between annotations should resolve many possible errors including false positives, uncalled genes, genes without a predicted function, incorrectly predicted functions and incorrect start sites. To accomplish multi-annotation comparison, information must be interchangeable between annotation services, and software should be built to connect annotations in a manner that promotes easy human review. Tools that cross-query annotations and provide side-by-side comparisons that include genomic context and multiple functional annotations will aid the user and decrease the amount of time required to make an accurate correction, i.e. to decrease manual curation time.

image

Figure 3. Venn diagram of comparison of gene prediction in Halorhabdus utahensis using the RAST, IMG and JCVI automated annotation services. The diagram shows the number of predicted protein-coding genes that share start site and stop site with the other annotations. Overlapping regions indicate genes having exact matches between annotations. Adapted from Bakke and colleagues (2009).

Download figure to PowerPoint

Future

  1. Top of page
  2. Re-annotation
  3. Standardized (re)-annotation databases
  4. (Re)-annotation pipelines
  5. Comparison of automatic annotation pipelines
  6. Future
  7. Acknowledgements
  8. References

Clearly, standardization of ORF calling and annotation (and re-annotation of published genomes) is of utmost importance. A few standard operating procedures for genome annotation have already been proposed in recent years (Angiuoli et al., 2008; Mavromatis et al., 2009). Still, we are a long way from achieving that goal, and it is unlikely we will ever be able to weed out all the incorrect gene calls and inherited annotations that are abundant in present genome databases. The contents of NCBI GenBank can only be changed by the original submitters, and that rarely happens. So be aware that a blast search against GenBank may retrieve very outdated or incorrectly inherited annotations. It is wiser to blast against curated genome databases, but there are so many to choose from (Table 2), and we clearly need tools to compare annotations from different curated databases.

Re-annotation of genomes is a never-ending process, and any current genome annotation is only a snap-shot. New information emerges almost every day from re-sequencing, experimentation (e.g. transcriptomics, proteomics, phenotypic tests, gene knock-outs), comparative genomics, etc. Salzberg (2007) has proposed that a ‘genome wiki’ might provide just the solution we need for genome annotation. A wiki would allow the community of experts to work out the best name for each gene, to indicate uncertainty where appropriate, to include experimental evidence, to discuss alternative annotations, and to continuously update annotations. Although wikis will not (and should not) supplant well-curated model-organism databases, for the majority of species they might represent our best chance for creating accurate, up-to-date genome annotation.

And if you are really serious about updating your annotations, don't forget to re-sequence your original strains using next-generation sequencing, at least if you can still find them in your freezer!

Acknowledgements

  1. Top of page
  2. Re-annotation
  3. Standardized (re)-annotation databases
  4. (Re)-annotation pipelines
  5. Comparison of automatic annotation pipelines
  6. Future
  7. Acknowledgements
  8. References

This project was carried out within the research programmes of the Kluyver Centre for Genomics of Industrial Fermentation and the Netherlands Bioinformatics Centre, which are part of the Netherlands Genomics Initiative/Netherlands Organization for Scientific Research.

References

  1. Top of page
  2. Re-annotation
  3. Standardized (re)-annotation databases
  4. (Re)-annotation pipelines
  5. Comparison of automatic annotation pipelines
  6. Future
  7. Acknowledgements
  8. References
  • Almeida, L.G., Paixao, R., Souza, R.C., Costa, G.C., Barrientos, F.J., Santos, M.T., et al. (2004) A system for automated bacterial (genome) integrated annotation – SABIA. Bioinformatics 20: 28322833.
  • Altschul, S.F., Madden, T.L., Schaffer, A.A., Zhang, J., Zhang, Z., Miller, W., and Lipman, D.J. (1997) Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res 25: 33893402.
  • Angiuoli, S.V., Gussman, A., Klimke, W., Cochrane, G., Field, D., Garrity, G., et al. (2008) Toward an online repository of Standard Operating Procedures (SOPs) for (meta)genomic annotation. OMICS 12: 137141.
  • Aziz, R.K., Bartels, D., Best, A.A., DeJongh, M., Disz, T., Edwards, R.A., et al. (2008) The RAST Server: rapid annotations using subsystems technology. BMC Genomics 9: 75.
  • Bairoch, A. (2000) The ENZYME database in 2000. Nucleic Acids Res 28: 304305.
  • Bakke, P., Carney, N., Deloache, W., Gearing, M., Ingvorsen, K., Lotz, M., et al. (2009) Evaluation of three automated genome annotations for Halorhabdus utahensis. PLoS One 4: e6291.
  • Barbe, V., Cruveiller, S., Kunst, F., Lenoble, P., Meurice, G., Sekowska, A., et al. (2009) From a consortium sequence to a unified sequence: the Bacillus subtilis 168 reference genome a decade later. Microbiology 155: 17581775.
  • Barrell, D., Dimmer, E., Huntley, R.P., Binns, D., O'Donovan, C., and Apweiler, R. (2009) The GOA database in 2009 – an integrated Gene Ontology Annotation resource. Nucleic Acids Res 37: D396D403.
  • Benson, D.A., Karsch-Mizrachi, I., Lipman, D.J., Ostell, J., and Sayers, E.W. (2009) GenBank. Nucleic Acids Res 37: D26D31.
  • Bocs, S., Cruveiller, S., Vallenet, D., Nuel, G., and Medigue, C. (2003) AMIGene: Annotation of MIcrobial Genes. Nucleic Acids Res 31: 37233726.
  • Bryson, K., Loux, V., Bossy, R., Nicolas, P., Chaillou, S., Van De Guchte, M., et al. (2006) AGMIAL: implementing an annotation strategy for prokaryote genomes as a distributed system. Nucleic Acids Res 34: 35333545.
  • Camus, J.C., Pryor, M.J., Medigue, C., and Cole, S.T. (2002) Re-annotation of the genome sequence of Mycobacterium tuberculosis H37Rv. Microbiology 148: 29672973.
  • Caspi, R., Altman, T., Dale, J.M., Dreher, K., Fulcher, C.A., Gilham, F., et al. (2010) The MetaCyc database of metabolic pathways and enzymes and the BioCyc collection of pathway/genome databases. Nucleic Acids Res 38: D473D479.
  • Chaudhuri, R.R., Loman, N.J., Snyder, L.A., Bailey, C.M., Stekel, D.J., and Pallen, M.J. (2008) xBASE2: a comprehensive resource for comparative bacterial genomics. Nucleic Acids Res 36: D543D546.
  • Chiapello, H., Gendrault, A., Caron, C., Blum, J., Petit, M.A., and EI Karoui, M., (2008) MOSAIC: an online database dedicated to the comparative genomics of bacterial strains at the intra-species level. BMC Bioinformatics 9: 498.
  • Christie, K.R., Weng, S., Balakrishnan, R., Costanzo, M.C., Dolinski, K., Dwight, S.S., et al. (2004) Saccharomyces Genome Database (SGD) provides tools to identify and analyze sequences from Saccharomyces cerevisiae and related sequences from other organisms. Nucleic Acids Res 32: D311D314.
  • Davidsen, T., Beck, E., Ganapathy, A., Montgomery, R., Zafar, N., Yang, Q., et al. (2010) The comprehensive microbial resource. Nucleic Acids Res 38: D340D345.
  • Dehal, P.S., Joachimiak, M.P., Price, M.N., Bates, J.T., Baumohl, J.K., Chivian, D., et al. (2010) MicrobesOnline: an integrated portal for comparative and functional genomics. Nucleic Acids Res 38: D396D400.
  • Delcher, A.L., Harmon, D., Kasif, S., White, O., and Salzberg, S.L. (1999) Improved microbial gene identification with GLIMMER. Nucleic Acids Res 27: 46364641.
  • Eddy, S.R. (1998) Profile hidden Markov models. Bioinformatics 14: 755763.
  • Finn, R.D., Mistry, J., Tate, J., Coggill, P., Heger, A., Pollington, J.E., et al. (2010) The Pfam protein families database. Nucleic Acids Res 38: D211D222.
  • Frishman, D., Albermann, K., Hani, J., Heumann, K., Metanomski, A., Zollner, A., and Mewes, H.W. (2001) Functional and structural genomics using PEDANT. Bioinformatics 17: 4457.
  • Fumoto, M., Miyazaki, S., and Sugawara, H. (2002) Genome Information Broker (GIB): data retrieval and comparative analysis system for completed microbial genomes and more. Nucleic Acids Res 30: 6668.
  • Gaasterland, T., and Sensen, C.W. (1996) MAGPIE: automated genome interpretation. Trends Genet 12: 7678.
  • Gundogdu, O., Bentley, S.D., Holden, M.T., Parkhill, J., Dorrell, N., and Wren, B.W. (2007) Re-annotation and re-analysis of the Campylobacter jejuni NCTC11168 genome sequence. BMC Genomics 8: 162.
  • Hallin, P.F., and Ussery, D.W. (2004) CBS Genome Atlas Database: a dynamic storage for bioinformatic results and sequence data. Bioinformatics 20: 36823686.
  • Hsiao, T.L., Revelles, O., Chen, L., Sauer, U., and Vitkup, D. (2010) Automatic policing of biochemical annotations using genomic correlations. Nat Chem Biol 6: 3440.
  • Hull, D., Wolstencroft, K., Stevens, R., Goble, C., Pocock, M.R., Li, P., and Oinn, T. (2006) Taverna: a tool for building and running workflows of services. Nucleic Acids Res 34: W729W732.
  • Hunter, S., Apweiler, R., Attwood, T.K., Bairoch, A., Bateman, A., Binns, D., et al. (2009) InterPro: the integrative protein signature database. Nucleic Acids Res 37: D211D215.
  • Karro, J.E., Yan, Y., Zheng, D., Zhang, Z., Carriero, N., Cayting, P., et al. (2007) Pseudogene.org: a comprehensive database and comparison platform for pseudogene annotation. Nucleic Acids Res 35: D55D60.
  • Kunst, F., Ogasawara, N., Moszer, I., Albertini, A.M., Alloni, G., Azevedo, V., et al. (1997) The complete genome sequence of the gram-positive bacterium Bacillus subtilis. Nature 390: 249256.
  • Lechat, P., Hummel, L., Rousseau, S., and Moszer, I. (2008) GenoList: an integrated environment for comparative analysis of microbial genomes. Nucleic Acids Res 36: D469D474.
  • Letunic, I., Doerks, T., and Bork, P. (2009) SMART 6: recent updates and new developments. Nucleic Acids Res 37: D229D232.
  • Linke, B., McHardy, A.C., Neuweger, H., Krause, L., and Meyer, F. (2006) REGANOR: a gene prediction server for prokaryotic genomes and a database of high quality gene predictions for prokaryotes. Appl Bioinformatics 5: 193198.
  • Liolios, K., Chen, I.M., Mavromatis, K., Tavernarakis, N., Hugenholtz, P., Markowitz, V.M., and Kyrpides, N.C. (2010) The Genomes On Line Database (GOLD) in 2009: status of genomic and metagenomic projects and their associated metadata. Nucleic Acids Res 38: D346D354.
  • Liu, Y., Harrison, P.M., Kunin, V., and Gerstein, M. (2004) Comprehensive analysis of pseudogenes in prokaryotes: widespread gene decay and failure of putative horizontally transferred genes. Genome Biol 5: R64.
  • Lukashin, A.V., and Borodovsky, M. (1998) GeneMark.hmm: new solutions for gene finding. Nucleic Acids Res 26: 11071115.
  • Luo, C., Hu, G.Q., and Zhu, H. (2009) Genome reannotation of Escherichia coli CFT073 with new insights into virulence. BMC Genomics 10: 552.
  • Markowitz, V.M., Chen, I.M., Palaniappan, K., Chu, K., Szeto, E., Grechkin, Y., et al. (2010) The integrated microbial genomes system: an expanding comparative analysis resource. Nucleic Acids Res 38: D382D390.
  • Markowitz, V.M., Korzeniewski, F., Palaniappan, K., Szeto, E., Werner, G., Padki, A., et al. (2006) The integrated microbial genomes (IMG) system. Nucleic Acids Res 34: D344D348.
  • Markowitz, V.M., Mavromatis, K., Ivanova, N.N., Chen, I.M., Chu, K., and Kyrpides, N.C. (2009) IMG ER: a system for microbial genome annotation expert review and curation. Bioinformatics 25: 22712278.
  • Mavromatis, K., Ivanova, N.N., Chen, I.A., Szeto, E., Markowitz, V.M., and Kyrpides, N.C. (2009) The DOE-JGI standard operating procedure for the annotations of microbial genomes. Standards in Genomics Sciences 1: 6871.
  • Meyer, F., Goesmann, A., McHardy, A.C., Bartels, D., Bekel, T., Clausen, J., et al. (2003) GenDB – an open source genome annotation system for prokaryote genomes. Nucleic Acids Res 31: 21872195.
  • Moriya, Y., Itoh, M., Okuda, S., Yoshizawa, A.C., and Kanehisa, M. (2007) KAAS: an automatic genome annotation and pathway reconstruction server. Nucleic Acids Res 35: W182W185.
  • Nascimento, L.V., and Bazzan, A.L. (2005) An agent-based system for re-annotation of genomes. Genet Mol Res 4: 571580.
  • Okuda, S., Yamada, T., Hamajima, M., Itoh, M., Katayama, T., Bork, P., et al. (2008) KEGG Atlas mapping for global analysis of metabolic pathways. Nucleic Acids Res 36: W423W426.
  • Ouzounis, C.A., and Karp, P.D. (2002) The past, present and future of genome-wide re-annotation. Genome Biol 3: COMMENT2001.
  • Overbeek, R., Begley, T., Butler, R.M., Choudhuri, J.V., Chuang, H.Y., Cohoon, M., et al. (2005) The subsystems approach to genome annotation and its use in the project to annotate 1000 genomes. Nucleic Acids Res 33: 56915702.
  • Overbeek, R., Larsen, N., Walunas, T., D'Souza, M., Pusch, G., Selkov, E., Jr, et al. (2003) The ERGO genome analysis and discovery system. Nucleic Acids Res 31: 164171.
  • Pruitt, K.D., Tatusova, T., Klimke, W., and Maglott, D.R. (2009) NCBI Reference Sequences: current status, policy and new initiatives. Nucleic Acids Res 37: D32D36.
  • Riley, M.L., Schmidt, T., Wagner, C., Mewes, H.W., and Frishman, D. (2005) The PEDANT genome database in 2005. Nucleic Acids Res 33: D308D310.
  • Rudd, K.E. (2000) EcoGene: a genome sequence database for Escherichia coli K-12. Nucleic Acids Res 28: 6064.
  • Rutherford, K., Parkhill, J., Crook, J., Horsnell, T., Rice, P., Rajandream, M.A., and Barrell, B. (2000) Artemis: sequence visualization and annotation. Bioinformatics 16: 944945.
  • Salzberg, S.L. (2007) Genome re-annotation: a wiki solution? Genome Biol 8: 102.
  • Selengut, J.D., Haft, D.H., Davidsen, T., Ganapathy, A., Gwinn-Giglio, M., Nelson, W.C., et al. (2007) TIGRFAMs and Genome Properties: tools for the assignment of molecular function and biological process in prokaryotic genomes. Nucleic Acids Res 35: D260D264.
  • Sterk, P., Kersey, P.J., and Apweiler, R. (2006) Genome Reviews: standardizing content and representation of information about complete genomes. OMICS 10: 114118.
  • Stewart, A.C., Osborne, B., and Read, T.D. (2009) DIYA: a bacterial annotation pipeline for any genomics lab. Bioinformatics 25: 962963.
  • Stothard, P., Van Domselaar, G., Shrivastava, S., Guo, A., O'Neill, B., Cruz, J., et al. (2005) BacMap: an interactive picture atlas of annotated bacterial genomes. Nucleic Acids Res 33: D317D320.
  • Tamaki, S., Arakawa, K., Kono, N., and Tomita, M. (2007) Restauro-G: a rapid genome re-annotation system for comparative genomics. Genomics Proteomics Bioinformatics 5: 5358.
  • Vallenet, D., Engelen, S., Mornico, D., Cruveiller, S., Fleury, L., Lajus, A., et al. (2009) MicroScope: a platform for microbial genome annotation and comparative genomics. Database (Oxford) 2009: bap021.
  • Vallenet, D., Labarre, L., Rouy, Z., Barbe, V., Bocs, S., Cruveiller, S., et al. (2006) MaGe: a microbial genome annotation system supported by synteny results. Nucleic Acids Res 34: 5365.
  • Van Domselaar, G.H., Stothard, P., Shrivastava, S., Cruz, J.A., Guo, A., Dong, X., et al. (2005) BASys: a web server for automated bacterial genome annotation. Nucleic Acids Res 33: W455W459.
  • Wood, V., Rutherford, K.M., Ivens, A., Rajandream, M.A., and Barrell, B. (2001) A re-annotation of the Saccharomyces cerevisiae genome. Comp Funct Genomics 2: 143154.
  • Wortman, J.R., Gilsenan, J.M., Joardar, V., Deegan, J., Clutterbuck, J., Andersen, M.R., et al. (2009) The 2008 update of the Aspergillus nidulans genome annotation: a community effort. Fungal Genet Biol 46 (Suppl. 1): S213.
  • Yang, S., Pappas, K.M., Hauser, L.J., Land, M.L., Chen, G.L., Hurst, G.B., et al. (2009) Improved genome annotation for Zymomonas mobilis. Nat Biotechnol 27: 893894.
  • Yu, G.X., Snyder, E.E., Boyle, S.M., Crasta, O.R., Czar, M., Mane, S.P., et al. (2007) A versatile computational pipeline for bacterial genome annotation improvement and comparative analysis, with Brucella as a use case. Nucleic Acids Res 35: 39533962.