An efficient numerical representation of genome sequence: natural vector with covariance component
- Published
- Accepted
- Received
- Academic Editor
- Alexander Bolshoy
- Subject Areas
- Bioinformatics, Genomics, Mathematical Biology, Microbiology, Data Mining and Machine Learning
- Keywords
- Bacteria, Virus, Giant virus, Archaea, Fungi, Convex hull classification, The nearest neighbor classification, Phylogeny, Natural vector with covariance component
- Copyright
- © 2022 Sun et al.
- Licence
- This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ) and either DOI or URL of the article must be cited.
- Cite this article
- 2022. An efficient numerical representation of genome sequence: natural vector with covariance component. PeerJ 10:e13544 https://doi.org/10.7717/peerj.13544
Abstract
Background
The characterization and comparison of microbial sequences, including archaea, bacteria, viruses and fungi, are very important to understand their evolutionary origin and the population relationship. Most methods are limited by the sequence length and lack of generality. The purpose of this study is to propose a general characterization method, and to study the classification and phylogeny of the existing datasets.
Methods
We present a new alignment-free method to represent and compare biological sequences. By adding the covariance between each two nucleotides, the new 18-dimensional natural vector successfully describes 24,250 genomic sequences and 95,542 DNA barcode sequences. The new numerical representation is used to study the classification and phylogenetic relationship of microbial sequences.
Results
First, the classification results validate that the six-dimensional covariance vector is necessary to characterize sequences. Then, the 18-dimensional natural vector is further used to conduct the similarity relationship between giant virus and archaea, bacteria, other viruses. The nearest distance calculation results reflect that the giant viruses are closer to bacteria in distribution of four nucleotides. The phylogenetic relationships of the three representative families, Mimiviridae, Pandoraviridae and Marsellieviridae from giant viruses are analyzed. The trees show that ten sequences of Mimiviridae are clustered with Pandoraviridae, and Mimiviridae is closer to the root of the tree than Marsellieviridae. The new developed alignment-free method can be computed very fast, which provides an effective numerical representation for the sequence of microorganisms.
Introduction
With the increasingly close relationship between microorganisms and human beings, a deeper understanding of microorganisms becomes important (Wessner, Dupont & Charles, 2013). Comparing sequence similarity and inferring phylogenetic relationship is helpful to understand their properties, so as to reduce the harm of microorganisms and let them serve human beings better. Molecular biologists believe that similar sequences have similar functions. If the function of microbial species is known, the function of microorganisms with similar sequences can be inferred. Similar sequences can be obtained by sequence comparison. Two methods, alignment-free and alignment methods, are known to compare sequences. Traditional commonly used alignment approaches include MUSCLE (Edgar, 2004a; Edgar, 2004b), ClustalW (Larkin, Blackshields & Brown, 2007), and BLAST (Altschul et al., 1990; Altschul et al., 1997), but they are very time-consuming and require a lot of memory. Alignment-free methods are developed to overcome these limitations, such as chaos game representation (Jeffrey, 1990; Hatje & Kollmar, 2012), Fourier transform (Yin, Chen & Yau, 2014), information theory (Vinga, 2014; Almeida, 2014), k-mer theory (Dai, Yang & Wang, 2008; Leimeister & Morgenstern, 2014), etc. The alignment-free methods do not require the neutral theory assumption and can process a large number of microbial sequences.
Yau and his team proposed a powerful alignment-free method, a 12-dimensional natural vector, to describe the nucleotides distribution within the DNA sequence (Deng et al., 2011). This natural vector consists of the count, average position and central moment of each nucleotide. It has been successfully applied to many research fields, especially the clustering (Zhao, Tian & Yau, 2018; Zhao et al., 2019; Sun et al., 2021) and classification (He et al., 2020; Pei et al., 2020) of biological sequences. The 12-dimensional natural vector only considers the respective distribution of single nucleotide but ignores the relationship between the two nucleotides. This inspires us to extend the definition and further consider the correlation of each two nucleotides. There are four nucleotides for a sequence, and the new natural vector is 18-dimensional, of which the covariance component is six dimensional.
Microorganisms are diverse and live in every part of the biosphere, which mainly include archaea, bacteria, virus, fungi, and some other protozoa (Wessner, Dupont & Charles, 2013). As a vital part of microorganisms, the study of the giant virus has attracted much attention. Their evolutionary origin and the relationship with other viruses, bacteria and archaea remain controversial (Bichell, 2017). Giant viruses have extremely large genomes, some of which are even larger than bacterial genome (Ogata, Toyoda & Tomaru, 2009). Recently discovered giant viruses have even longer genome sequences and more encoding genes (Van Etten, 2011; Legendre, Arslan & Abergel, 2012). Researchers claim two hypotheses that they evolve either from small viruses or from very complex organisms. These enlighten us to analyze microbial sequences using our method.
In this article, we improve the 12-dimensional natural vector by defining the covariance between nucleotides, and add the six-dimensional covariance vector to the 12-dimensional vector. The 18-dimensional natural vector can effectively represent a sequence, and has been tested on five genomic sequence datasets and one DNA barcode sequence dataset. The results of convex hull classification show that the six-dimensional covariance vector is necessary to characterize sequences. The study of giant virus based on our method gives more stable results than other alignment-free methods. Our new 18-dimensional natural vector shows outstanding ability in classification and phylogeny of biological sequences.
Materials and Methods
Natural vector
Natural vector is a 12-dimensional numerical representation of a nucleotide sequence (Deng et al., 2011), which is defined as follows. Let be a genomic sequence of length n, and . For , the indicator functions is defined as:
(1) where Let denote the counts of nucleotide k in S, specify the average location of letter k, be the j-th central moment of position of letter k. If , we get the traditional 12-dimensional natural vector:
(2)
Here we give an example to calculate the vector. If the genomic sequence is ACGGTAGTCC, the indicator functions are . Each component of the vector is calculated as follow:
•
•
•
•
•
•
•
•
•
Then the 12-dimensional natural vector in formula (2) is:
A novel definition of covariance between nucleotides
The 12-dimensional natural vector definition reveals the respective distribution of four nucleotides, but ignores the relationship of each two nucleotides. We improve the 12-dimensional vector by defining the covariance between nucleotides. For the same genomic sequence , and , we redefine the indicator function,
(3)
And the covariance between k and l is defined as:
(4)
The above formula reflects the correlation relationship of the position of each two nucleotides. The beauty of the definition is .
Thus, we get a novel 18-dimensional natural vector with covariance component:
(5)
For the same sequence ACGGTAGTCC, the indicator functions are The corresponding components are calculated as follows:
•
•
•
•
•
•
Then the nucleotide distribution of sequence ACGGTAGTCC can be described by an 18-dimensional natural vector with covariance component:
The biological similarity between two sequences can be measured using the Euclidean distance of their corresponding 18-dimensional natural vectors, which is commonly used in our previous studies (Deng et al., 2011; Zhao, Tian & Yau, 2018; Zhao et al., 2019; Sun et al., 2021; He et al., 2020; Pei et al., 2020).
Datasets and tools
The newly proposed alignment-free method is tested on six microorganism datasets, including the genome and gene sequences of archaea, bacteria, virus and fungi, as shown in Table 1. The genomes of archaea, bacteria, virus and fungi are downloaded from National Center for Biotechnology Information (NCBI). Giant viruses in this study are regarded as the viruses with genome size greater than 170 kb, which are collected to study their relationship with archaea, bacteria, and other viruses. This giant virus dataset is collected from two public databases (Giant virus toplist: https://pitgroup.org/giant-virus-toplist/; The largest known viral genomes (completely sequenced, >170 kb): http://www.giantvirus.org/2014-04-14top.html) and virus dataset (Viruses with genome size greater than 170 kb). In order to compare with the previous nucleotide covariance study (Zhao, Tian & Yau, 2018), we re-download DNA barcode of fungi from Barcode of Life Data System (BOLD) according to the dataset record (Zhao, Tian & Yau, 2018).
Dataset | Type | Number of sequences | Number of families | Database access link and description | |
---|---|---|---|---|---|
1 | Archaea | genomic sequence | 298 | 20 | ftp.ncbi.nih.gov/refseq/release/archaea/ |
2 | Bacteria | genomic sequence | 16,375 | 178 | ftp.ncbi.nih.gov/refseq/release/bacteria/ |
3 | Virus | genomic sequence | 7,382 | 83 | ftp.ncbi.nlm.nih.gov/genomes/Viruses |
4 | Fungi | genomic sequence | 387 | 22 | ftp.ncbi.nih.gov/refseq/release/fungi/ |
5 | Giant virus | genomic sequence | 677 | 16 | Giant virus toplist: https://pitgroup.org/giant-virus-toplist/; The largest known viral genomes (completely sequenced, >170 kb): http://www.giantvirus.org/2014-04-14top.html; Reference sequences from Virus dataset, which genome size is over 170 kb, and the CDS counts are over 100. |
6 | Fungi | DNA barcode | 95,542 | 467 | Barcode of Life Data System (BOLD): http://www.barcodinglife.org |
To ensure the reliability of the data, we remove three types of sequences from the original datasets: (1) sequences without family taxonomic information; (2) families with less three sequences. (3) sequences of plasmid for bacteria dataset. DNA barcode uniquely identifies species using a short fragment of DNA sequence from specific genes (iBOL, 2022). For this DNA barcode of fungi dataset, we only remain the sequences pertaining to internal transcribed spacer (ITS) region of fungi (Conrad, Keith & Sabine, 2012; Naturvetenskapliga, 2010). At last, there are 298 genomic sequences belonging to 20 families for archaea dataset, 16,375 genomic sequences belonging to 178 families for bacteria dataset, 7,382 genomic sequences belonging to 83 families for virus dataset, 387 genomic sequences belonging to 22 families for fungi genome dataset, 677 sequences belonging to 16 families for giant virus dataset, and 95,542 sequences belonging to 467 families for fungi DNA barcode dataset. All accession numbers can be found in Datas S1–S6.
All the programs in this article are written in MATLAB R2020a and run on the same laptop (MacBook Air, 1.8 GHz Intel Core i5, 8 GB 1,600 MHz DDR3).
Convex hull principle for genomes
Convex hull principle for genomes has been demonstrated to be a wonderful classification tool (Zhao, Tian & Yau, 2018; Zhao et al., 2019; Sun et al., 2021). In Mathematics, the convex hull of a point set is the minimal convex set that contains these m points, where is the k-dimensional Euclidean space, and is a k-dimensional point. The convex hull of finite set A is defined as the set of convex combinations of all points in A:
(6)
The boundary of the convex hull is spanned by some points of A (vertexes), and the rest points of A are lying inside the hull. The convex hull is a convex polygon if all are two-dimensional vectors, and the convex hull is a convex polytope if all are high dimensional vectors. Particularly, triangles and tetrahedrons are convex hulls.
Here are 18-dimensional natural vectors, and they are divided into several classes (families). Intuitively, the distribution of nucleotides from the same family is similar, and the 18-dimensional points from the same families lie closely. The sequence is transformed into an 18-dimensional numerical vector first, and the points from the same family can form a convex hull. Convex hull principle states that convex hulls corresponding to different families are mutually disjoint (Zhao et al., 2019).
Linear programming (LP) can be used to check whether two convex hulls are disjoint (Sun et al., 2021). If and intersect, then the convex combination of these points satisfy the formula: , where . or is an 18-dimensional natural vector. It means that the following linear programming problem has a feasible solution (That is, there are non-zero coefficients such that the minimum value of the optimization problem is 0):
(7)
The above problem can be implemented through linprog function built in MATLAB.
Results
Convex hull classification of archaea, bacteria, virus and fungi
The five datasets, archaea, bacteria, virus, fungi (genome), fungi (DNA barcode), are used for convex hull classification, and the necessity of adding extra six-dimensional nucleotide covariance component to 12-dimensional natural vector is verified. For each dataset, we first calculate the 12-dimensional or 18-dimensional natural vector to describe the distribution of each sequence, and construct convex hull for each family. Then the LP method is utilized to check whether the convex hulls of different families are disjoint. The comparison of classification performance between 12-dimensional natural vector and 18-dimensional natural vector is displayed in Table 2. For archaea dataset, there are 190 convex hull pairs, and 184 convex hull pairs are mutually disjoint in 12-dimensional space, while all pairs are disjoint in 18-dimensional space. For bacteria dataset, there are convex hull pairs, and 15,160 pairs are not intersected using 18-dimensional vector method. The non-intersection ratio in 18-dimensional space is 96.24%, which is larger than that in 12-dimensional space (92.46%). For virus dataset, there are 3,403 convex hull pairs. A total of 3,322 pairs are disjoint in 18-dimensional space, and 3,321 pairs are disjoint in 12-dimensional space. For both fungi (genome) and fungi (DNA barcode) datasets, the non-intersection ratios in 18-dimensional space are higher than those in 12-dimensional space. The results demonstrate that our new 18-dimensional natural vector performs better classification results than 12-dimensional natural vector. The 18-dimensional vector contains more sequence information because it considers the correlation relationships of the two nucleotides. The results of fungi (DNA barcode) dataset further show that covariance can be used not only for sequence classification at genome level, but also for sequence classification at gene sequence level.
Dataset | Convex hull pairs | 12-dim | 18-dim |
---|---|---|---|
Archaea | = 190 | 184 | 190 |
Bacteria | = 15,753 | 14,565 | 15,160 |
Virus | = 3,403 | 3,321 | 3,322 |
Fungi (Genome) |
= 231 | 207 | 227 |
Fungi (DNA barcode) | = 108,811 | 75,237 | 88,719 |
To visualize the convex hull classification results, we use the traditional support vector machine method (SVM) to reduce the dimension (Sun et al., 2021). For two disjoint convex hulls in 18-dimensional space, there is a hyperplane to separate them:
(8) is the normal vector, b is the offset item. There is at least a vector perpendicular to . For an 18-dimensional point, named in the convex hull, the new point projected into two-dimensional space is . Then the convex hull can be visualized in two-dimensional space. As shown in Fig. 1, we randomly select four disjoint convex hull pairs. Points from the same family gather together.
Figure 1: Convex hull pairs after dimension reduction by SVM method.
(A) Convex hull pair constructed by two bacterial families, Corynebacteriaceae (243 points) and Campylobacteraceae (305 points). (B) Convex hull pair constructed by two virus families, Geminiviridae (565 points) and Papillomaviridae (154 points). (C) Convex hull pair constructed by two archaea families, Thermococcaceae (37 points) and Sulfolobaceae (51 points). (D) Convex hull pair constructed by two fungi (DNA barcode) families, Saccotheciaceae (274 points) and Claroideoglomeraceae (301 points).Preliminary statistical analysis of the genomes of giant viruses
The research on phylogenetic relationship between giant virus and bacteria, archaea and other viruses is still active (Claverie & Abergel, 2013). The discovery of Mimivirus comes as a shock in biological field for a long time (Birtles, Rowbotham & Storey, 1997), and its genome is about 118 kbp (Didier, Stéphane & Catherine, 2004). Later viral genomes larger than 118 kbp started to accumulate quickly. This suggests that viruses with genomes larger than 118 kbp are not as exceptional as previously thought, especially Pandoravirus, which is discovered in recent years, with a length of more than 2,500 kbp (Philippe et al., 2013). Recent discoveries are not sufficient to erase the tremendous gap in genome size between giant viruses (Brandes & Linial, 2019), which is also reflected in Fig. 2. The x-axis represents the sequence number, the y-axis represents the genome size, and each dot represents a sequence. There are many gaps between genomes sizes of “Giant Virus” (blue color). Here “Giant Virus” only indicates the sequences of giant virus collected from two public databases (genome size > 170 kb). “Giant & RefSeq” indicates the sequences of giant virus collected from virus dataset (genome size > 170 kb). “Other Virus RefSeq” indicates the rest sequences in virus dataset except for giant virus. In Fig. 2A, there is a significant slope change at about 300 kbp, and the genome size of giant viruses is larger than that of other viruses (green color). In Fig. 2B, it is found that the genome sizes of several giant viruses and bacteria overlap at about 2,000 kbp, and the genome sizes of some viruses are larger than those of some bacteria. In Fig. 2C, the genome sizes of several giant viruses also overlap at about 2,000 kbp. Fig. 2 gives an intuitive understanding of the genome size relationship between giant virus and bacteria, archaea, other viruses. There is not yet any reason to believe that the genome size of giant viruses has reached the upper limit, and viruses with different genome lengths may emerge continuously (Claverie & Abergel, 2013). The origin of the giant virus still remains mysterious, so we can study it through the relationship between genomes of similar length.
Figure 2: Genome size distribution of giant viruses.
X-axis represents the number of the sequence, and Y-axis represents the genome size. Here “Giant Virus” only represents the sequences (genome size > 170 kb) of giant virus collected from two public databases. “Giant & RefSeq” represents the sequences (genome size > 170 kb) of giant virus collected from virus dataset. “Other Virus RefSeq” represents the rest sequences in virus dataset except for giant virus. (A) Genome size distribution of “Giant Virus”, “Giant & RefSeq” and “Other Virus RefSeq”. (B) Genome size distribution of bacteria, “Giant Virus” and “Giant & RefSeq”. (C) Genome size distribution of archaea, “Giant Virus” and “Giant & RefSeq”.We next make preliminary statistics on the gene distribution to understand the giant virus. All known giant viruses belong to the phylum Nucleocytoviricota (nucleocytoplasmic large DNA viruses, NCLDVs), which contains many unique genes that cannot be found in other life forms (Ogata, Toyoda & Tomaru, 2009). Here we only consider the coding sequence. We plot the number of NCLDV coding sequences on the y-axis, and the genome size on the x-axis. The results are shown in Fig. 3. The representative families of giant viruses, Mimiviridae and Pandoraviridae have larger genome size and more coding sequences (Mimiviridae: purple star, Pandoraviridae: black triangle). In addition, the G+C content of Pandoraviridae is the highest among NCLDVs (average 61.3%), and the earliest discovered virus group, Mimiviridae has the lowest G+C content (average 26.3%, Table S1).
Figure 3: Number of coding sequences of nucleocytoplasmic large DNA viruses.
Each dot represents a sequence. X-axis represents the genome size, and Y-axis represents the number of coding sequences of NCLDV. The representative families of giant viruses, Mimiviridae and Pandoraviridae have larger genome size and more coding sequences.Nearest neighbor classification of the genomes of giant viruses
The similarity of genomic distribution between giant viruses and bacteria, archaea, other viruses is of great importance to understand their phylogenetic relationship. We use a new 18-dimensional natural vector with covariance to measure it. There are 24,250 different biological sequences in these four datasets (Genomes of giant virus, bacteria, archaea, and virus), of which 677 sequences belong to 31 groups for giant virus dataset. Each sequence is converted into an 18-dimensional natural vector first. For each sequence in giant virus dataset, the closest sequence is then calculated and the sequence type is checked. The Euclidean distance between two 18-dimensional natural vectors is used to measure the biological similarity of the corresponding sequences. The nearest neighbor classification results are shown in Table 3.
Group name of large genome virus | Seq Nu. | Nearest type: Bacteria | Nearest type: Virus | SeqLen | ||||
---|---|---|---|---|---|---|---|---|
Max | Min | Mean | Median | |||||
1 | Polydnaviridae | 230 | 1 | 229 | 41,573 | 1,533 | 6,684 | 3,836 |
2 | Myoviridae | 138 | 67 | 71 | 4,97,513 | 170,286 | 229,450 | 191,652 |
3 | Phycodnaviridae | 82 | 76 | 6 | 1,473,573 | 171,045 | 362,340 | 329,946 |
4 | Mimiviridae | 59 | 59 | -- | 1,516,267 | 317,278 | 1,048,973 | 1,181,042 |
5 | Poxviridae | 39 | 34 | 5 | 359,853 | 170,560 | 244,824 | 224,499 |
6 | Alloherpesviridae | 20 | 17 | 3 | 295,146 | 171,096 | 224,435 | 223,830 |
7 | Herpesviridae | 17 | 12 | 5 | 233,501 | 171,823 | 203,228 | 204,237 |
8 | Marseilleviridae | 13 | 13 | -- | 386,631 | 360,610 | 370,058 | 369,360 |
9 | Pandoraviridae | 12 | 12 | -- | 2,473,870 | 1,676,110 | 2,058,604 | 2,015,816 |
10 | Iridoviridae | 10 | 10 | -- | 220,222 | 186,250 | 202,184 | 201,674 |
11 | Siphoviridae | 10 | 10 | -- | 279,967 | 185,683 | 223,445 | 219,073 |
12 | Faustovirus | 8 | 8 | -- | 470,659 | 455,803 | 464,660 | 465,984 |
13 | Nimaviridae | 7 | 7 | -- | 309,286 | 300,223 | 305,918 | 305,119 |
14 | Cedratvirus | 4 | 4 | -- | 589,068 | 560,887 | 578,546 | 582,115 |
15 | Pithoviridae | 3 | 3 | -- | 683,254 | 610,033 | 634,440 | 610,033 |
16 | Apis mellifera filamentous virus | 2 | 2 | -- | 496,396 | 496,396 | 496,396 | 496,396 |
17 | Ascoviridae | 2 | -- | 2 | 186,262 | 174,059 | 180,161 | 180,161 |
18 | Kaumoebavirus | 2 | 2 | -- | 350,731 | 350,731 | 350,731 | 350,731 |
19 | Lausannevirus | 2 | 2 | -- | 346,754 | 346,754 | 346,754 | 346,754 |
20 | Mollivirus | 2 | 2 | -- | 651,523 | 651,523 | 651,523 | 651,523 |
21 | Pacmanvirus | 2 | 2 | -- | 395,405 | 395,405 | 395,405 | 395,405 |
22 | Bamfordvirae | 2 | 2 | -- | 380,011 | 349,275 | 364,643 | 364,643 |
23 | Baculoviridae | 2 | -- | 2 | 178,733 | 176,677 | 177,705 | 177,705 |
24 | Asfarviridae | 1 | -- | 1 | 170,101 | 170,101 | 170,101 | 170,101 |
25 | Brazilian cedratvirus | 1 | 1 | -- | 460,038 | 460,038 | 460,038 | 460,038 |
26 | Brazilian Marseilleviridae | 2 | 2 | -- | 362,276 | 362,276 | 362,276 | 362,276 |
27 | Cannes 8 virus | 1 | 1 | -- | 374,041 | 374,041 | 374,041 | 374,041 |
28 | Glossinavirus | 1 | 1 | -- | 190,032 | 190,032 | 190,032 | 190,032 |
29 | Nudiviridae | 1 | 1 | -- | 231,621 | 231,621 | 231,621 | 231,621 |
30 | Insectomime | 1 | 1 | -- | 382,785 | 382,785 | 382,785 | 382,785 |
31 | Malacoherpesviridae | 1 | 1 | -- | 207,439 | 207,439 | 207,439 | 207,439 |
Except for Polydnaviridae and Myoviridae, the nucleotide distribution of most sequences is similar to that of bacteria . About half of the 138 Myoviridae sequences are close to the bacterial genomes (67 sequences) and half to the viral genomes (71 sequences). One of the reasons for this phenomenon is that the sequence length of Myoviridae is similar to that of some bacteria. Of the 230 Polydnaviridae sequences, 229 are closest to the virus sequence. These 230 sequences belong to two genera, Ichnovirus (IV) and Bracovirus (BV), and five species (Table S2). Glypta fumiferanae ichnovirus (GfIV) has 105 segments, which is the virus with the most segments among all segmented viruses. The segment length is about 2,777 bp, which is shorter than bacterial sequence. In addition, all sequences of three representative giant virus families, Mimiviridae, Marseilleviridae, and Pandoraviridae are closer to bacterial sequences.
Phylogenetic analysis of the genomes of giant viruses
Phylogenetic relationships between giant virus and bacteria, archaea, other viruses are studied using our new alignment-free method. We select three representative families from giant virus (Mimiviridae, Pandoraviridae, and Marseilleviridae) and randomly select two or three families from other three datasets to construct the phylogenetic tree. Figure 4 shows the phylogenetic tree of three other virus families (Adenoviridae, Anelloviridae, and Closteroviridae) and the three families of giant virus, different groups are marked in different colors. All groups are separate except Mimiviridae. To clearly observe the relationships between the three giant virus families, two bacterial families, Pseudomonadaceae and Alteromonadaceae are selected for further analysis. The phylogenetic result in Fig. 5 shows that all sequences from the same family are clustered except Mimiviridae. Beyond that, two archaea families, Methanosarcinaceae and Natrialbaceae are selected to construct the phylogenetic tree, the same family groups together except Mimiviridae is shown in Fig. 6. The algorithm of constructing the phylogenetic tree is unweighted pair-group method with arithmetic mean (UPGMA), which is an approach of constructing rooted tree based on distance matrix. The distance matrix is calculated using the commonly used Euclidean distance. In Figs. 4–6, the same 10 Mimiviridae species and Marseilleviridae species are clustered together. The sequence information is displayed in Table S3. The length of the 10 sequences is shorter than that of other viruses of Mimiviridae, but similar to some viruses of Marseilleviridae. The average sequence length of Marseilleviridae is about 370 kbp, that of Mimiviridae is about 1,000 kbp, and the length of 10 sequences is hundreds of thousands of bp.
Figure 4: Phylogenetic tree for the three representative families (Mimiviridae, Pandoraviridae, and Marseilleviridae) of giant virus and three other viral families (Adenoviridae, Anelloviridae, and Closteroviridae).
Different colors represent different families.Figure 5: Phylogenetic tree for the three representative families (Mimiviridae, Pandoraviridae, and Marseilleviridae) of giant virus and two bacterial families (Pseudomonadaceae and Alteromonadaceae).
Different colors represent different families.Figure 6: Phylogenetic tree for the three representative families (Mimiviridae, Pandoraviridae, and Marseilleviridae) of giant virus and two archaea families (Methanosarcinaceae and Natrialbaceae).
Different colors represent different families.To demonstrate the importance of natural vector with six-dimensional covariance component in characterizing biological sequence, we compare it with the traditional 12-dimensional natural vector and another alignment-free method, position natural vector (He et al., 2020) on the same three small datasets. The phylogenetic trees based on 12-dimensional natural vector are shown in Figs. S1 to S3. In Fig. S1, the sequences of Adenoviridae colored navy blue are not clustered together. In Fig. S2, there are two extra sequences from Mimiviridae clustered with Marseilleviridae. In Fig. S3, the sequences of Methanosarcinaceae are not grouped together. Additionally, the results of position natural vector method are shown in Figs. S4 to S6. In Fig. S4, a sequence from Marseilleviridae is incorrectly clustered with Mimiviridae. Figure S5 shows an unstable result compared with Fig. 5. In Fig. S6, the sequences of three families Methanosarcinaceae, Pandoraviridae, and Natrialbaceae are mixed. In conclusion, the tree based on our new 18-dimensional natural vector gives more reasonable and interpretable results.
Haursdorff distance can reflect the genetic distance between groups, and we want to analyze the interspecific differences of the above 10 families. Mathematically, Haursdorff distance is used to calculate the distance between point sets. If X and Y are two non-empty point sets, then the Haursdorff distance is defined as:
(9)
The distance calculation can be implemented through the code of the MathWorks community: https://ww2.mathworks.cn/matlabcentral/fileexchange/26738-hausdorff-distance. Each sequence is transformed into an 18-dimensional natural vector, then Haursdorff distance between groups is calculated, and UPGMA algorithm based on distance matrix is used to construct the tree, as shown in Fig. S7. Mimiviridae is marked with circles, and Marsellieviridae with triangles. Mimiviridae is closer to the root of the tree than Marsellieviridae.
Time and phylogeny comparison with previous covariance method
The previous study has shown that nucleotide covariance is related to the phylogenetics of fungi (Zhao, Tian & Yau, 2018), we redefine the nucleotide covariance to make it simpler and more general.
The previous covariance definition is:
(10)
are the position of k and l, respectively.
• If , .
• If (assume ), the covariance between A and any n values in B is computed and the average of these results is .
For a bacterial sequence (Accession number in Genbank is AP018515, sequence length is 3,041,114 bp), the number of nucleotide T is m = 723,764 and the number of nucleotide C is n = 799,865, the covariance of T and C using the previous definition is:
(11)
Suppose the positions of T and C are , respectively, then the covariance between A and any 723,764 values in B is computed and the average of these results is:
(12)
If the number of two nucleotides is quite different, the above formula (12) is too complicated and difficult to compute, which will take a lot of time to calculate. Our new nucleotide covariance definition is , there is no need to compute values, so the calculation of covariance takes less time.
We compare the running time of the two definitions using a sequence segment with a length of 90 bp (gaggaagtaaaagtcgtaacaaggtttccttccgggtgtagcacctgccgaagcctcccgcagcgactctaaagaaactgcgcagtctgc, a segment of a sequence whose accession number is DQ525472). The results are displayed in Fig. 7. The calculation time increases greatly with the increase of the sequence length for the previous covariance method, but is robust for our new method. It costs about 0.5 s to compute the previous covariance vector of a sequence with length 75 bp, which is much longer than that of our method (Fig. 7). While it only costs 0.017 s to compute our covariance vector of a sequence with length 813 bp (GenBank accession number is DQ525472).
Figure 7: The calculation time comparison of 18-dimensional natural vectors under the covariance definitions of this article and the previous study.
The previous covariance method is tested on the fungi DNA barcode dataset, so we also apply our method on the same dataset. To show that our method can also be used for phylogenetic analysis, we choose 311 nucleotide sequences of DNA barcode from nine species of fungi (Monosporascus cannonballus, Peniophorella praetermissa, Biatora helvola, Ceratobasidium cereale, Rhodotorula glutinis, Geosmithia landonii, Fusarium cf. solani, Acarospora smaragdula, Acaulospors kentinensis) to construct phylogenetic tree, as shown in Fig. S8. The nine groups can be separated based on our method, while a sequence from Peniophorella praetermissa doesn’t cluster together with Peniophorella praetermissa based on the previous covariance method.
Discussion
As a phylogenetic researcher with mathematical background, we propose a new alignment-free method to compare sequences from the perspective of statistics, which overcomes the shortcomings of high demand for computer experimental setup of the traditional alignment method. The new 18-dimensional natural vector method improves the 12-dimensional natural vector, and successfully numerically characterizes a large number of microbial genome data. In this way, each sequence corresponds to a point in 18-dimensional Euclidean space. The sequence similarity can be compared quickly and accurately. The traditional 12-dimensional natural vector only considers the distribution of a single nucleotide, but ignores the relationship between nucleotides. The new 18-dimensional natural vector method takes all these features into account, and contains the counts, average position and central moment of single nucleotide as well as the covariance between nucleotides. The rationality of the method is verified by testing on five datasets, archaea, bacteria, virus, fungi (genome), fungi (DNA barcode) using the convex hull classification. The results show that the six-dimensional covariance vector is a necessary condition to characterize the sequence. A further verification is performed on a special dataset, giant virus. The results show that the new 18-dimensional vector plays an important role in classification and evolution.
Many details of our article are worth discussing. First, the previous study has shown that the covariance between nucleotides is related to the phylogeny of fungi (Zhao, Tian & Yau, 2018). However, the limitation of the old covariance definition makes it difficult to calculate in a reasonable time if the number of two nucleotides in a sequence is quite different. Therefore, we propose a new and more natural covariance definition, which can be computed quickly. The new proposed method has obvious advantages in processing a large number of sequences and detecting the similarity and difference between sequences. Second, our proposed method has important practical significance in sequence alignment. For some sequence similarity search tools (For example, BLAST, MUSCLE), searching and aligning sequences will be very time-consuming (Figs. S9 and S10). The new method overcomes these shortcomings. It can not only naturally and effectively describe the distribution of four nucleotides, but also need less memory to store the 18-dimensional numerical vectors. Our method is promising for studying sequence alignment problems with large-scale data. Third, the microbial nucleotide sequences are utilized to verify the rationality of our new covariance definition. The data is abundant and easy to process, which is convenient for other researchers to repeat the experiment. The method can also be used for sequence comparison of other organisms, such as plants, vertebrates and invertebrates. It is beyond the scope of this article, we will study it in future work. Fourth, we use the convex hull classification results to show the necessity of six-dimensional covariance vectors in characterizing sequence. The results are reliable because the convex hull principle has strict theoretical supports: optimization background (Zhao, Tian & Yau, 2018), protein classification (Zhao et al., 2019) and the geometry construction of virus genome space (Sun et al., 2021). Fifth, we only use 18-dimensional natural vector to study the relationship of giant virus and bacteria, archaea, other viruses. Further studies can also be explored, for example, the geometric construction of genome space, evolution analysis. Sixth, the covariance definition of nucleotide can be extended to protein sequences. There are 20 amino acids: A, R, N, D, C, Q, E, G, H, I, L, K, M, F, P, S, T, W, Y, V. The natural vector with the covariance component of a protein sequence consists of four kinds of features including the counts ( ), the average positions ( ) and the central moment of position ( ) of the 20 amino acids as well as the covariance between different amino acids ( , k or l ):
So, the natural vector for a protein sequence is 250-dimensional, of which the covariance component is 190-dimensional. Seventh, we emphasize that dealing with the massive data sets and viewing biological problems from a mathematical perspective will lead to a deeper and more rapid understanding of their nature than relying solely on expensive experimentation. Because mathematicians may see some profound and unexpected structures and invent new mathematical methods to understand the high-dimensional properties and complex dynamics of biological problems (Zhao, Pei & Yau, 2020). Therefore, we propose a new mathematical numerical representation to describe the nucleotide distribution of sequences. Compared with direct (linguistic) method that avoid text conversion, for example, k-mer method, our method has two advantages: (1) It doesn’t depend on any assumption because there is no need to determine k. For a genome sequence, k-mer is a sequence segment of length k (Dai, Yang & Wang, 2008; Leimeister & Morgenstern, 2014). For each given k, the number of k-mer is fixed: 1-mers indicate A, C, G, T. Our method only considers the distribution of 1-mers; (2) It is more statistically significant than k-mers because we consider three features of 1-mers, even we can extend the definition by combining 18-dimensional vector and k-mers: k-mer natural vector. The distribution of 2-mers (2-mers include AA, AC, AG, AT, CA, CC, CG, CT, GA, GC, GG, GT, TA, TC, TG, TT) can be described as:
Therefore, our method gives a new mathematical framework to describe the distributions of k-mers, and it may be of great significance for the application of efficient and large-scale sequence alignment in the future.
Conclusions
In this article, a new six-dimensional covariance vector is proposed to reflect the correlation between nucleotides, which improves the traditional 12-dimensional natural vector. The new 18-dimensional natural vector is tested on six datasets, including five genome sequence datasets (archaea, bacteria, virus, fungi and giant virus) and one gene sequence dataset (fungi). First of all, we perform the convex hull classification. The results show that the classification performance of 18-dimensional natural vector is better than that of 12-dimensional vector, which verifies the necessity of 6-dimensional covariance vector in characterizing biological sequences. Furthermore, we study a special virus, giant virus. Statistical analysis gives us a preliminary understanding of the representative families of giant virus, Mimiviridae, Pandoraviridae and Marsellieviridae: Pandoravirus has the largest genome size and the most of the G+C content, Mimiviridae and Pandoraviridae have more coding sequences than other families. Then we analyze the relationship between giant viruses and bacteria, archaea, other viruses. Except for Polydnaviridae and Myoviridae, the nucleotide distribution of most sequences is similar to that of bacteria. And the phylogenetic trees show a stable result, that is, 10 sequences of Mimiviridae cluster with Marseilleviridae, and Mimiviridae is closer to the root of the tree than Marsellieviridae. While another alignment-free method, position natural vector, and 12-dimensional natural vector applied to the same dataset do not show stable results. Finally, we compare the time and phylogeny with the previous covariance definition. Our method needs less computation and memory, but gets accurate results. Our 18-dimensional natural vector is a powerful alignment-free method to characterize biological sequences.
Supplemental Information
Phylogenetic tree for the three representative families of giant viruses (Mimiviridae, Pandoraviridae, and Marseilleviridae) and three other viral families (Adenoviridae, Anelloviridae, and Closteroviridae) based on 12-dimensional natural vector.
Phylogenetic tree for the three representative families of giant viruses (Mimiviridae, Pandoraviridae, and Marseilleviridae) and two bacterial families (Pseudomonadaceae and Alteromonadaceae) based on 12-dimensional natural vector.
Comparison between BLAST and our method.
We select a viral genome sequence (Accession number in GenBank is NC_035619, sequence length is 30620 bp) and search its similar sequences.
(A) The parameters choice for the similar sequence search using BLAST (https://blast.ncbi.nlm.nih.gov/Blast.cgi). (B) Similar sequence search results using BLAST for the viral genome sequence (Accession number in GenBank is NC_035619). (C) The top ten similar sequences using our 18-dimensional natural vector method. Here the biological distance between two sequences is measured using the Euclidean distance of their corresponding 18-dimensional natural vectors, which is commonly used in our previous studies.
It takes about 20 min for BLAST to get three similar sequences (Accession number are NC_002685.2, NC_020074.1, and NC_004037.2) for the target sequence, and the percentage identities are 73.05%, 72.75%, and 73.76%, respectively (Figure S9B). Using our 18-dimensional natural vector method, it takes about 0.024914 s to get the similar sequences from our extracted Virus dataset (Table 2 in the main text). The top three similar sequences are the same using BLAST and our method, but our method runs faster. In addition, there is a sequence length limitation for BLAST, so it is inconvenient to search similar sequences for the bacterial genomic sequence. But our methods can deal with these sequences efficiently.
Comparison between MUSCLE and our method.
Fifteen DNA barcode sequences of fungi are selected to construct the phylogenetic tree.
(A) The phylogenetic tree using MUSCLE method (https://www.ebi.ac.uk/Tools/msa/muscle/). (B) The phylogenetic tree using our method. The algorithm to construct the phylogenetic tree is neighbor-joining (NJ), which is an approach based on distance to construct un-rooted tree. The distance matrix is calculated using the commonly used Euclidean distance.
Using our method, the two families, Glomerellaceae and Strophariaceae can be separated better. The reason is that our method is based on the distribution of nucleotides from the perspective of statistic. Furthermore, since there are many bacterial genomic sequences in our study, MUSCLE can’t get the phylogenetic results in a reasonable time. Therefore, our method is better than MUSCLE in some sense.
Phylogenetic tree for the three representative families of giant viruses (Mimiviridae, Pandoraviridae, and Marseilleviridae) and two archaea families (Methanosarcinaceae and Natrialbaceae) based on 12-dimensional natural vector.
Phylogenetic tree for the three representative families of giant viruses (Mimiviridae, Pandoraviridae, and Marseilleviridae) and three other viral families (Adenoviridae, Anelloviridae, and Closteroviridae) based on 18-dimensional position natural vector.
Phylogenetic tree for the three representative families of giant viruses (Mimiviridae, Pandoraviridae, and Marseilleviridae) and two bacterial families (Pseudomonadaceae and Alteromonadaceae) based on 18-dimensional position natural vector.
Phylogenetic tree for the three representative families of giant viruses (Mimiviridae, Pandoraviridae, and Marseilleviridae) and two archaea families (Methanosarcinaceae and Natrialbaceae) based on 18-dimensional position natural vector.
Phylogenetic tree for the viral, archaea and bacterial families based on Haursdorff distance and 18-dimensional Natural Vector algorithm. Mimiviridae is closer to the root of the tree than Marsellieviridae.
Phylogenetic tree of nine species of fungi.
(A) Phylogenetic tree of nine species of fungi based on our method. (B) Phylogenetic tree of nine species of fungi based on the previous correlation method.
The species information of Mimiviridae clustered with the viruses of Marseilleviridae.
The supplemental MATLAB code.
naturalvectordna: the function of the proposed 18-dimensional Natural Vector. intersection: the program aims to solve the linear programming problem.