{"id":2276,"date":"2023-08-10T09:51:00","date_gmt":"2023-08-10T08:51:00","guid":{"rendered":"https:\/\/blogs.qub.ac.uk\/dipsa\/?p=2276"},"modified":"2024-06-20T16:29:18","modified_gmt":"2024-06-20T15:29:18","slug":"ms-biographs-ms200","status":"publish","type":"post","link":"https:\/\/blogs.qub.ac.uk\/dipsa\/ms-biographs-ms200\/","title":{"rendered":"MS-BioGraphs MS200"},"content":{"rendered":"\n

<\/p>\n\n\n\n\n\t\t

\n\t\n
Name<\/td>MS-BioGraphs – MS200<\/td><\/tr>\n
URL<\/td>https:\/\/blogs.qub.ac.uk\/DIPSA\/MS-BioGraphs-MS200<\/a><\/td><\/tr>\n
Download Link<\/td>https:\/\/doi.org\/10.21227\/gmd9-1534<\/a><\/td><\/tr>
Script for Downloading All Files<\/td>https:\/\/blogs.qub.ac.uk\/DIPSA\/MS-BioGraphs-on-IEEE-DataPort\/<\/a><\/td><\/tr>
Validating and Sample Code<\/td>https:\/\/blogs.qub.ac.uk\/DIPSA\/MS-BioGraphs-Validation\/<\/a><\/td><\/tr>
Graph Explanation<\/td>Vertices represent proteins and each edge represents the sequence similarity between its two endpoints<\/td><\/tr>
Edge Weighted<\/td>Yes<\/td><\/tr>\n
Directed<\/td>No<\/td><\/tr>\n
Number of Vertices<\/td>1,414,493,449<\/td><\/tr>\n
Number of Edges<\/td>502,930,788,612<\/td><\/tr>\n
Maximum Degree<\/td>745,735<\/td><\/tr>\n
Minimum Weight<\/td>460<\/td><\/tr>\n
Maximum Weight<\/td>634,925<\/td><\/tr>\n
Number of Zero-Degree Vertices<\/td>0<\/td><\/tr>\n
Average Degree<\/td>355.6<\/td><\/tr>\n
Size of The Largest WCC<\/td>485,867,547,569<\/td><\/tr>\n
Number of WCC<\/td>338,348,495<\/td><\/tr>\n
Creation Details<\/td>MS-BioGraphs: Sequency Similarity Graph Datasets<\/a><\/td><\/tr>
Format<\/td>WebGraph<\/a><\/td><\/tr>
License<\/td>CC BY-NC-SA<\/td>
QUB IDF<\/td>2223-052<\/td><\/tr>\n
DOI<\/td>10.5281\/zenodo.7820812<\/a><\/td><\/tr>\n
Citation<\/td>
Mohsen Koohi Esfahani, Sebastiano Vigna, \nPaolo Boldi, Hans Vandierendonck, Peter Kilpatrick, March 13, 2024, \n\"MS-BioGraphs: Trillion-Scale Sequence Similarity Graph Datasets\", \nIEEE Dataport, doi: https:\/\/doi.org\/10.21227\/gmd9-1534.<\/pre><\/td><\/tr>\n
Bibtex<\/td>
@data{gmd9-1534-24,\ndoi = {10.21227\/gmd9-1534},\nurl = {https:\/\/doi.org\/10.21227\/gmd9-1534},\nauthor = {Koohi Esfahani, Mohsen and Vigna, Sebastiano and Boldi, \nPaolo and Vandierendonck, Hans and Kilpatrick, Peter},\npublisher = {IEEE Dataport},\ntitle = {MS-BioGraphs: Trillion-Scale Sequence Similarity Graph Datasets},\nyear = {2024} }<\/pre><\/td><\/tr>\n<\/table>

Files<\/h2>\n\n\t\t\n\t\t\t\n\t\t\t\n\t\t\t\n\t\t\t\n\t\t\t\n\t\t\t\n\t\t\t\t\n\t\t\t
Underlying Graph<\/td>\n\t\t\t\n\t\t\t\tThe underlying graph in WebGraph format: \n\t\t\t\t
    \n\t\t\t\t\t
  • File: MS200-underlying.graph, Size: 1,459,981,767,426 Bytes<\/li>\n\t\t\t\t\t
  • File: MS200-underlying.offsets, Size: 3,174,012,489 Bytes<\/li>\n\t\t\t\t\t
  • File: MS200-underlying.properties, Size: 1,515 Bytes<\/li>\n\t\t\t\t\t\n\t\t\t\t<\/ul>\n\t\t\t\tTotal Size: 1,463,155,781,430 Bytes
    \n\t\t\t\tThese files are validated using ‘Edge Blocks SHAs File’ as follows.\n\t\t\t<\/td>\n\t\t<\/tr>\n\n\t\t
Weights (Labels)<\/td>\n\t\t\t\n\t\t\t\tThe weights of the graph in WebGraph format: \n\t\t\t\t
    \n\t\t\t\t\t
  • File: MS200-weights.labels, Size: 1,199,053,831,206 Bytes<\/li>\n\t\t\t\t\t
  • File: MS200-weights.labeloffsets, Size: 3,090,041,102 Bytes<\/li>\n\t\t\t\t\t
  • File: MS200-weights.properties, Size: 186 Bytes<\/li>\n\t\t\t\t<\/ul>\n\t\t\t\tTotal Size: 1,202,143,872,494 Bytes
    \n\t\t\t\tThese files are validated using ‘Edge Blocks SHAs File’ as follows.\n\t\t\t<\/td>\n\t\t<\/tr>\n\n\t\t
Edge Blocks SHAs File (Text) <\/td>\n\t\t\t\n\t\t\t\tThis file contains the shasums of edge blocks where each block contains \n\t\t\t\t64 Million continuous edges and has one shasum for its 64M endpoints and \n\t\t\t\tone for its 64M edge weights. 
\n\t\t\t\tThe file is used to validate the underlying graph and the weights.\n\t\t\t\tFor further explanation about validation process,  please visit\n\t\t\t\tthe \n\t\t\t\thttps:\/\/blogs.qub.ac.uk\/DIPSA\/MS-BioGraphs-Validation<\/a>.\n\n\t\t\t\t
    \n\t\t\t\t\t
  • Name: MS200_edges_shas.txt<\/li>\n\t\t\t\t\t
  • Size: 899,640 Bytes<\/li>\n\t\t\t\t\t
  • SHASUM: 5bb635fc94aea3ee7b2b6a4aecbbb1fc6f77e1b5<\/li>\n\t\t\t\t\t\n\t\t\t\t<\/ul>\n\t\t\t<\/td>\n\t\t<\/tr>\n\n\t\t
Offsets (Binary)<\/td>\n\t\t\t\n\t\t\t\tThe offsets array of the CSX (Compressed Sparse Rows\/Columns) graph in binary \n\t\t\t\tformat and little endian order. It consists of |V|+1 8-Bytes elements. 
\n\t\t\t\tThe first and last values are 0 and |E|, respectively.
\n\t\t\t\tThis array helps converting the graph (or parts of it) from WebGraph format \n\t\t\t\tto binary format by one pass over (related) edges.
\n\t\t\t\t
    \n\t\t\t\t\t
  • Name: MS200_offsets.bin<\/li>\n\t\t\t\t\t
  • Size: 11,315,947,600 Bytes<\/li>\n\t\t\t\t\t
  • SHASUM: 9192158aab65e1ca536a46183411d87452cd9ee3<\/li>\n\t\t\t\t\t\n\t\t\t\t<\/ul>\n\t\t\t<\/td>\n\t\t<\/tr>\n\n\t\t
WCC (Binary)<\/td>\n\t\t\t\n\t\t\t\tThe Weakly-Connected Compontent (WCC) array in binary format and little endian order.
\n\t\t\t\tThis array consists of |V| 4-Bytes elements\n\t\t\t\tThe vertices in the same component have the same values in the WCC array.
\n\t\t\t\t
    \n\t\t\t\t\t
  • Name: MS200-wcc.bin<\/li>\n\t\t\t\t\t
  • Size: 5,657,973,796 Bytes<\/li>\n\t\t\t\t\t
  • SHASUM: 027e1b826659b5ec0f62921a4eb3ecd6c83fa76a<\/li>\n\t\t\t\t\t\n\t\t\t\t<\/ul>\n\t\t\t<\/td>\n\t\t<\/tr>\n\n\t\t
Names (tar.gz) <\/td>\n\t\t\t\n\t\t\t\tThis compressed file contains 120 files in CSV format using ‘;’ as the separator.\n\t\t\t\tEach row has two columns: ID of vertex and name of the sequence.
\n\t\t\t\tNote: If the graph has a ‘N2O Reordering’ file, the n2o array should \n\t\t\t\tbe used to convert the vertex ID to old vertex ID which is used for identifying\n\t\t\t\tname of the protein in the `names.tar.gz` file.\n\t\t\t\t\n\t\t\t\t
    \n\t\t\t\t\t
  • Name: names.tar.gz<\/li>\n\t\t\t\t\t
  • Size: 27,130,045,933 Bytes<\/li>\n\t\t\t\t\t
  • SHASUM: ba00b58bbb2795445554058a681b573c751ef315<\/li>\n\t\t\t\t\t\n\t\t\t\t<\/ul>\n\t\t\t<\/td>\n\t\t<\/tr>\n\n\t\t\t
N2O Reordering (Binary)<\/td>\n\t\t\t\t\n\t\t\t\t\tThe New to Old (N2O) reordering array of the graph in binary format and little endian order.
\n\t\t\t\t\tIt consists of |V| 4-Bytes elements and identifies the old ID of each vertex\n\t\t\t\t\twhich is used in searching the name of vertex (protein) in the names.tar.gz file .\n\t\t\t\t\t
    \n\t\t\t\t\t\t
  • Name: MS200-n2o.bin<\/li>\n\t\t\t\t\t\t
  • Size: 5,657,973,796 Bytes<\/li>\n\t\t\t\t\t\t
  • SHASUM: de833f1c36011af07c165f53760b82a49715537d<\/li>\n\t\t\t\t\t\t\n\t\t\t\t\t<\/ul>\n\t\t\t\t<\/td>\n\t\t\t<\/tr>\n\n\t\t
OJSON<\/td>\n\t\t\t\n\t\t\t\tThe charactersitics of the graph and shasums of the files.
\n\t\t\t\tIt is in the open json format and needs a closing brace (}) to be appended\n\t\t\t\tbefore being passed to a json parser.\n\n\t\t\t\t