Vis enkel innførsel

dc.contributor.authorMurphy, Mike
dc.contributor.authorBjørndalen, John Markus
dc.contributor.authorAnshus, Otto
dc.date.accessioned2020-08-18T11:18:57Z
dc.date.available2020-08-18T11:18:57Z
dc.date.issued2017-11-26
dc.description.abstract<p>Distributed version control systems are popular for storing source code, but they are notoriously ill suited for storing large binary files. <p>We report on the results from a set of experiments designed to characterize the behavior of some widely used distributed version control systems with respect to scaling. The experiments measured commit times and repository sizes when storing single files of increasing size, and when storing increasing numbers of single-kilobyte files. <p>The goal is to build a distributed storage system with characteristics similar to version control but for much larger data sets. An early prototype of such a system, Distributed Media Versioning (DMV), is briefly described and compared with Git, Mercurial, and the Git-based backup tool Bup. <p>We find that processing large files without splitting them into smaller parts will limit maximum file size to what can fit in RAM. Storing millions of small files will result in inefficient use of disk space. And storing files with hash-based file and directory names will result in high-latency write operations, due to having to switch between directories rather than performing a sequential write. <p>The next-phase strategy for DMV will be to break files into chunks by content for de-duplication, then re-aggregating the chunks into append-only log files for low-latency write operations and efficient use of disk space.en_US
dc.descriptionSource at <a href=https://ojs.bibsys.no/index.php/NIK/article/view/434>https://ojs.bibsys.no/index.php/NIK/article/view/434</a>.en_US
dc.identifier.citationMurphy, M. J., Bjørndalen, J. M. & Anshus, O. (2017). Scalability of Distributed Version Control Systems. NIK: Norsk Informatikkonferanse.en_US
dc.identifier.cristinIDFRIDAID 1522935
dc.identifier.issn1892-0713
dc.identifier.issn1892-0721
dc.identifier.urihttps://hdl.handle.net/10037/19015
dc.language.isoengen_US
dc.publisherNorsk informatikkonferanseen_US
dc.relation.journalNIK: Norsk Informatikkonferanse
dc.relation.projectIDinfo:eu-repo/grantAgreement/RCN/IKTPLUSS/270672/Distributed Arctic Observatory (DAO): A Cyber-Physical System for Ubiquitous Data and Services Covering the Arctic Tundra//en_US
dc.rights.accessRightsopenAccessen_US
dc.rights.holderCopyright 2017 The Authorsen_US
dc.subjectVDP::Teknologi: 500::Informasjons- og kommunikasjonsteknologi: 550en_US
dc.subjectVDP::Technology: 500::Information and communication technology: 550en_US
dc.titleScalability of Distributed Version Control Systemsen_US
dc.type.versionpublishedVersionen_US
dc.typeJournal articleen_US
dc.typeTidsskriftartikkelen_US


Tilhørende fil(er)

Thumbnail

Denne innførselen finnes i følgende samling(er)

Vis enkel innførsel