InfoQ

InfoQ

News

My Bookmarks

Login or Register to enable bookmarks for unlimited time.

The content has been bookmarked!

There was an error bookmarking this content! Please retry.

Article: Distributed Version Control Systems - a guide

Posted by Niclas Nilsson on May 09, 2008

Sections
Process & Practices,
Architecture & Design
Topics
Agile ,
Technology ,
Collaboration ,
Architecture ,
Teamwork
Tags
Version Control ,
Mercurial ,
CVS ,
git ,
VCS ,
Subversion ,
DVCS

Article: Distributed Version Control Systems

Since Linus Torvalds presentation at Google about git in May 2007, the adoption and interest for Distributed Version Control Systems has been constantly rising. In this article, Sebastien Auvray introduces the concept of Distributed Version Control, see when to use it, why it may be better than what you’re currently using, and have a look at three actors in the area: git, Mercurial and Bazaar.

Sebastien start out by comparing Distributed Version Control Systems with Centralized VMS:es:

Or a more precise question: Why Central VCS (and notably Subversion) are not satisfying? Several things are blamed on Subversion:

* Major reason is that branching is easy but merging is a pain (but one doesn't go without the other). And it's likely that any consequent project you'll work on will need easy gymnastic with splits, dev, test branches. Subversion has no History-aware merge capability, forcing its users to manually track exactly which revisions have been merged between branches making it error-prone.
* No way to push changes to another user (without submitting to the Central Server).
* Subversion fails to merge changes when files or directories are renamed.
* The trunk/tags/branches convention can be considered misleading.
* Offline commits are not possible.
* .svn files pollute your local directories.
* svn:external can be harmful to handle.
* Performance

After that, Sebastien moves on to describe how DVCS works, which the open source options are, before he comes to the an excellent comparison between git, Mercurial and Bazaar. The comparison includes things line features, model, web access, integration, performance, hosting options and many other things.

If you’re having trouble deciding which DVCS to pick, this is the article for you.

  • This article is part of a featured topic series on Agile

Related Sponsor

In today’s hyper-competitive world, later may be too late to adopt Agile development and this Roadmap for Success will help you get started. Download "Agile Development: A Manager's Roadmap for Success" now!

28 comments

Watch Thread Reply

Issue Tracker Integration for git by Roman Heinrich Posted
Excellent article by Surya De Posted
Kind of.... by chris songer Posted
Re: Kind of.... by Sebastien Auvray Posted
Re: Kind of.... by sax maniac Posted
Outstanding breakdown by Kurt Christensen Posted
my 2c by Bela Babik Posted
BitKeeper by Robert Sullivan Posted
SVK - Subversion decentralized - http://svk.bestpractical.com/view/HomePage by Ludolph Neethling Posted
Rebase plugin available for Bazaar by Jelmer Vernooij Posted
Re: Rebase plugin available for Bazaar by Sebastien Auvray Posted
Top mark against Subversion going away by Ray Davis Posted
git repository size by dhamma vicaya Posted
SVK by Seurin Jean Posted
Usability/colour impairment by Damien Warman Posted
Article Updated by Sebastien Auvray Posted
Good but... by David H. Posted
Choices by Bruno Vernay Posted
Update on Bazaar performance by Ian Clatworthy Posted
Branches in Hg are supported by Stepan Koltsov Posted
MySQL uses Bazaar by Robin St Posted
history model by bgeron bgeron Posted
Re: history model by Bhaskar Rimal Posted
Re: history model by Sebastien Auvray Posted
Re: history model by bhaskar rimal Posted
Revision naming in Mercurial by Dirkjan Ochtman Posted
Re: Revision naming in Mercurial by Mark Anderson Posted
You forgot git-bisect. by John Q. Public Posted
  1. Back to top

    Issue Tracker Integration for git

    by Roman Heinrich

    Git integrates well with Readmine (www.redmine.org/), a Rails-based Issue Tracker. Just had to add this one ;)

  2. Back to top

    Excellent article

    by Surya De

    I thoroughly enjoyed this. And I learned a lot from this as well. Somehow our switch from CVS to Subversion makes less sense now after reading this.

  3. Back to top

    Kind of....

    by chris songer

    The problem with this analysis, and those like it, is that they assume SVN as the state of the art. SVN is the state of the "free" art; but is missing a lot of features that perforce offers.

    Now Perforce is pretty costly, but when broadly comparing "centralized vs. decentralized" it's probably not quite on target to use the "best free" rather than the "best." Many of the issues cited (and thereby implied to be issues with centralized solutions)

    For example, perforce does not pollute your directories with control files. Perforce does a fantastic job of maintaining merges between branches and keeping merge history.

    Indeed, most of the arguments put forward against "central" tend to be limitations in the SVN implementation of centralized SCM rather than limitations in the state of the art.

  4. Back to top

    Outstanding breakdown

    by Kurt Christensen

    Dude, this was a very, very nice article. Thanks for the rollup.

  5. Back to top

    Re: Kind of....

    by Sebastien Auvray

    Hi Chris,
    I agree with you that Perforce got some good points that SVN do not support. But as you said 1) you need to pay for it 2) you really need to take a big care of your production scalability (as any central server...) else it's becoming a big bottleneck and you're blocked at each branch creation... Some Editors like Idea add some intelligence to that like adding the Offline mode.

  6. Back to top

    my 2c

    by Bela Babik

    DVCS's are young, but very capable. They are rather tools not systems to manage the code. Users need to come up with their own workflow and thats what a lot of them do not get.

    It can be frustrating when someone tries out one of them and it seems complicated after CVS/SVN. The benefits are not so obvious (what are the benefits for a developer who has never ever did any branching and merging in CVS/SVN?).


    > Mercurial SLOC (without Test src)
    Mercurial's core is python + c only (there are 4 c files).

    What I don't like about Git:
    - is that it is a mess. c+perl+bash
    - my environment is polluted by it really hardly (at least in msys git, there are huge amount of aliases)
    - native windows port is really far from being production ready. (I can not even use it from behind firewall.)

    What I don't like about Mercurial:
    - tree handling is not really good. It's not an easy call to implement it right, but it is important.
    - editing of the history is considered harmful and not really supported (can be done though through extensions, but not as nice as in git)

    What I like about Mercurial:
    - hgbook is awesome
    - easy to extend (the included extensions are good starting point)
    - clean python
    - very flexible, you can build nice workflows around it
    - mq is evil but very handy once you understand what and how is it doing

  7. Back to top

    BitKeeper

    by Robert Sullivan

    Great article, nice comparison & research. I've been very interested in BitKeeper and git since reading about the controversy with Linux. Very cool idea, and if anyone's interested there is some very good doc out there explaining how BitKeeper works.

    And I find it amazing that when Larry McEvoy pulled the plug on the Linux licenses, Linus (or someone) shook git out of their sleeve in a short time. Impressive.

    Now that said, Torvalds has an incredible knack for saying incredibly insulting comments. SVN is pointless? When 59% of git users also use SVN or CVS? and anyone who uses CVS is stupid - uh - this coming from someone who didn't use *any* version control until forced to do so because it was impacting the work on Linux? Now that was nuts. Now, SCM is a given, CVS is probably one of the grandaddy, we stand on the shoulders of giants. And SVN's aim was to fix issues with CVS, nothing more, isn't git pretty much a clone of BitKeeper, like Linux a clone of Unix? Hopefully for Linus, the successors to Linux will have a more admirable view of their forebearers.

  8. Back to top

    SVK - Subversion decentralized - http://svk.bestpractical.com/view/HomePage

    by Ludolph Neethling

    Thanks for the informing article. Another option for a DVCS maybe SVK. I haven't tried it myself, so feedback or a review of SVK would be appreciated.



    Copied from wikipedia:



    "SVK (also written svk) is a decentralized version control system written in Perl, with a hierarchical distributed design comparable to centralized deployment of BitKeeper and GNU arch.



    SVK uses the Subversion filesystem but provides additional features:

    * Offline operations like checkin, log, merge.

    * Distributed branches.

    * Lightweight checkout copy management (no .svn directories).

    * Advanced merge algorithms, like star-merge and cherry picking.

    * Changeset signing and verification.

    * Can mirror and operate on Subversion, Perforce and CVS repositories.
    "



    I do think it addresses some of the problems of subversion, but seeing I haven't used it I don't know what new problems it creates.



    Regards,

  9. Back to top

    Rebase plugin available for Bazaar

    by Jelmer Vernooij

    Your overview lists Bazaar as not having support for Rebase and queues. However, there is a rebase plugin available for Bazaar ( bazaar-vcs.org/Rebase) and a queues one (launchpad.net/bzr-loom).

  10. Back to top

    Re: Rebase plugin available for Bazaar

    by Sebastien Auvray

    Hi Jelmer,

    You're right, I'll update this asap.

    I'll also take into consideration some interesting remarks from reddit.

    Thanks.

  11. Back to top

    Top mark against Subversion going away

    by Ray Davis

    Nice overview, thanks. One thing, though -- the "major reason" you list for moving from Subversion is the difficulty of merging, but history-aware merge is the major improvement being delivered in Subversion 1.5. That's mentioned in the pages you link to at the end of your article, but given the importance attached to the feature, I thought it might be worth calling out.

  12. Back to top

    git repository size

    by dhamma vicaya

    git gc by default uses a conservative window size to save memory. For relatively large import from foreign repositories you should run:

    git repack -a -f -d --window=100 --depth=100

    A couple of times until the repository doesn't get any smaller.

  13. Back to top

    SVK

    by Seurin Jean

    Being a novice in the matter, I'd be very interested in having some feedback on how SVK compare to the mentioned DVCS.
    I had identified it as a potential solution to solve my SVN problems, mainly off-line commits and .svn file.

    I'm very happy for the new perspectives the articles gave me. Thanks for the hard work!

  14. Back to top

    Usability/colour impairment

    by Damien Warman

    This otherwise rather interesting article is for me and for more than 10% of readers fatally undermined by the choice to use generic icons differing only in red/green colour choice in the first comparison table. Simple check/dash/x symbology, or even a tooltip, would dramatically increase its usefulness.

  15. Back to top

    Article Updated

    by Sebastien Auvray

    [Article updated on 20080512 according to the comments here and from Ian Clatworthy and reedit]:



    • * Bzr plugins and Windows Gui added: rebase, ..., Wildcat BZR, ...

    • * Hg Shelve added.

    • * SLOC for Hg updated (HTML doc used to be counted, I kept contrib which is responsible for the presence of Lisp and Tcl/Tk).

    • * Repository size for git updated after doing proper repack command (<code>git repack -a -f -d --window=100 --depth=100</code> until size becomes constant) (Thanks to the comment by dhamma vicaya).

  16. Back to top

    Good but...

    by David H.

    Hello.
    A nice article, but I am a bit disappointed. First of all there is no mention of www.monotone.ca/ which is a well recognised DVCS now-a-days. It also fails to mention that git traditionally is fastest because on linux good old Linus Torvalds is using all the low level filesystem tricks you can possibly think off.

  17. Back to top

    Choices

    by Bruno Vernay

    @Perforce : That's why Open Source (and free beer) is relevant : you get considered.


    Developer's choices are not based on which is best, but what is my community using, as the author noticed :

    it seems as if some choices have emerged based on the language used by the communities: Java / Sun related developments seem to be interested more in Mercurial while C / Linux / Ruby / Rails related projects are attracted by git.

    But overall, the point is that your SCM tool should support your workflow and processes. It maybe be easier to change the tool than it is to change the processes.

  18. Back to top

    Update on Bazaar performance

    by Ian Clatworthy

    My measurements have 'bzr clone master feature-1' coming in around 22 secs. A patch is available to reduce this to 16 secs. See this email for further details.


    If you want to save further time and space when cloning in Bazaar, use the --hardlink option. It cuts the time to 11.2 secs (vs 11.1 secs for git on my computer) and reduces space usage across the working trees, which is where most of the disk space get consumed in tools as efficient at historical storage as these.

  19. Back to top

    Branches in Hg are supported

    by Stepan Koltsov

    Seems like branches are supported in hg:

    hgbook.red-bean.com/hgbookch8.html

  20. Back to top

    MySQL uses Bazaar

    by Robin St

    There's now a big project which decided to use Bazaar, namely MySQL. Here's the announcement.

  21. Back to top

    history model

    by bgeron bgeron

    Sorry, but the history model for Mercurial is the same as for Git and Bazaar. A changeset/changegroup/commit/revision is in all systems a name for a snapshot. :)

  22. Back to top

    Re: history model

    by Bhaskar Rimal

    This is very impressive article and good analysis.Actually I want to know could anyone can explain about DVCS by UML diagram of its every process and steps so that I can understand all its micro process as visually.

  23. Back to top

    Re: history model

    by Sebastien Auvray

    Hi Bhaskar,
    It's very difficult to gather information on the micro process from the various VCS available. I can only advise you Scott Chacon presentation about Git at RailsConf and its slides.

  24. Back to top

    Re: history model

    by bhaskar rimal

    Thank you very much

  25. Back to top

    Revision naming in Mercurial

    by Dirkjan Ochtman

    There's been some confusion among people who think Mercurial doesn't use SHA1 for revision identification, because this article suggests its naming is simpler. While we gladly accept the notion that our revision identification scheme is simpler to use than that of other DVCSs, it's still fundamentally based on SHA1 hashes. Please note this in the table, if you can.

  26. Back to top

    Re: Revision naming in Mercurial

    by Mark Anderson

    As much as I appreciated articles like this in the past, I must say we did ourselves a favor by skipping the interim solution of going from CVS and VSS to another open source tool and chose what we believe is the last tool we'll have to use, period. www.accurev.com I just don't get what all the excitement is over a 'free' tool that will only lead to more problems down the road?

  27. Back to top

    You forgot git-bisect.

    by John Q. Public

    Generally a very good article. But...

    Widely considered one of Git's killer features, git-gisect is worth mentioning.

    Basically, it automates searching through the revision history for a version that introduced a regression. Git's speed lets you make frequent small commits, so the change that introduced the regression can be very small, and the result is the problem is easy to spot.

    For distributed development, it's particularly nice because it lets even a relatively unskilled tester find the exact commit that introduced the regression and send the complaint straight to the relevant developer.

    (It has, of course, been copied by Hg and bzr, so it's no longer unique to git. Still something well worth knowing about.)

  28. Back to top

    Re: Kind of....

    by sax maniac

    But centralization is the main weakness of Perforce - you cannot work while you are offline as you need to check out files on the server, which is unneeded and annoying. That is why SVN beats Perforce (from developer point of view).

Educational Content

10 tips on how to prevent business value risk

One category of risk that project teams need to ensure they address is business value failure – delivering a product that fails to provide value for the business investor.

Interview: Software Systems Architecture: Working With Stakeholders Using Viewpoints and Perspectives

InfoQ spoke to the authors of Software Systems Architecture on a couple of new topics, the System Context viewpoint and Agile, which have been added to the second edition.

Beauty Is in the Eye of the Beholder

Alex Papadimoulis discusses ugly code, where it comes from, how to avoid it, and how to get rid of it.

Architecting Visa for Massive Scale and Continuous Innovation

John Davies examines Visa’s architecture and shows how enterprises have architected complex integrations incorporating Hadoop, memcached, Ruby on Rails, and others to deliver innovative solutions.

Max Protect: Scalability and Caching at ESPN.com

Sean Comerford unveils ESPN.com’s architecture, what components are used and why, and the current changes the website goes through.

The Seven Deadly Sins of Enterprise Agile Adoption

Are there repeated patterns of failure on Enterprise Agile Enablement efforts? Sanjiv and Arlen discuss Seven Deadly Sins to avoid when adopting Agile in an enterprise.

Questions for an Enterprise Architect

Erik Dörnenburg answers: What is Enterprise and Evolutionary Architecture?, discussing 4 issues: Turning strategy into execution, Ensuring conformance, Where do the architects sit? Buying or building?

Wrap Your SQL Head Around Riak MapReduce

Sean Cribbs explains what Map-Reduce and Riak are, why and how to use Map-Reduce with Riak, and how to convert SQL queries into their Map-Reduce equivalents.