| 1 |
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" |
| 2 |
"http://www.w3.org/TR/REC-html40/loose.dtd"> |
| 3 |
<!-- This document was created with Latte version 2.1 --> |
| 4 |
<!-- For information on Latte, see http://www.latte.org/ --> |
| 5 |
<html> |
| 6 |
<head><meta name="generator" content="Latte 2.1"><title>distcc compared to other systems</title> |
| 7 |
<meta name="author" content="Martin Pool"> |
| 8 |
<meta name="keywords" content="distributed, make, build, gcc, |
| 9 |
parallel, network, networked, faster, free, fast, paralel, cc, c, |
| 10 |
C++, Objective C, ObjC, compile, compiler, compilation, |
| 11 |
simple, GPL, GNU, Linux, BSD, Unix, software, development, |
| 12 |
developer, TeamBuilder, quick, dmake, pvmake, |
| 13 |
transparent, easy, workstations, Solaris, IncrediBuild, |
| 14 |
productivity, speed, time, tool, performance, hardware, |
| 15 |
agents, nfs, libraries, source, headers, workload, |
| 16 |
buildfarm, farm, server, cluster, clustered, clustering, MOSIX, OpenMOSIX"> |
| 17 |
<link rel="SHORTCUT ICON" href="favicon.ico"> |
| 18 |
<link type="text/css" rel="stylesheet" href="distcc-green.css"> |
| 19 |
<link type="text/html" rel="top" href="index.html"> |
| 20 |
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1"></head> |
| 21 |
<body vlink="#003300" text="#000000" link="#003300" bgcolor="#ffffff" alink="#336633"><p><table width="100%"><tr><td valign="top"><div class="navbar"><ul> |
| 22 |
<li><a href="index.html">distcc</a></li> |
| 23 |
<li><a href="http://code.google.com/p/distcc/source/browse/trunk">source</a> |
| 24 |
<li><a href="http://code.google.com/p/distcc/downloads/list">binaries</a></li> |
| 25 |
<li><a href="http://distcc.googlecode.com/svn/trunk/NEWS">news</a></li> |
| 26 |
<li><a href="scenarios.html">scenarios</a></li> |
| 27 |
<li><a href="results.html">testimonials</a></li> |
| 28 |
<li><a href="benchmark.html">benchmarks</a></li> |
| 29 |
<li><a href="security.html">security</a></li> |
| 30 |
<li><a href="distcc-lca-2004.html">whitepaper</a></li> |
| 31 |
<li><a href="http://distcc.googlecode.com/svn/trunk/doc/web/man/">Man pages</a></li> |
| 32 |
<li><a href="faq.html">FAQ</a></li> |
| 33 |
|
| 34 |
<p> |
| 35 |
<li><a href="http://code.google.com/p/distcc/issues/list">report a bug</a></li> |
| 36 |
<li><a href="https://lists.samba.org/mailman/listinfo/distcc">mailing list</a> |
| 37 |
<ul><li><a href="mailto:[email protected]">post</a></li> |
| 38 |
<li><a href="http://lists.samba.org/archive/distcc/">archive</a></li> |
| 39 |
<li><a href="news://news.gmane.org/gmane.comp.compilers.distcc">newsgroup</a></li></ul> |
| 40 |
</li> |
| 41 |
<li><a href="http://freshmeat.net/projects/distcc">Freshmeat</a> |
| 42 |
<ul><li><a href="http://freshmeat.net/subscribe/28140">be notified</a></li></ul> |
| 43 |
</li> |
| 44 |
|
| 45 |
<p> |
| 46 |
<li>related:</li> |
| 47 |
<ul> |
| 48 |
<li><a title="How to use distcc and Gentoo" href="http://www.gentoo.org/doc/en/distcc.xml">Gentoo</a></li> |
| 49 |
<li><a title="Script to ease building cross-compilers and toolchains" href="http://kegel.com/crosstool/">crosstool</a></li> |
| 50 |
<li><a title="Cache compiler results" href="https://ccache.dev/">ccache</a></li> |
| 51 |
<li><a title="Centralized control over distcc and ccache" href="http://ccontrol.ozlabs.org/">ccontrol</a></li> |
| 52 |
<li><a title="Smart job scheduler" href="http://dmucs.sourceforge.net/">dmucs</a></li> |
| 53 |
</ul> |
| 54 |
<p><p></td> <td valign="top"><div class="body"><h1 class="title">distcc compared to other systems</h1> |
| 55 |
|
| 56 |
<p><h2><a name="summary" href="#summary">Summary</a></h2> |
| 57 |
|
| 58 |
<p>The main advantages of distcc compared to other tools are: |
| 59 |
|
| 60 |
<p><ul><li>distcc is free software under the GNU GPL.</li> |
| 61 |
|
| 62 |
<p><li>distcc is simple to install and configure.</li> |
| 63 |
|
| 64 |
<p><li>distcc can be installed by a non-root user, without requiring |
| 65 |
a kernel patch or any change to installed software or |
| 66 |
filesystems.</li> |
| 67 |
|
| 68 |
<p><li>distcc has very little impact on machines helping with the |
| 69 |
build.</li> |
| 70 |
|
| 71 |
<p><li>distcc doesn't require a shared filesystem.</li> |
| 72 |
|
| 73 |
<p><li>distcc can optionally use strongly encrypted and authenticated ssh |
| 74 |
channels for communication. In this mode it is |
| 75 |
<a href="security.html">safe</a> to use on untrusted networks.</li> |
| 76 |
|
| 77 |
<p><li>distcc can use machines with different processor architectures |
| 78 |
(i386, ppc, ...) or operating systems (Cygwin, Linux, BSD), if |
| 79 |
appropriate cross-compilers are installed. distcc runs on |
| 80 |
<a href="binaries.html">many operating systems and architectures</a>.</li> |
| 81 |
|
| 82 |
<p><li>distcc works reasonably even over wireless networks, when the |
| 83 |
LZO compression option is turned on.</li></ul> |
| 84 |
|
| 85 |
<p>The disadvantages of distcc are: |
| 86 |
|
| 87 |
<p><ul><li>distcc requires that the same compiler version be installed on all |
| 88 |
participating machines. (Every other distributed build system |
| 89 |
requires this too.)</li> |
| 90 |
|
| 91 |
<p><li>Only C/C++/ObjC/ObjC++ compilation can be distributed, not |
| 92 |
linking or other tasks. (Some clustering systems can |
| 93 |
distribute any task.)</li> |
| 94 |
|
| 95 |
<p><li>distcc comes with no warranty (as does most software), though |
| 96 |
it has been successfully used by many people for many |
| 97 |
years.</li></ul> |
| 98 |
|
| 99 |
|
| 100 |
<p><h2><a name="openmosix" href="#openmosix">OpenMOSIX</a></h2> |
| 101 |
|
| 102 |
<p><a href="http://www.openmosix.org/">OpenMOSIX</a> is a kernel-level |
| 103 |
single-image clustering system for Linux. It can be used to spread |
| 104 |
software builds or any other parallel task across multiple machines. |
| 105 |
|
| 106 |
<p>OpenMOSIX requires a kernel patch. All the machines must be of the |
| 107 |
same architecture and running similar kernels. |
| 108 |
|
| 109 |
<p>MOSIX and OpenMOSIX give you essentially a "single system image" |
| 110 |
cluster, which looks like a fast computer. distcc just looks like a |
| 111 |
fast compiler. |
| 112 |
|
| 113 |
<p>Some people have reported that distcc is much faster than OpenMOSIX |
| 114 |
for software builds in some situations. Short-lived, CPU-intensive |
| 115 |
compiler processes may be a very difficult load for a design based |
| 116 |
on process migration. |
| 117 |
|
| 118 |
<p>Other differences: |
| 119 |
|
| 120 |
<p><ul><li>You don't need root to install distcc</li> |
| 121 |
<li>Installing distcc doesn't require a kernel patch or reboot; |
| 122 |
presumably it can't destabilize anything else on the machine.</li> |
| 123 |
<li>distcc copes reasonably gracefully if a machine goes away |
| 124 |
abruptly or the network goes down; it will just keep compiling |
| 125 |
locally.</li> |
| 126 |
<li>distcc works (at least in theory) on any POSIX-like operating |
| 127 |
system, not just Linux, and on any processor. It has been |
| 128 |
reported to work on Linux, FreeBSD, HP-UX, Solaris, AIX and Cygwin, |
| 129 |
and you can spread load across machines using different systems. |
| 130 |
OpenMOSIX works only on Linux, and (perhaps?) only on x86 and IA-64.</li> |
| 131 |
<li>distcc volunteers can have different processor architectures |
| 132 |
or even operating systems to the machines they're serving. (You |
| 133 |
do need to install a cross compiler though.)</li> |
| 134 |
<li>distcc is only about 13000 lines of C, so you may find it |
| 135 |
easier to hack or patch.</li></ul> |
| 136 |
|
| 137 |
<p>Barnowl writes: |
| 138 |
|
| 139 |
<p><blockquote>Currently openMosix (oM) only runs on Linux and |
| 140 |
currently only on x86 and IA64 arch. distcc works like a champ when |
| 141 |
used combined with oM. While oM does help some with short run jobs, |
| 142 |
its forte is big computation jobs so it works better for things like |
| 143 |
video edits or DNA decoding. If you just want to speed up C compiles |
| 144 |
with out a lot of work or custom kernels distcc is the way to go.</blockquote> |
| 145 |
|
| 146 |
|
| 147 |
|
| 148 |
|
| 149 |
<p><h2><a name="cook" href="#cook">Cook</a></h2> |
| 150 |
|
| 151 |
<p><a href="http://www.canb.auug.org.au/~millerp/cook/cook.html">Cook</a> |
| 152 |
is a Make replacement written by Peter Miller and distributed under |
| 153 |
the GNU GPL. Cook can do parallel builds and has built-in support |
| 154 |
for distributing builds across machines on a LAN. |
| 155 |
|
| 156 |
<p>Using Cook requires you to convert your Makefiles to a <q>cookbook</q>, |
| 157 |
though there is a <q>make2cook</q> program to help with this. |
| 158 |
|
| 159 |
<p>Cook runs commands over <tt>rsh</tt> by default, but it seems like you |
| 160 |
could use <tt>ssh</tt> instead. Cook uses <tt>rup</tt> to calculate load |
| 161 |
on different machines. |
| 162 |
|
| 163 |
<p>It seems like Cook requires a shared filesystem and the same tools |
| 164 |
on all machines. There is a mechanism to group machines into |
| 165 |
classes and run particular commands on particular classes of |
| 166 |
machine. |
| 167 |
|
| 168 |
|
| 169 |
<p><h2><a name="pvmgmake" href="#pvmgmake">pvmgmake</a></h2> |
| 170 |
|
| 171 |
<p><a href="http://pvmgmake.sourceforge.net/">pvmgmake</a> is a fork of |
| 172 |
GNU Make which can spread tasks across multiple machines using the |
| 173 |
PVM protocol. |
| 174 |
|
| 175 |
<p>pvmgmake requires that all the machines see the same filesystem, and |
| 176 |
have the same tools installed. |
| 177 |
|
| 178 |
|
| 179 |
<p><h2><a name="xcode" href="#xcode">XCode</a></h2> |
| 180 |
|
| 181 |
<p>Apple <a href="http://developer.apple.com/documentation/DeveloperTools/Conceptual/Build_System/Dist_Builds/distributed_builds.html">XCode Distributed Build</a> is based on distcc. |
| 182 |
|
| 183 |
<p>Apple add patches for Rendezvous-based discovery of servers and |
| 184 |
transport of precompiled headers. These features may come back into |
| 185 |
the mainstream distribution in the future. Apple also add GUI to |
| 186 |
configure distcc, and support for some Apple-specific gcc features. |
| 187 |
|
| 188 |
<p>Apple's tools only work on Mac OS X. |
| 189 |
|
| 190 |
<p>The Apple version at the moment does not seem to support LZO or SSH.</div></td> |
| 191 |
</tr></table> |
| 192 |
<div class="thanks">Copyright © 2002–2004 Martin Pool. |
| 193 |
distcc is a trademark of Martin Pool. |
| 194 |
|
| 195 |
<p>Send comments to <tt>distcc(at)lists.samba.org</tt>, |
| 196 |
or talk to us on <tt>#distcc</tt> on <a href="http://oftc.net/">irc.oftc.net</a>.</div></body> |
| 197 |
</html> |