eHive production system
A big fraction of Ensembl's computation pipelines are run using eHive (Ensembl Hive) distributed scheduling system.
The main goal behind creating it was to enable efficient parallel computation on Unix clusters using a simple Perl API.
Recently eHive code was detached from Ensembl codebase and can now be used as a separate product by those who need to run computational pipelines.
Code and documentation
eHive system is hosted on GitHub together with its recently updated documentation (see docs/index.html).
guiHive is a Web app that helps both to visualize the progress of an eHive pipeline and to tune some parameters of the already running computations. It is also hosted on GitHub and has its own documentation (in README.md).