Skip to content
This repository was archived by the owner on Oct 11, 2025. It is now read-only.

Home

Jump to bottom
Tom Kaitchuck edited this page Jul 30, 2015 · 10 revisions

Overview

The Google App Engine Pipeline API connects together complex, time-consuming workflows (including human tasks). The goals are flexibility, workflow reuse, and testability. A primary use-case of the API is connecting together various App Engine MapReduces into a computational pipeline.

Status

This project is open source and community-supported. Please join the mailing list to ask questions. There are implementations in both Python and Java.

Getting Started

  • Read the Getting Started guides for Python and Java to learn about the Pipeline API
  • Take a look at the Python or Java examples

Tutorial

A series of articles explaining the Python Pipeline API in tutorial fashion.

Screenshots

The Pipeline library includes a UI for debugging, which shows:

  • Status of the pipeline
  • Values of all parameters and returned values
  • Spawned children
  • Status message and links to consoles

Here is an example of a running pipeline with example console:

Status console

A Pipeline where all elements have completed

Completed job

Clone this wiki locally