The International Planning Competition has been a bi-annual event, hosted at the Artificial Intelligence Planning and Scheduling Conference series. The objectives of the competition are to provide a forum for empirical comparison of planning systems, to highlight challenges to the community in the form of problems at the edge of current capabilities, to propose new directions for research and to provide a core of common benchmark problems and a representation formalism that can aid in the comparison and evaluation of planning systems. Although the series has a competitive style (individual systems are identified for exceptional performance at the event itself), the focus is on data-collection and presentation, with interpretation of results being understated. The real goal of the competition is to make as much data as possible available to the community.
The competition event began in 1998 when Drew McDermott and a committee created a common specification language (PDDL) and a collection of problems forming a first benchmark. Five systems participated in the competition. In 2000, Fahiem Bacchus continued this work, and the event attracted 16 competitors. The event was extended to include both fully automatic and hand-tailored planning systems. Both STRIPS and ADL domains were used but no further extensions were made to the language. In 2002, the competition was run by Derek Long and Maria Fox. The event attracted 14 competitors, and focussed on planning in temporal and metric domains. McDermott's PDDL was not expressive enough to enable the modelling of durative actions and continuous resource consumption, so it was extended to enable the modelling of these features. The resulting competition language PDDL2.1 consisted of three levels of expressive power. Level 1 was ADL planning as before, level 2 added numerical variables, level 3 added durational constructs.
The 4th International Planning Competition, IPC-4, was hosted at ICAPS-2004. IPC-4 built on the previous efforts, in particular the language PDDL2.1. The competition event was extended and revised in several respects. In particular, IPC-4 featured, for the first time, a competition for probabilistic planners, so that the overall competition was split into a classical part -- a continuation of the previous events -- as well as a probabilistic part. In the latter part, co-organized by Michael Littman and Hakan Younes, the main objective of the event was to introduce a common representation language for probabilistic planners, and to establish some first benchmarks and results. For more information on the probabilistic part of IPC-4, see Michael Littman's page.
The classical part of IPC-4 was co-organized by Stefan Edelkamp and Joerg Hoffmann. The event attracted 19 competing systems (22 when counting different system versions). Several important revisions to the previous classical competitions were made: