State-of-the-art planners often exhibit substantial runtime variation, making it useful to be able to efficiently predict how long a given planner will take to run on a given instance. In other areas of AI, such needs are met by building so-called empirical performance models (EPMs), statistical models derived from sets of problem instances and performance observations. Historically, such models have been less accurate for predicting the running times of planners. A key hurdle has been a relative weakness in instance features for characterizing instances: mappings from problem instances to real numbers that serve as the starting point for learning an EPM. We propose a new, extensive set of instance features for planning, and investigate its effectiveness across a range of model families. We built EPMs for various prominent planning systems on several thousand benchmark problems from the planning literature and from IPC benchmark sets, and conclude that our models predict runtime much more accurately than the previous state of the art. We also study the relative importance of these features.
|Title of host publication||Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS 2014)|
|Editors||Steve Chien, Alan Fern, Wheeler Ruml, Minh Do|
|Number of pages||5|
|Publication status||Published - Aug 2014|
|Event||24th International Conference on Automated Planning and Scheduling - Portsmouth, United States|
Duration: 21 Jun 2014 → 26 Jun 2014
Conference number: 24
http://icaps14.icaps-conference.org/ (Link to Conference Website)
|Conference||24th International Conference on Automated Planning and Scheduling|
|Abbreviated title||ICAPS 2014|
|Period||21/06/14 → 26/06/14|
Fawcett, C., Vallati, M., Hutter, F., Hoffmann, J., Hoos, H. H., & Leyton-Brown, K. (2014). Improved Features for Runtime Prediction of Domain-Independent Planners. In S. Chien, A. Fern, W. Ruml, & M. Do (Eds.), Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS 2014) (pp. 355-359). AAAI press.