Code and data for the ECAI 2024 paper "Dissecting Scorpion: Ablation Study of an Optimal Classical Planner"

Code

The file seipp-ecai2024-code.zip contains a copy of the Scorpion planning system. Please see README.md and BUILD.md for instructions on how to compile the planner. Here is the short version for building the planner and running the recommended Scorpion configuration:

./build.py
./fast-downward.py PDDL_TASK --search "astar(scp_online([\
projections(sys_scp(max_time=100, max_time_per_restart=10, max_pdb_size=2M, max_collection_size=20M, \
pattern_type=interesting_non_negative)), \
cartesian(subtasks=[landmarks(order=random), goals(order=random)], \
max_states=infinity, max_transitions=1M, max_time=100, pick_flawed_abstract_state=first_on_shortest_path, \
pick_split=max_refined, tiebreak_split=min_cg)], \
saturator=perimstar, max_time=100, max_size=1M, interval=10K, orders=greedy_orders()), \
pruning=limited_pruning(pruning=atom_centric_stubborn_sets(), min_required_pruning_ratio=0.2), verbosity=normal)"

The latest version of the code is available at https://github.com/jendrikseipp/scorpion.

Scripts

The file seipp-ecai2024-scripts.zip contains the Python code that was used for running the experiment.

Benchmarks

The file seipp-ecai2024-benchmarks.zip contains the PDDL benchmarks from sequential optimization tracks of IPC 1998-2023.

Experiment data

The remaining zipfiles contain the raw experiment data, parsed values and basic reports for the experiments in the paper. For each experiment there are two files. The first contains the raw data of all experiment runs. The code directories and benchmark files have been removed to avoid duplication and to save space. The second file (*-eval.zip) contains a "properties" file with all parsed values and HTML reports.