This directory contains examples, log files, and scripts from the
experimental evaluation in [1].

Examples were run without and with conversion to NNF during
translation from LTL to SNF. We ended up using data with conversion to
NNF for the genbuf family and without conversion to NNF for all other
families.

The columns of the tables of results (all.raw.{csv,txt}) are as follows:
t           run time [seconds]
m           memory [MB]
sti         size of syntax tree of input formula [# nodes]
stc         size of syntax tree of uc [# nodes]
cli         # SNF clauses obtained from input formula
clc         # SNF clauses of uc
all         # sets of time points in uc
nt          # sets of time points in uc different from {0}, N
dif         # of different sets of time points
bwr         size of resolution graph backward reachable from vertex labeled
            with empty clause [# vertices]
mbwr        largest size of resolution graph backward reachable from vertex
            labeled with empty clause and forward reachable from vertex
            labeled with input clause in uc [# vertices]

Entries have the following meaning:
to          time out
mo          memory out
na          not available
si          simplified to false during translation from LTL to SNF
---         example not run (only for subfamilies of increasing difficulty; at
            least two less difficult examples of subfamily timed or memed out)

File (type)             Content
--------------------------------------------------------------------------------
all.raw.csv             table of results as csv
all.raw.txt             table of results as txt
config_examples.bash    list of examples for run_benchmarks.bash
Config_examples.pm      list of examples for generate_tab.pl
generate_tab.pl         script used to generate tables of results
README                  this file
run_benchmarks.bash     script used to run examples (note: the version of run
                        used is customized to allow configuring the rate of
                        reporting)
statistics_sls.bash     script used to generate statistics on occurrences of
                        sets of time points

For the following files we have
- ${e} is the name of an example
- ${m} is whether uc extraction was enabled: none (no uc), simple (uc
  w/o sets of time points), positionsetsg (uc w/ sets of time points
  Gawrychowski), positionsetss (uc w/ sets of time points Sawa)
- ${n} is whether conversion to NNF was enabled: nnf or nonnf
- ${f} is the format of the uc: internal, snf, ltlc, ltl

${e}.trp                example
${e}.${m}.${n}.log      log file
${e}.trp.${m}.${n}.${f} core file

Viktor Schuppan
Füssen, 17 February 2013

[1] V. Schuppan: Extracting Unsatisfiable Cores for LTL via Temporal
    Resolution. In progress. Available from
    http://arxiv.org/abs/1212.3884v1.
