Skip to content

Restrict unrolling to loops that are nested within less than 4 loops#1595

Merged
sim642 merged 4 commits intomasterfrom
no-unrolling-resource
Oct 11, 2024
Merged

Restrict unrolling to loops that are nested within less than 4 loops#1595
sim642 merged 4 commits intomasterfrom
no-unrolling-resource

Conversation

@karoliineh
Copy link
Copy Markdown
Member

@karoliineh karoliineh commented Oct 8, 2024

This PR addresses the excessive resource usage introduced in bb6f9aa.

As the amount of unrolling grows exponentially with the number of nested loops, we determined what would be a reasonable amount of nestings with a 5s run on the sv-benchmarks and found that unrolling less than 4 loops is a reasonable metric.

On the downside, this PR introduces an issue where some termination tasks do not reach a fixpoint. Unfortunately, I was not able to trace it to the cause, but we made a quick run, and it seems to not impact our overall scores (compared to SV-COMP 2023, we lost 2 termination tasks, but we also currently run out of resources for these).

So, (hopefully) this PR fixes more things than it breaks. Edit: we made a run and, indeed, this PR does not break anything else but fixes the excessive resource usage with 717 tasks going from errors back to unknowns.

as unrolling and analyzing empty loops is cheaper than visiting loops for collecting the nr of the instructions
@karoliineh karoliineh added sv-comp SV-COMP (analyses, results), witnesses performance Analysis time, memory usage labels Oct 8, 2024
@karoliineh karoliineh added this to the SV-COMP 2025 milestone Oct 8, 2024
@karoliineh karoliineh requested a review from sim642 October 8, 2024 10:51
@karoliineh karoliineh self-assigned this Oct 8, 2024
@sim642
Copy link
Copy Markdown
Member

sim642 commented Oct 11, 2024

On the downside, this PR introduces an issue where some termination tasks do not reach a fixpoint

For reference, in SV-COMP 2024 we also had a bunch of fixpoint errors: https://sv-comp.sosy-lab.org/2024/results/results-verified/goblint.results.SV-COMP24.table.html#/table?filter=0(0*status*(status(in(ERROR%20%28verify%29)))).
Most of them are also with the termination property, so there's probably some preexisting underlying issue that less unrolling also triggers.

@sim642 sim642 merged commit cda9ec4 into master Oct 11, 2024
@sim642 sim642 deleted the no-unrolling-resource branch October 11, 2024 07:46
sim642 added a commit to sim642/opam-repository that referenced this pull request Nov 28, 2024
CHANGES:

Functionally equivalent to Goblint in SV-COMP 2025.

* Add 32bit vs 64bit architecture support (goblint/analyzer#54, goblint/analyzer#1574).
* Add per-function context gas analysis (goblint/analyzer#1569, goblint/analyzer#1570, goblint/analyzer#1598).
* Adapt automatic static loop unrolling (goblint/analyzer#1516, goblint/analyzer#1582, goblint/analyzer#1583, goblint/analyzer#1584, goblint/analyzer#1590, goblint/analyzer#1595, goblint/analyzer#1599).
* Adapt automatic configuration tuning (goblint/analyzer#1450, goblint/analyzer#1612, goblint/analyzer#1181, goblint/analyzer#1604).
* Simplify non-relational integer invariants in witnesses (goblint/analyzer#1517).
* Fix excessive hash collisions (goblint/analyzer#1594, goblint/analyzer#1602).
* Clean up various code (goblint/analyzer#1095, goblint/analyzer#1523, goblint/analyzer#1554, goblint/analyzer#1575, goblint/analyzer#1588, goblint/analyzer#1597, goblint/analyzer#1614).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

performance Analysis time, memory usage sv-comp SV-COMP (analyses, results), witnesses

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants