Skip to content

Flacoco support#323

Merged
martinezmatias merged 28 commits intoSpoonLabs:masterfrom
andre15silva:flacoco
Aug 29, 2021
Merged

Flacoco support#323
martinezmatias merged 28 commits intoSpoonLabs:masterfrom
andre15silva:flacoco

Conversation

@andre15silva
Copy link
Copy Markdown
Collaborator

@andre15silva andre15silva commented Jul 14, 2021

Closes #314.

@andre15silva
Copy link
Copy Markdown
Collaborator Author

andre15silva commented Jul 14, 2021

@martinezmatias

You can find 3 examples under FaultLocalizationExtensionTest.

The first two are passing, and are example small projects.

The last one is math85, and if you run it you'll get the error we talked about in #314 .

testFlacocoExtensionMath85(fr.inria.astor.test.repair.evaluation.extensionpoints.FaultLocalizationExtensionTest)  Time elapsed: 207.793 sec  <<< ERROR!
java.lang.RuntimeException: Forked process did not finished correctly
	at eu.stamp_project.testrunner.EntryPoint.runGivenCommandLine(EntryPoint.java:599)
	at eu.stamp_project.testrunner.EntryPoint.runCoveredTestResultPerTestMethods(EntryPoint.java:496)
	at eu.stamp_project.testrunner.EntryPoint.runCoveredTestResultPerTestMethods(EntryPoint.java:446)
	at fr.spoonlabs.flacoco.core.coverage.framework.JUnit4Strategy.execute(JUnit4Strategy.java:23)
	at fr.spoonlabs.flacoco.core.coverage.CoverageRunner.getCoverageMatrix(CoverageRunner.java:35)
	at fr.spoonlabs.flacoco.localization.spectrum.SpectrumRunner.computeCoverageMatrix(SpectrumRunner.java:37)
	at fr.spoonlabs.flacoco.localization.spectrum.SpectrumRunner.run(SpectrumRunner.java:22)
	at fr.spoonlabs.flacoco.api.Flacoco.runDefault(Flacoco.java:32)
	at fr.inria.astor.core.faultlocalization.flacoco.FlacocoFaultLocalization.searchSuspicious(FlacocoFaultLocalization.java:30)
	at fr.inria.astor.core.solutionsearch.AstorCoreEngine.calculateSuspicious(AstorCoreEngine.java:903)
	at fr.inria.main.evolution.AstorMain.createEngine(AstorMain.java:119)
	at fr.inria.main.evolution.AstorMain.run(AstorMain.java:173)
	at fr.inria.main.evolution.AstorMain.execute(AstorMain.java:233)
	at fr.inria.astor.test.repair.evaluation.extensionpoints.FaultLocalizationExtensionTest.runMath85(FaultLocalizationExtensionTest.java:204)
	at fr.inria.astor.test.repair.evaluation.extensionpoints.FaultLocalizationExtensionTest.testFlacocoExtensionMath85(FaultLocalizationExtensionTest.java:53)

@andre15silva
Copy link
Copy Markdown
Collaborator Author

andre15silva commented Jul 21, 2021

Any way we can get CI enabled @martinezmatias ?

@martinezmatias
Copy link
Copy Markdown
Collaborator

martinezmatias commented Jul 22, 2021

Hi @andre15silva

Any way we can get CI enabled @martinezmatias ?

Ideally we should move to Actions. Travis.org is death so instead of moving to travis.com we should go to Actions.

@andre15silva
Copy link
Copy Markdown
Collaborator Author

andre15silva commented Jul 22, 2021

Ideally we should move to Actions. Travis.org is death so instead of moving to travis.com we should go to Actions.

Ok, I'll take care of that then. I was running the travis config on my personal account, but ran out of tokens quickly. Actions is for sure a better option.

@martinezmatias
Copy link
Copy Markdown
Collaborator

martinezmatias commented Jul 22, 2021

Perfect @andre15silva , thanks

@martinezmatias
Copy link
Copy Markdown
Collaborator

martinezmatias commented Jul 22, 2021

During the migration, it would be convenient to remove some low quality test (lot of smoke test) which require large execution times.

@andre15silva
Initial flacoco support
061e3f3 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Make flacoco the default fault localizer to test in CI.
ba33d75 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Update flacoco usage
a54d87a 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix quix bugs tests
c41a9be 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Update repositories to include sonatype snapshots where flacoco is
5cc9e46 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva andre15silva force-pushed the flacoco branch 3 times, most recently from 8c9b117 to 42077aa Compare July 29, 2021 13:49
@andre15silva
Fix CardumenExahustiveTest
fe66470 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix VariableResolverTest
380d6ff 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix flacoco setup for auto-compilation
4bf1dc3 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix RepairOperatorTest
76ad3d7 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix CardumenExahustiveTest#testCardumentM70Exhausitve
7138701 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix IngredientPoolTest#testMath85_ParticularIngredientStrategy
8bb600b 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Remove print
431e8a1
@andre15silva
Configurate compliance level in flacoco
c9ef9b6 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva andre15silva mentioned this pull request Aug 10, 2021
Merged
@andre15silva
Copy link
Copy Markdown
Collaborator Author

andre15silva commented Aug 11, 2021

Currently blocked by ASSERT-KTH/flacoco#79

@andre15silva
Fix spoon version
b8c8ccb 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Set ignored tests in flacoco config
2778b28 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix VariableResolverTest#test2VariablesInScope
4641fd2 
Signed-off-by: André Silva <andre15andre@hotmail.com>
This was referenced Aug 19, 2021
Open
Merged
@andre15silva
Fix CardumenApproachTest
fa15b2e 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix CardumenApproachTest
2bf13bc 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Implement missing options in flacoco localization
dc5c56f 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva andre15silva force-pushed the flacoco branch 2 times, most recently from d4d32c4 to dc5c56f Compare August 25, 2021 12:25
@andre15silva
Use flacoco's new API
63d20c5 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Ignore test failing due to being too restrictive in regards to fl
ef39eb2 
results

Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix CardumenApproachTest
cf69aa7 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix test2VariablesInScope
c446fa9 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Revert changes in CardumentApproachTest due to FL order
e6973c0 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Use flacoco's new API
ee6cdf5 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Upgrade snapshots to releases
37a733d 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix and add FaultLocalizationExtensionTest to CI
c7be7da 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva
Fix VariableResolverTest
5cd0d6b 
Signed-off-by: André Silva <andre15andre@hotmail.com>
@andre15silva andre15silva marked this pull request as ready for review August 27, 2021 15:25
@andre15silva
Copy link
Copy Markdown
Collaborator Author

andre15silva commented Aug 27, 2021

This is ready for review.

I left some comments on the tests/assertions I had to ignore, so it would be nice if you could give me some feedback on those (if they are correct, if we can ignore them, if we should fix them, etc) as I don't have the entire context of how Astor and the tools work.

@martinezmatias martinezmatias merged commit dd8e597 into SpoonLabs:master Aug 29, 2021
@martinezmatias
Copy link
Copy Markdown
Collaborator

martinezmatias commented Aug 29, 2021

Nice work @andre15silva . Thanks!

so it would be nice if you could give me some feedback on those (if they are correct, if we can ignore them, if we should fix them, etc) as I don't have the entire context of how Astor and the tools work.

Ok, I merge now and then we update the tests doing other PR.

@monperrus monperrus mentioned this pull request Sep 7, 2021
Closed
@andre15silva andre15silva mentioned this pull request Sep 7, 2021
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

integrate flacoco in Astor

2 participants

@andre15silva @martinezmatias