Skip to content

Configure agents to be aware that modifying lower-level layers can affect higher-level tests  #1602

@nathanjmcdougall

Description

@nathanjmcdougall

@copilot the TestAddAuthor.test_append test is failing, please investigate.

Originally posted by @nathanjmcdougall in #1591 (comment)

When thinking about whether to consider a test worth running during an agent session, we need heuristics. In this case, the agent didn't realize that modifying the TOMLFileManger could affect higher-level functions and the TestAddAuthor test was failing once the agent finished its session, i.e. it stopped too early.

The more general principle here is to consider the layers of abstraction affected by a change, e.g. by inspecting the layered architecture in .importlinter config. Aspects in a higher layer can always be affected by a lower layer and the ramifications should be investigated in terms of running more tests.

Metadata

Metadata

Labels

agentConfiguration updates for LLM coding agents

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions