Skip to content

[chassis] white listed logs are getting ignored by loganalyzer for multi asic device  #6884

@arlakshm

Description

@arlakshm

Description

Steps to reproduce the issue:

  1. Run test_arpall on multi asic linecard with log analyser enabled
  2. The test is marked as error with the below logs
      # if we have failed processes, we should log the exception and exit code
        # of each Process and fail
        if len(failed_processes.keys()):
            for process_name, process in failed_processes.items():
                p_exitcode = ""
                p_exception = ""
                p_traceback = ""
                if 'exception' in process and process['exception']:
                    p_exception = process['exception'][0]
                    p_traceback = process['exception'][1]
                    p_exitcode = process['exit_code']
                pt_assert(
                    False,
                    'Processes "{}" failed with exit code "{}"\nException:\n{}\nTraceback:\n{}'.format(
>                       list(failed_processes.keys()), p_exitcode, p_exception, p_traceback
                    )
                )
E               Failed: Processes "['analyze_logs--<MultiAsicSonicHost str2-sonic-lc5-1>']" failed with exit code "1"
E               Exception:
E               expected_match: 0
E               expected_missing_match: 0
E               match: 6
E               
E               Match Messages:
E               Nov 19 10:19:01.464441 str2-sonic-lc5-1 ERR swss0#orchagent: :- getResAvailability: Failed to get availability counter for MPLS_INSEG CRM resourse
E               
E               Nov 19 10:19:01.465320 str2-sonic-lc5-1 ERR swss0#orchagent: :- getResAvailability: Failed to get availability counter for SRV6_MY_SID_ENTRY CRM resourse
E               
E               Nov 19 10:19:01.466259 str2-sonic-lc5-1 ERR swss0#orchagent: :- getResAvailability: Failed to get availability counter for NEXTHOP_GROUP_MAP CRM resourse
E               
E               Nov 19 10:19:06.564622 str2-sonic-lc5-1 ERR swss1#orchagent: :- getResAvailability: Failed to get availability counter for MPLS_INSEG CRM resourse
E               
E               Nov 19 10:19:06.565486 str2-sonic-lc5-1 ERR swss1#orchagent: :- getResAvailability: Failed to get availability counter for SRV6_MY_SID_ENTRY CRM resourse
E               
E               Nov 19 10:19:06.566409 str2-sonic-lc5-1 ERR swss1#orchagent: :- getResAvailability: Failed to get availability counter for NEXTHOP_GROUP_MAP CRM resourse
E               
E               Traceback:
E               Traceback (most recent call last):
E                 File "/azp/agent/_work/12/s/tests/common/helpers/parallel.py", line 31, in run
E                   Process.run(self)
E                 File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
E                   self._target(*self._args, **self._kwargs)
E                 File "/azp/agent/_work/12/s/tests/common/helpers/parallel.py", line 243, in wrapper
E                   target(*args, **kwargs)
E                 File "/azp/agent/_work/12/s/tests/common/plugins/loganalyzer/__init__.py", line 39, in analyze_logs
E                   dut_analyzer.analyze(markers[node.hostname])
E                 File "/azp/agent/_work/12/s/tests/common/plugins/loganalyzer/loganalyzer.py", line 371, in analyze
E                   self._verify_log(analyzer_summary)
E                 File "/azp/agent/_work/12/s/tests/common/plugins/loganalyzer/loganalyzer.py", line 135, in _verify_log
E                   raise LogAnalyzerError(result_str)
E               LogAnalyzerError: expected_match: 0
E               expected_missing_match: 0
E               match: 6
E               
E               Match Messages:
E               Nov 19 10:19:01.464441 str2-sonic-lc5-1 ERR swss0#orchagent: :- getResAvailability: Failed to get availability counter for MPLS_INSEG CRM resourse
E               
E               Nov 19 10:19:01.465320 str2-sonic-lc5-1 ERR swss0#orchagent: :- getResAvailability: Failed to get availability counter for SRV6_MY_SID_ENTRY CRM resourse
E               
E               Nov 19 10:19:01.466259 str2-sonic-lc5-1 ERR swss0#orchagent: :- getResAvailability: Failed to get availability counter for NEXTHOP_GROUP_MAP CRM resourse
E               
E               Nov 19 10:19:06.564622 str2-sonic-lc5-1 ERR swss1#orchagent: :- getResAvailability: Failed to get availability counter for MPLS_INSEG CRM resourse
E               
E               Nov 19 10:19:06.565486 str2-sonic-lc5-1 ERR swss1#orchagent: :- getResAvailability: Failed to get availability counter for SRV6_MY_SID_ENTRY CRM resourse
E               
E               Nov 19 10:19:06.566409 str2-sonic-lc5-1 ERR swss1#orchagent: :- getResAvailability: Failed to get availability counter for NEXTHOP_GROUP_MAP CRM resourse

alive      = []

Describe the results you received:
These logs are whitelisted in this file https://github.com/sonic-net/sonic-mgmt/blob/master/ansible/roles/test/files/tools/loganalyzer/loganalyzer_common_ignore.txt but loganalyser still parses these logs

Describe the results you expected:
The test should pass because the above mentioned syslog is added to the loganalyzer_common_ignore.txt

Additional information you deem important:

**Output of `show version`:**

```
(paste your output here)
```

**Attach debug file `sudo generate_dump`:**

```
(paste your output here)
```

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions