Description
Mgmt-framework service fails to start:
Mar 19 13:30:45.820590 sonic INFO mgmt-framework#supervisord: rest-server REST_SERVER_ARGS = -ui /rest_ui -logtostderr -cert /etc/sonic/telemetry/streamingtelemetryserver.cer -key /etc/sonic/telemetry/streamingtelemetryserver.key -cacert /etc/sonic/telemetry/dsmsroot.cer
Mar 19 13:30:45.830825 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:45.830099 423 util.go:161] Current Values of CVL Configuration File map[TRACE_CACHE:false TRACE_YPARSER:false __comment4__:Display log upto INFO level 8 TRACE_LIBYANG:false TRACE_SEMANTIC:false LOGTOSTDERR:false __comment3__:Display log upto INFO level TRACE_CREATE:false TRACE_UPDATE:false __comment1__:Log trace data when error occurs STDERRTHRESHOLD:ERROR SKIP_VALIDATION:false TRACE_DELETE:false TRACE_SYNTAX:false TRACE_ONERROR:true __comment2__:Set LOGTOSTDER to 'true' to log on standard error VERBOSITY:0 SKIP_SEMANTIC_VALIDATION:false]
Mar 19 13:30:45.831150 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:45.830414 423 util.go:161] Current Values of CVL Configuration File map[TRACE_CACHE:false TRACE_YPARSER:false __comment4__:Display log upto INFO level 8 TRACE_LIBYANG:false TRACE_SEMANTIC:false LOGTOSTDERR:false __comment3__:Display log upto INFO level TRACE_CREATE:false TRACE_UPDATE:false __comment1__:Log trace data when error occurs STDERRTHRESHOLD:ERROR SKIP_VALIDATION:false TRACE_DELETE:false TRACE_SYNTAX:false TRACE_ONERROR:true __comment2__:Set LOGTOSTDER to 'true' to log on standard error VERBOSITY:0 SKIP_SEMANTIC_VALIDATION:false]
Mar 19 13:30:45.889356 sonic INFO mgmt-framework#supervisord: rest-server libyang[0]: Failed to find "fec" as a sibling to "sonic-port:ifname".
Mar 19 13:30:46.250554 sonic INFO mgmt-framework#supervisord: rest-server Yang model List: [sonic-acl.yang sonic-common.yang sonic-extension.yang sonic-extensions.yang sonic-interface.yang sonic-port.yang openconfig-acl.yang openconfig-acl-annot.yang]
Mar 19 13:30:46.362128 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.361613 423 xspec.go:284] Module name(sonic-acl)
Mar 19 13:30:46.362222 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.361683 423 xspec.go:261] xDbSpecOrdTblMap after appending map[sonic-acl:[ACL_TABLE ACL_RULE]]
Mar 19 13:30:46.362561 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl) #015
Mar 19 13:30:46.362630 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set) #015
Mar 19 13:30:46.362729 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/config/name) #015
Mar 19 13:30:46.363039 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.361840 423 xspec.go:284] Module name(sonic-common)
Mar 19 13:30:46.363105 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.361872 423 xspec.go:261] xDbSpecOrdTblMap after appending map[sonic-acl:[ACL_TABLE ACL_RULE] sonic-common:[operation]]
Mar 19 13:30:46.363160 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.361913 423 xspec.go:284] Module name(sonic-port)
Mar 19 13:30:46.363206 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.361942 423 xspec.go:261] xDbSpecOrdTblMap after appending map[sonic-acl:[ACL_TABLE ACL_RULE] sonic-common:[operation] sonic-port:[PORT]]
Mar 19 13:30:46.363253 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.362016 423 xspec.go:284] Module name(sonic-interface)
Mar 19 13:30:46.363306 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.362046 423 xspec.go:261] xDbSpecOrdTblMap after appending map[sonic-acl:[ACL_TABLE ACL_RULE] sonic-common:[operation] sonic-port:[PORT] sonic-interface:[INTERFACE]]
Mar 19 13:30:46.363962 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/config/type) #015
Mar 19 13:30:46.363962 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/config/description) #015
Mar 19 13:30:46.363962 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/state/name) #015
Mar 19 13:30:46.363962 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/state/type) #015
Mar 19 13:30:46.363962 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/state/description) #015
Mar 19 13:30:46.364005 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry) #015
Mar 19 13:30:46.364005 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv4) #015
Mar 19 13:30:46.364037 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv6) #015
Mar 19 13:30:46.364037 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/config/sequence-id) #015
Mar 19 13:30:46.364063 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv4/config/source-address) #015
Mar 19 13:30:46.364063 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv4/config/destination-address) #015
Mar 19 13:30:46.364111 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv4/config/protocol) #015
Mar 19 13:30:46.364111 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv4/state/source-address) #015
Mar 19 13:30:46.364148 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv4/state/destination-address) #015
Mar 19 13:30:46.364148 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv4/state/protocol) #015
Mar 19 13:30:46.364175 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv6/config/source-address) #015
Mar 19 13:30:46.364193 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv6/config/destination-address) #015
Mar 19 13:30:46.364193 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/ipv6/config/protocol) #015
Mar 19 13:30:46.364219 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/transport/config/source-port) #015
Mar 19 13:30:46.364219 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/transport/config/destination-port) #015
Mar 19 13:30:46.364259 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/transport/state/source-port) #015
Mar 19 13:30:46.364259 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/transport/state/destination-port) #015
Mar 19 13:30:46.364280 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/transport/config/tcp-flags) #015
Mar 19 13:30:46.364303 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/l2/config/ethertype) #015
Mar 19 13:30:46.364303 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/actions/config/forwarding-action) #015
Mar 19 13:30:46.364326 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/acl-sets/acl-set/acl-entries/acl-entry/actions/state/forwarding-action) #015
Mar 19 13:30:46.364343 sonic INFO mgmt-framework#supervisord: rest-server Xpath not found(/openconfig-acl:acl/interfaces) #015
Mar 19 13:30:46.429063 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428538 423 app_interface.go:82] Registering for path =/openconfig-acl:acl
Mar 19 13:30:46.429152 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428586 423 app_interface.go:82] Registering for path =/sonic-
Mar 19 13:30:46.429200 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428609 423 app_interface.go:82] Registering for path =*
Mar 19 13:30:46.429247 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428639 423 intf_app.go:93] Init called for INTF module
Mar 19 13:30:46.429463 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428662 423 app_interface.go:82] Registering for path =/openconfig-interfaces:interfaces
Mar 19 13:30:46.429525 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428693 423 lldp_app.go:61] Init called for LLDP modules module
Mar 19 13:30:46.429573 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428717 423 app_interface.go:82] Registering for path =/openconfig-lldp:lldp
Mar 19 13:30:46.429630 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428741 423 pfm_app.go:44] Init called for Platform module
Mar 19 13:30:46.429676 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.428763 423 app_interface.go:82] Registering for path =/openconfig-platform:components
Mar 19 13:30:46.807895 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.795182 423 sys_app.go:47] SysApp: Init called for System module
Mar 19 13:30:46.807895 sonic INFO mgmt-framework#supervisord: rest-server ERROR: logging before flag.Parse: I0319 13:30:46.795266 423 app_interface.go:82] Registering for path =/openconfig-system:system
Mar 19 13:30:46.812676 sonic INFO mgmt-framework#supervisord: rest-server 2020/03/19 13:30:46 profile: cpu profiling enabled, /tmp/profile662473775/cpu.pprof
Mar 19 13:30:46.813676 sonic INFO mgmt-framework#supervisord: rest-server I0319 13:30:46.812561 423 router.go:79] Server has 2909 paths
Mar 19 13:30:47.829133 sonic INFO mgmt-framework#supervisord: rest-server I0319 13:30:47.828378 423 main.go:132] Server certificate file: /etc/sonic/telemetry/streamingtelemetryserver.cer
Mar 19 13:30:47.829133 sonic INFO mgmt-framework#supervisord: rest-server I0319 13:30:47.828421 423 main.go:133] Server private key file: /etc/sonic/telemetry/streamingtelemetryserver.key
Mar 19 13:30:47.829133 sonic INFO mgmt-framework#supervisord: rest-server F0319 13:30:47.828468 423 main.go:137] Failed to load server cert/key -- open /etc/sonic/telemetry/streamingtelemetryserver.cer: no such file or directory
Steps to reproduce the issue:
- Install SONiC 201911
- Deploy t0 topo
- service mgmt-framework restart
Describe the results you received:
mgmt-framework fails to start
Describe the results you expected:
mgmt-framework service should be operational or disabled
Additional information you deem important (e.g. issue happens only occasionally):
**Output of `show version`:**
```
(paste your output here)
```
**Attach debug file `sudo generate_dump`:**
```
(paste your output here)
```
The issue is observed with Removing explicit libyang plugin path settings #4144 cherry-picked
Description
Mgmt-framework service fails to start:
Steps to reproduce the issue:
Describe the results you received:
mgmt-framework fails to start
Describe the results you expected:
mgmt-framework service should be operational or disabled
Additional information you deem important (e.g. issue happens only occasionally):
The issue is observed with Removing explicit libyang plugin path settings #4144 cherry-picked