This issue captures all the work done and additional work required to migrate obs-infraobs-integrations owned packages to format_version 3.0.0.

In order to get some packages passing the new package-spec validations, several validation exclude rules were added. For these packages, the underlying issues should be fixed as soon as possible and the exclude rules removed. The fixes required for this are also captured in this issue.

The packages being migrated as part of this issue are:

• activemq
• airflow
• apache [BLOCKED]
• apache_spark
• apache_tomcat
• azure_app_service
• azure_functions
• cassandra
• ceph
• citrix_adc
• cockroachdb
• coredns
• couchbase
• couchdb
• etcd
• golang
• hadoop
• haproxy [BLOCKED]
• ibmmq [BLOCKED]
• iis
• influxdb
• jolokia_input
• kafka
• kafka_log
• memcached
• microsoft_sqlserver
• mongodb
• mysql
• nagios_xi [BLOCKED]
• nginx
• oracle
• oracle_weblogic
• php_fpm
• postgresql
• prometheus_input
• rabbitmq
• redis
• redisenterprise
• salesforce
• spring_boot
• sql_input
• statsd_input
• tomcat
• traefik
• vsphere
• websphere_application_server
• zookeeper

PRs:

• [apache_tomcat] - Migrate to package-spec v3 #8159
• [salesforce] Update package to format_version 3.0.0 #8215
• Migrate obs-infraobs-integrations to package-spec v3 #1 #8170 (activemq -> etcd)
• Add dimension field previously missed during package-spec v3 migration #8260
• Migrate obs-infraobs-integrations to package-spec v3 #2 #8171 (golang -> nginx)
• Migrate obs-infraobs-integrations to package-spec v3 #3 #8203 (oracle -> zookeeper)
• Migrate obs-infraobs-integrations to package-spec v3 #4 #8216 (leftovers - azure_app_service, citrix_adc, redis, tomcat)
• Migrate obs-infraobs-integrations to package-spec v3 #5 #8234 (more leftovers - influxdb, mongodb)
• Migrate obs-infraobs-integrations to package-spec v3 #6 #8291 (statsd_input, sql_input)
• [memcached]: Address skipped validation SVR00003 #8347
• elastic/obs-infraobs-integrations: Address skipped validation SVR00002 #8348

Issues blocking migration to format_version 3.0.0

• [apache] convert legacy visualizations to lens #8209
• [azure_app_service]: resolving external fields failed: can't resolve fields: field geo.continent_name cannot be reused at top level (see: #1)
• [citrix_adc]: resolving external fields failed: can't resolve fields: field interface.id cannot be reused at top level
• [haproxy] convert legacy visualizations to lens #8210
• [IBMMQ]: [IBM MQ] Migrate Top 5 Errors [Logs IBM MQ] panel to the lens #5662
• [redis]: resolving external fields failed: can't resolve fields: field os.full cannot be reused at top level
• [tomcat]: resolving external fields failed: can't resolve fields: field geo.city_name cannot be reused at top level
• [nagios_xi]: multiple set processors setting event.dataset in this file. (see: #1). Probable fix could be a breaking change.

Issues that need fixing but are currently skipped in 'validation.yml'

Other non-blocking issues that should be fixed in the future

• [etcd]: While migrating we noticed the type {backend_commit_duration,wal_fsync_duration}.ns.{count,sum} is set to long but it should be float instead. (ref)
• [azure_app_service]: geo mappings are not allowed at root level in ECS (ref)
• [citrix_adc]: interface mappings are not allowed at root level in ECS (ref). Also, interface be nested like observer.egress.interface.*. Please refer ECS docs.
• [redis]: os mappings are not allowed at root level in ECS (ref)
• [tomcat]: geo mappings are not allowed at root level in ECS (ref)