Skip to content

Indexing throughput drop after types removal issues deprecation messages #37411

@dliappis

Description

@dliappis

#36549 introduced deprecation messages when types are used in _bulk APIs.

This has caused major throughput drops in our standard nightly benchmarks (that use a _doc type) like the one seen here https://elasticsearch-benchmarks.elastic.co/#tracks/geopoint/nightly/30d:

image

Other tracks affected are http_logs, nyc_taxis, noaa, [geonames][(https://elasticsearch-benchmarks.elastic.co/#tracks/geonames/nightly/30d) and nested.

The deprecation logger is suppressing duplicate messages hence there is only one entry in the log file:

$ cat rally-benchmark_deprecation.log
[2019-01-14T11:05:37,399][WARN ][o.e.d.a.b.BulkRequest    ] [rally-node-0] [types removal] Specifying types in bulk requests is deprecated.

IMO a deprecated feature shouldn't cause a performance regression (at least not that magnitude) until it gets removed.

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions