Skip to content

Support synthetic source in tsdb and nyc_taxis tracks#268

Merged
nik9000 merged 4 commits intoelastic:masterfrom
nik9000:synthetic_source
May 16, 2022
Merged

Support synthetic source in tsdb and nyc_taxis tracks#268
nik9000 merged 4 commits intoelastic:masterfrom
nik9000:synthetic_source

Conversation

@nik9000
Copy link
Copy Markdown
Member

@nik9000 nik9000 commented May 9, 2022

Adds support for synthetic source to the tsdb and nyc_taxis tracks.

tsdb/README.md Outdated
* `index_mode` (default: time_series): Whether to make a standard index (`standard`) or time series index (`time_series`)
* `codec` (default: default): The codec to use compressing the index. `default` uses more space and less cpu. `best_compression` uses less space and more cpu.
* `ingest_order` (default: jumbled): Should the data be loaded in `sorted` order or a more `jumbled`, mostly random order.
* `synthetic_source` (default: false): Should we enable `synethetic` _source to save space?.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: synethetic has a typo

Copy link
Copy Markdown
Contributor

@michaelbaamonde michaelbaamonde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did you intentionally add this to the nyc_taxis track, too? If so, could you document the synthetic_source track parameter there, too? The only other thing is the typo in the tsdb README.

Otherwise, this works for me locally. I wish there were an obvious way around the repetition in the jinja templates, but I don't have any brilliant ideas on that front.

Thanks for putting this together!

@nik9000
Copy link
Copy Markdown
Member Author

nik9000 commented May 15, 2022

Did you intentionally add this to the nyc_taxis track, too

Huh! I did intentionally do it. Then forgot.... Sorry about that. It is useful to have it there too. I'll update the docs.

@nik9000 nik9000 changed the title Support synthetic source in tsdb track Support synthetic source in tsdb and nyc_taxis tracks May 16, 2022
@nik9000 nik9000 merged commit 12113c1 into elastic:master May 16, 2022
@nik9000
Copy link
Copy Markdown
Member Author

nik9000 commented May 16, 2022

Thanks @michaelbaamonde !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants