Skip to content

Add fetch operations for synthetic source#270

Merged
nik9000 merged 1 commit intoelastic:masterfrom
nik9000:synthetic_source_fetch
May 23, 2022
Merged

Add fetch operations for synthetic source#270
nik9000 merged 1 commit intoelastic:masterfrom
nik9000:synthetic_source_fetch

Conversation

@nik9000
Copy link
Copy Markdown
Member

@nik9000 nik9000 commented May 19, 2022

This adds a default_1k operation to nyc_taxis to fetch 1,000
documents. It adds that same operation to tsdb, and another one to fetch
10 documents, similar to nyc_taxis default operation. These are all
useful to test the fetch speed of synthetic source. Specifically it
tests fetching the same documents over and over again. That's useful!
It shows that, at least in this case, synthetic source is fast for
nyc_taxis:

|                              |            |  normal | synthetic |    |         |
| 50th percentile service time | default_1k | 10.9269 |   10.5904 | ms |  -3.08% |
| 90th percentile service time | default_1k | 22.4911 |   15.4604 | ms | -31.26% |
| 99th percentile service time | default_1k | 24.4341 |   20.982  | ms | -14.13% |
|100th percentile service time | default_1k | 24.9321 |   20.9966 | ms | -15.79% |

That's lovely and surprising. It also shows that synthetic source is
slow for tsdb, which has many many many fields:

|                               |            | normal | synthetic |    |           |
|  50th percentile service time | default_1k | 4.4208 |   163.061 | ms | +3588.48% |
|  90th percentile service time | default_1k | 4.6127 |   166.374 | ms | +3506.88% |
|  99th percentile service time | default_1k | 5.0065 |   168.403 | ms | +3263.67% |
| 100th percentile service time | default_1k | 5.1351 |   173.503 | ms | +3278.76% |

It'd be useful to also test fetching random docs too - probably more
useful and realistic. But this is also useful!

This adds a `default_1k` operation to nyc_taxis to fetch 1,000
documents. It adds that same operation to tsdb, and another one to fetch
10 documents, similar to nyc_taxis `default` operation. These are all
useful to test the fetch speed of synthetic source. Specifically it
tests fetching the same documents over and over again. That's useful!
It shows that, at least in this case, synthetic source is fast for
nyc_taxis:
```
|                              |            |  normal | synthetic |    |         |
| 50th percentile service time | default_1k | 10.9269 |   10.5904 | ms |  -3.08% |
| 90th percentile service time | default_1k | 22.4911 |   15.4604 | ms | -31.26% |
| 99th percentile service time | default_1k | 24.4341 |   20.982  | ms | -14.13% |
|100th percentile service time | default_1k | 24.9321 |   20.9966 | ms | -15.79% |
```

That's lovely and surprising. It also shows that synthetic source is
slow for tsdb, which has many many many fields:
```
|                               |            | normal | synthetic |    |           |
|  50th percentile service time | default_1k | 4.4208 |   163.061 | ms | +3588.48% |
|  90th percentile service time | default_1k | 4.6127 |   166.374 | ms | +3506.88% |
|  99th percentile service time | default_1k | 5.0065 |   168.403 | ms | +3263.67% |
| 100th percentile service time | default_1k | 5.1351 |   173.503 | ms | +3278.76% |
```

It'd be useful to also test fetching *random* docs too - probably more
useful and realistic. But this is also useful!
@nik9000
Copy link
Copy Markdown
Member Author

nik9000 commented May 19, 2022

Note - this'll add another item to the nightlies for nyc_taxis.

@nik9000 nik9000 changed the title Add fetch tests for synthetic source Add fetch operations for synthetic source May 19, 2022
Copy link
Copy Markdown
Member

@pquentin pquentin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! This looks good. Please merge this only on Monday, as we won't have anybody to fix issues that come up otherwise.

@nik9000 nik9000 merged commit ebd1ab6 into elastic:master May 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants