[O11y][Nginx] Rally benchmark nginx.access#9032
Conversation
| type: keyword | ||
| - name: destination_domain | ||
| type: keyword | ||
| example: lessons.example.com |
There was a problem hiding this comment.
Currently this wouldn't work due to a known issue mentioned here. Once it's fix it would generate domains in the example format.
cc:- @aspacca
There was a problem hiding this comment.
@aliabbas-elastic,
Can we use the suggested alternate format #8909 (comment) instead of dot? if that works, we can proceed.
There was a problem hiding this comment.
@lalit-satapathy This is the original log which I was making it relatable so that the generated log appears close to the original one
lessons.example.com 192.168.0.1 - - [09/Jun/2020:12:10:39 -0700] "GET /A%20Beka%20G1%20Howe/029_AND_30/15%20reading%20elephants.mp4 HTTP/1.1" 206 7648063 "http://lessons.example.com/A%20Beka%20G1%20Howe/029_AND_30/15%20reading%20elephants.mp4" "Mozilla/5.0 (Linux; Android 5.1.1; KFFOWI) AppleWebKit/537.36 (KHTML, like Gecko) Silk/81.2.16 like Chrome/81.0.4044.138 Safari/537.36"
I think there is a strong dependency of this to be there.
🚀 Benchmarks reportTo see the full report comment with |
|
@tommyers-elastic Here is an example of event ingested in Elastic. There will be one change in the format of |
|
we can go ahead and merge now i think 👍 |
… into nginx_benchmark_access
💚 Build Succeeded
History
cc @aliabbas-elastic |
|
Proposed commit message
accessdata stream ofNginxSample Response
sample_event.json
{ "_index": ".ds-logs-nginx.access-ep-2024.02.15-000001", "_id": "iOjQxY0B302vswJ8QL2w", "_version": 1, "_score": 0, "_source": { "agent": { "name": "blazehound", "id": "ef5e274d-4b53-45e6-943a-a5bcf1a6f523", "ephemeral_id": "ambershriek", "type": "filebeat", "version": "8.5.1" }, "nginx": { "access": { "remote_ip_list": [ "68.22.118.246" ] } }, "benchmark_metadata": { "info": { "run_id": "09a202de-9f41-44ec-ad87-5771937b2414", "benchmark": "access-benchmark" } }, "log": { "file": { "path": "/tmp/service_logs/access.log" }, "offset": 0 }, "elastic_agent": { "id": "ef5e274d-4b53-45e6-943a-a5bcf1a6f523", "version": "8.5.0", "snapshot": false }, "destination": { "port": 80, "domain": "bootchillmarbleshield" }, "source": { "address": "68.22.118.246", "ip": "68.22.118.246" }, "url": { "path": "/downloads/product_2", "original": "/downloads/product_2", "domain": "bootchillmarbleshield" }, "tags": [ "nginx-access" ], "input": { "type": "log" }, "@timestamp": "2024-02-20T09:19:34.000Z", "ecs": { "version": "8.5.1" }, "_tmp": {}, "related": { "ip": [ "68.22.118.246" ], "user": [ "citrinemouse" ] }, "data_stream": { "namespace": "ep", "type": "logs", "dataset": "nginx.access" }, "host": { "hostname": "docker-fleet-agent", "os": { "kernel": "5.15.49-linuxkit", "codename": "focal", "name": "Ubuntu", "family": "debian", "type": "linux", "version": "20.04.5 LTS (Focal Fossa)", "platform": "ubuntu" }, "containerized": false, "ip": [ "172.18.0.7" ], "name": "docker-fleet-agent", "id": "66392b0697b84641af8006d87aeb89f1", "mac": [ "02-42-AC-12-00-07" ], "architecture": "x86_64" }, "http": { "request": { "referrer": "http://localhost:8080/", "method": "POST" }, "response": { "status_code": 200, "body": { "bytes": 19432 } }, "version": "1.1" }, "event": { "agent_id_status": "auth_metadata_missing", "ingested": "2024-02-20T09:19:36Z", "timezone": "+05:30", "created": "2024-02-20T14:49:34.740+05:30", "kind": "event", "category": [ "web" ], "type": [ "access" ], "dataset": "nginx.access", "outcome": "success" }, "user": { "name": "citrinemouse" }, "user_agent": { "original": "Chef Client/12.0.3 (ruby-2.1.4-p265; ohai-8.0.1; x86_64-linux; +http://opscode.com)", "os": { "name": "Linux" }, "name": "Other", "device": { "name": "Other" } } } }Checklist
How to test this PR locally
Run this command from package root
elastic-package benchmark rally --benchmark access-benchmark -velastic-package benchmark stream --benchmark access-benchmark -vRelated issues
Screenshots