Skip to content

Added Generic SQL output plugin#4205

Closed
illuusio wants to merge 1 commit intoinfluxdata:masterfrom
illuusio:sqloutput
Closed

Added Generic SQL output plugin#4205
illuusio wants to merge 1 commit intoinfluxdata:masterfrom
illuusio:sqloutput

Conversation

@illuusio
Copy link
Copy Markdown

@illuusio illuusio commented May 27, 2018

First small word of warning. This is SQL output plugin is far from perfect. It tries to works automatically with some plugins but with some it fails miserably.

I took generic SQL input plugin and Postgres output plugin PR#3428. Then formulated them into generic SQL plugin. As I know Telegraf is made by InfluxData which makes first grade InfluxDB but there is corner cases when SQL based database is needed to store metrics. It's not fast it's more convenient.
Plugin is at very basic level as I though if it can be get in it should be extended some features in future which are missing (like transactions) and again it's not fastest way to store metrics currently!
I have tested it with Postgres and MariaDB but it should be so generic it could be used with most SQL databases.
As said above this is far from perfect and I really appreciate comments which are not about speed of SQL (I know there is several pull request for Postgres Output plugin which probably do faster) but what is missing and is this even needed output plugin.

Required for all PRs:

  • Signed CLA.
  • Associated README.md updated.
  • Has appropriate unit tests.

@illuusio illuusio force-pushed the sqloutput branch 2 times, most recently from ae13dfd to 8b28eb1 Compare May 31, 2018 13:39
@danielnelson danielnelson mentioned this pull request Jun 12, 2018
3 tasks
@illuusio illuusio force-pushed the sqloutput branch 2 times, most recently from 24b4de8 to e95149e Compare October 31, 2018 13:53
@fgenoese
Copy link
Copy Markdown

Are you still working on this @illuusio ?

@illuusio
Copy link
Copy Markdown
Author

illuusio commented May 25, 2020

Yes I would if there is interest. I kind of settled to Fluentd but it's harder to maintain but supports SQL with plugin. So if there would be solution which have intree support then I'll would settle back.

@fgenoese
Copy link
Copy Markdown

Would it be feasible to write an External Plugin?

@illuusio
Copy link
Copy Markdown
Author

Maybe I have to investigate that.

@illuusio
Copy link
Copy Markdown
Author

If I understood correctly It works only for Input plugins with execd. It could be done with output Exec but needs again more thinking.

@sjwang90 sjwang90 added the external plugin Plugins that would be ideal external plugin and expedite being able to use plugin w/ Telegraf label Nov 20, 2020
@sjwang90 sjwang90 added the plugin/output 1. Request for new output plugins 2. Issues/PRs that are related to out plugins label Jan 26, 2021
@reimda reimda mentioned this pull request May 19, 2021
@sjwang90
Copy link
Copy Markdown
Contributor

sjwang90 commented Jul 1, 2021

outputs.sql released in Telegraf 1.19 - merged in #9280

@sjwang90 sjwang90 closed this Jul 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

external plugin Plugins that would be ideal external plugin and expedite being able to use plugin w/ Telegraf new plugin plugin/output 1. Request for new output plugins 2. Issues/PRs that are related to out plugins

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants