1,311 questions
0
votes
0
answers
67
views
Consumer with manual ack and transactional producer in SCDF processor
I'm using SCDF 2.11 and I'm trying to implement processors in which we don't want to lose any message.
So we want our producers to be transactional and the consumers to acks messages only if they are ...
- 21
0
votes
0
answers
21
views
How to use Spring Cloud Config for Kafka bindings with Spring Cloud Dataflow?
I'm using SCDF 2.11 with Kafka on Kubernetes platform and I would like to use Spring Cloud Config for application configuration, especially Kafka configurations like topic names.
In our company we ...
- 21
1
vote
0
answers
53
views
Problem when running composed tasks on spring cloud data flow
I am having problems with composed tasks on spring cloud data flow, I get the following error
2025-04-03 15:06:40.357 INFO 2040 --- [ main] o.s.c.d.c.ComposedTaskRunner : ...
0
votes
0
answers
17
views
How to suppress version number suffix from spring cloud data flow deployment name
We currently have dataflow/skipper setup to manage streams in our environment deployed in kubernetes.
When making a deployment change, the next deployment / statefulset appends the incremented version ...
- 29
0
votes
0
answers
64
views
Spring cloud data flow ''Failed to start bean 'taskLifecycleListener'' error
I am trying to run a Spring Batch task in Spring Cloud Data Flow (SCDF), but every time I execute it, the task status remains unknown, and I get the following error in the logs:
stdout:
. ____ ...
1
vote
1
answer
65
views
Spring Cloud data flow docker connection
I have created a Spring Batch app and packaged it as a JAR file. However, when I try to upload it to SCDF (running inside a Docker container), SCDF can't access the JAR file, and I'm not sure how to ...
-1
votes
1
answer
94
views
Spring cloud data flow java version mismatch
i am following the documentation tutorial of spring cloud data flow and when i try to run the default task timestamp i face this error :
stderr:
Error: LinkageError occurred while loading main class ...
0
votes
0
answers
55
views
Task schedule data flow , send current time stamp as argument
I’m using SCDF to create tasks and task schedules. My task accepts current timestamp as the job parameter. But I’m unable to pass the current timestamp using —arguments . Can anyone help me in ...
- 21
0
votes
1
answer
63
views
TIMEZONE issues in apps deployed with SCDF
I've deployed locally with docker and tried different settings, but the timestamp of the task is not applied as I want.
services:
mysql:
image: mysql:5.7
container_name: dataflow-mysql
...
- 37
0
votes
1
answer
34
views
Can I change binding destination naming rule?
I want to change binding destination name separator. For example, given stream name is "inflow" and application name is "parsing",
I want to change inflow.parsing to inflow-parsing....
- 71
0
votes
1
answer
43
views
How do I setup multiple directory configuration using Spring Cloud Dataflow pre-packaged SFTP source?
When using the pre-packaged SFTP source I've been unable to configure multiple directories. Does anyone have a clear example on how to set this up? Either with multiple factories or with a single ...
1
vote
1
answer
104
views
How do I add Metadata in my custom prebuilt application docker image in Spring cloud dataflow
I have customized the JDBC-SOURCE-KAFKA Stream application project and ran the maven commands to generate the Main jar and Metadata jar.
After importing as --URI and --METADATA-URI I can see the ...
- 51
0
votes
1
answer
67
views
Spring Cloud Dataflow Server - NoSQL / MongoDB Database support
The latest milestone release for Spring batch (5.2.0-M2) has added support for MongoDB. Spring cloud dataflow server still requires an RDMBS (MySQL, PostgreSQL etc). Is there a feature request already ...
0
votes
1
answer
31
views
remove app.<application name> dataflow Spring Cloud
Is there a way to remove app. from the application.properties on the dataflow ??
I'm trying to launch a batch on dataflow with some properties.
These properties are loaded from another project so they ...
1
vote
1
answer
56
views
How can I import newer versions of pre-defined SCDF starter apps?
I'm working on evaluating Spring Cloud Data Flow, and want to get a demonstration working with the out of the box apps (Kafka on Kubernetes). I'm having trouble getting things working, but before I ...
- 6,056