Settings and activity
17 results found
-
2 votes
An error occurred while saving the comment 
Alessandro Bacchini
supported this idea
·
-
2 votesAlessandro Bacchini
supported this idea
·
-
14 votesAlessandro Bacchini
supported this idea
·
-
33 votesAlessandro Bacchini
supported this idea
·
-
16 votesAlessandro Bacchini
supported this idea
·
-
27 votesAlessandro Bacchini
supported this idea
·
-
25 votesAlessandro Bacchini
supported this idea
·
-
3 votesShelved ·
AdminMichael Tansini (Product Manager Data Streaming (Kafka and Flink), Aiven.io) responded
not currently possible in Kafka natively, will re-evaluate if and when becomes available
Alessandro Bacchini
supported this idea
·
-
3 votesAlessandro Bacchini
supported this idea
·
-
8 votesAlessandro Bacchini
supported this idea
·
-
8 votesAlessandro Bacchini
supported this idea
·
-
9 votesAlessandro Bacchini
supported this idea
·
-
11 votesAlessandro Bacchini
supported this idea
·
-
15 votesAlessandro Bacchini
supported this idea
·
-
55 votesAlessandro Bacchini
supported this idea
·
-
18 votesAlessandro Bacchini
supported this idea
·
-
19 votesAlessandro Bacchini
supported this idea
·
Aiven provides many services for processing and storing data, but it is missing a way for orchestrating them. I think that Airflow may be a good candidate as an orchestration tool.
The deployment of Airflow may be a little complex because it needs a web-server, a scheduler, a triggerer, celery, some workers and a database. However, for the initial implementation a simplified deployment may be considered, using the LocalExecutor. In this case, Airflow will be useful to schedule and to orchestrate processing jobs executed on other platforms like Flink, ClickHouse, MySQL, ...