Settings and activity
20 results found
-
1 voteAlessandro Bacchini shared this idea ·
-
10 votesGathering Interest · AdminMichael Tansini (Product Manager Data Streaming (Kafka and Flink), Aiven.io) respondedAlessandro Bacchini supported this idea ·
-
3 votesAlessandro Bacchini supported this idea ·
-
2 votesAlessandro Bacchini supported this idea ·
-
2 votesAlessandro Bacchini supported this idea ·
-
2 votes
An error occurred while saving the comment Alessandro Bacchini supported this idea · -
14 votesAlessandro Bacchini supported this idea ·
-
34 votesAlessandro Bacchini supported this idea ·
-
16 votesAlessandro Bacchini supported this idea ·
-
28 votesAlessandro Bacchini supported this idea ·
-
25 votesAlessandro Bacchini supported this idea ·
-
3 votesAlessandro Bacchini supported this idea ·
-
8 votesAlessandro Bacchini supported this idea ·
-
8 votesAlessandro Bacchini supported this idea ·
-
9 votesAlessandro Bacchini supported this idea ·
-
11 votesAlessandro Bacchini supported this idea ·
-
15 votesAlessandro Bacchini supported this idea ·
-
55 votesAlessandro Bacchini supported this idea ·
-
18 votesAlessandro Bacchini supported this idea ·
-
19 votesAlessandro Bacchini supported this idea ·
Aiven provides many services for processing and storing data, but it is missing a way for orchestrating them. I think that Airflow may be a good candidate as an orchestration tool.
The deployment of Airflow may be a little complex because it needs a web-server, a scheduler, a triggerer, celery, some workers and a database. However, for the initial implementation a simplified deployment may be considered, using the LocalExecutor. In this case, Airflow will be useful to schedule and to orchestrate processing jobs executed on other platforms like Flink, ClickHouse, MySQL, ...