Skip to content
← Aiven Ideas

Event Streaming

  • Aiven for Apache Kafka® - Apache Kafka as a fully managed service, deployed in the cloud of your choice and a full set of capabilities to build your streaming data pipelines. Find more info in our documentation or developer center.
  • Aiven for Apache Kafka® Connect - Seamlessly transport data with Kafka, integrate with external systems using Kafka Connect
  • Aiven for Apache Kafka® MirrorMaker 2 - replicate data with MirrorMaker 2
  • Karapace - easily manage schemas with Karapace
Join our forum to discuss your ideas with Aiven community or check out our public roadmap.

Event Streaming

Categories

JUMP TO ANOTHER FORUM

(thinking…)

I suggest you ...

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback

22 results found

  1. Support for "stretched" cluster across multi regions/clouds for Aiven for Apache Kafka

    As a developer / SRE,
    I want to have my Apache Kafka cluster to run across multiple regions and potentially even clouds,
    so that I can ensure high availability setup and have near zero RTO and RPO in case of DR, i.e. network, region or provider failure.
    In addition, I want to benefit from the geo-distributed cluster setup and read/write from/to the geographically closest broker to optimise my network latency and cost.

    58 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  2. Programmatic Apache Kafka Consumer (group) management

    As a developer,
    I want to programmatically manage my consumers and consumer groups,
    so that I can see the status of them, perform CRUD operations, show members of a group, reset offsets and similar.
    In addition, I want to be able to do so also in Aiven Console.

    26 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  3. Schema Validation on Apache Kafka broker side

    As a developer,
    I want to make sure schema is being validated not just on client but also on a broker side,
    so that I can make sure all messages in the topic correspond to the same schema and does not contain any mixed schemas.

    22 votes
    Gathering Interest  ·  2 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  4. Support for public CA for SASL for Aiven for Apache Kafka

    As developer,
    I want to use public CA (i.e. Let's Encrypt),
    so that I can connect to my Apache for Kafka service without installing any additional certificates.
    In addition, I can trust publish authority issuing certificates instead of validating 3rd party certificates.

    17 votes
    Gathering Interest  ·  2 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  5. Temporarily disable service user on Aiven for Apache Kafka

    As a developer,
    I want to temporarily disable service user,
    so that I can test is service user still in use by any of the applications or temporarily ban abusive clients.

    12 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  6. Capture and expose "last used" date for service users

    As a developer / SRE,
    I want to know when service users were last used,
    so that I can know is service user still in use or was abandoned and could be removed.

    12 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  7. Support Grouping of OAuth2/OIDC Users

    As a platform engineer
    I want to group multiple users based on their role (OAuth2/OIDC claim)
    so that I can reduce the number of required Kafka users and ACL entries that need to be managed.

    Currently, every user / identity connecting via OAuth2/OIDC has a 1:1 mapping to a Kafka user (the username is taken from the sub claim). This is cumbersome and leads to significant overhead if for example multiple identities / users with the same permissions want to access the Kafka service. Kafka users and ACLs need to be created for every single identity, even though they share…

    11 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  8. Audit logging as self-service option

    As a developer,
    I want to enable audit logging for my service,
    so that I can keep track of breadcrumbs left by all the changes made to a service to ensure compliance.

    11 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  9. Configurable maximum validity for service user certificates

    As a developer / security engineer,
    I want to be able to define lifetime of certificates (i.e. 30-90 days) used to authenticate my service users,
    so that I can have certificate rotation policies in place to ensure compliance and security best practices.

    11 votes
    Gathering Interest  ·  1 comment  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  10. Enforcing naming convention for Apache Kafka topics

    As a SRE / Apache Kafka operator / developer,
    I want to make sure all my topics adhere to a naming convention,
    so that I can ensure consistency of my topics.
    In addition, I can use naming convention to better identify, group, locate and categorise my topics.

    10 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  11. Tagging functionality for Apache Kafka ACLs

    As a developer,
    I want to tag Apache Kafka ACLs,
    so that I can group, search and identify what my ACLs are used for.

    7 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  12. Add MaxTimestampSpec data to the topic/partition details from the Aiven API

    As a developer,
    I want to know latest offset and max timestamp for a given topic/partition,
    so that I can identify when topic/partition was last time used and in case it is no longer in use I can cleanup stale topics/partitions.

    6 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  13. Support for cross-project and cross-vpc service integration for all services in streaming domain

    As a developer,
    I want to integrate my services in streaming domain, i.e. Apache Kafka, Apache Kafka Connect, Apache MirrorMaker2, etc with other services in any project and/or VPC,
    so that I can build data streaming pipelines and benefit from the use use of aforementioned services.

    6 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  14. Include custom Kafka topic tags as Prometheus metric labels

    The Aiven platform allows custom key/value tags to be added to resources such as Kafka topics. It would be useful to have these exposed as additional labels on metrics so that alerts can be triggered based on this metadata.

    3 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  15. Visualization of client IDs that interact with a Kafka cluster

    As a Cloud platform engineer, I need to have a view of Kafka cluster resources consumption across all clients IDs. Such information is needed to configure quotas and to manage them.

    2 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  16. Configure CPU threshold for alert mails in kafka

    As a kafka user, I want to configure the threshold used to send CPU warning emails. Right now we are getting emails because the CPU exceeds 50%, which is irrelevant. We know we can configure the emails to go to another mail address but in that case we would loose all other technical mails as well.
    It would also be good for us if we can turn off that single alert.

    2 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  17. Group topics by type when displayed in Aiven Console

    As a developer / operator,
    I want to see Kafka topics grouped by type in Aiven Console
    so that I can distinguish between topics created by Schema Registry, MirrorMaker2, Connect and directly in Kafka itself.
    In addition, i want to apply filters and sorting by type.

    2 votes
    Gathering Interest  ·  2 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  18. Ability to choose Apache Kafka service user password length using Aiven Console

    As a developer,
    I want to be able to select password length and difficulty when creating a service user,
    so that I can stay complaint with internal security and compliance rules.

    2 votes
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  19. Ability to scale Kafka cluster without upgrade

    As a Kafka Administrator
    I want to ahve ability to scalse Kafka clsuter without upgrade, that increses time of scale.
    In production this can become critical and lead to downtime. For example last 2 times the scale lasted for 12 hours.

    1 vote
    Gathering Interest  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?

  20. kafka_connect_connector_metrics availability over Prometheus

    Our customer Jago wants to monitor the status of connectors and tasks but currently can't find relevant metrics to do so. They want to be able to monitor the status of connectors and tasks on a dashboard and also get notified whenever a connector has not been running for X minutes.

    Jago has a connector running but can not find the metrics for kafka.connect:type=connector-metrics,connector=*.

    The specific metrics they are looking for is the one related to the status of a connector. For example, in the customers current self-managed kafka connect, they have the following metrics. This is convenient because they…

    1 vote
    Gathering Interest  ·  1 comment  ·  Aiven for Apache Kafka®  ·  Admin →
    How important is this to you?
← Previous 1
  • Don't see your idea?