11 results found
-
Support Kafka Single Sign On (OAuth, AAD, SSO)
As a developer / security engineer,
I want to be able to authenticate (i.e. Azure AD) and authorize (OAuth) my service users using OAuth2,
so that I can manage all users in a central place and don't need to worry about missing something during on- and off- boarding.57 votes -
Allow configuration of rate limits and quotas for Aiven for Apache Kafka
As a developer / SRE,
I want to configure quotas for producers and consumers,
so that I can make sure there are no rogue Apache Kafka clients exhausting network bandwidth available for the cluster.
In addition, I can throttle certain clients to simulate and test different network situations and application use-cases, i.e. consumer group auto-scaling.29 votes -
Add users and ACLs to Karapace
As a Service Owner
I want to enable Schema/REST ACLs
so that I can control who has write and read access to my data models
In addition TEST28 votes -
Secure secrets in Hashicorp Vault and use them in Kafka Connect.
As DevOps/SecOps engineer,
I want to securely manage my credentials in Kafka Connect connectors,
so that I can make sure no credentials are being leaked in connector configuration.
In addition, I can manage my credentials in Hashicorp Vault and exercise credential rotation without changing my connector configuration.27 votes -
Azure Blob Storage Kafka connector
As a developer,
I want to read and write data to Azure Blob Storage,
so that I can use that data for stream processing and analytics, and backup / restore data in Apache Kafka.17 votesThis sink is now available in Aiven . See here for our documentation on how to configure a connector
-
Kafka tiered storage
I would like to have the option of using low cost storage to keep my historical Kafka data so that I can have recoverability and lower my costs.
17 votes -
ClickHouse sink for Kafka Connect
As a developer,
I want to sync my data in to Clickhouse,
so that I can store large volumes of data and run analytics on top of it.10 votes -
Kafka fined grained ACLs
As an ops engineer,
I want to be able to declare fined grained ACLs
so that I avoid having to grant "admin" rights to users which only need "DeleteRecords" rights on specific topics.
The client uses Kafka Streams, which needs specific rights (https://docs.confluent.io/platform/current/streams/developer-guide/security.html#required-acl-setting-for-secure-ak-clusters) which are not covered by aiven predefined rights.
Currently, the "admin" is to broad for such access (I don't want the user to be able to create topics).8 votes -
Expose Karapace version
As a developer / user,
I want to know which Karapace version is currently running,
so that I can adapt new features and behaviours faster.
In addition, I would like to have version exposed in logs, HTTP responses and Aiven Console.8 votesThis is now available if you use the service API, and will be available in the Console shortly
A CL API example:
avn service get $SERVICE_NAME --json
Or you can use the GET service information if you use the REST API as documented here https://api.aiven.io/doc/#tag/Service/operation/ServiceGet
This will return the Karapace version in the metadata section of the response
"metadata": {
"kafka_version": "3.6.2",
"karapace_version": "3.12.0",
"service_version_end_of_life": "2024-10-18T00:00:00+00:00"
},
-
Time lag estimation metric for Aiven for Apache Kafka
As a developer,
I want to know how much time will it take for my consumers to catch up when lacking behind,
so that I can programmatically scale my workloads for faster data processing.7 votesIn Limited Availability
-
Kafka rack awareness
Kafka consumer clients on Aiven for Kafka should be able to use client.rack configuration introduced in KIP-392
3 votesnow implemented for Bring Your Own Cloud customers
- Don't see your idea?