4 results found

1. Kafka tiered storage with external S3 bucket

   As a developer
   I want to have the ability to use our own S3 bucket for storing Kafka tiered storage
   so that I can access the data from S3 and query some data for debugging (without streaming all the data to Kafka)

   3 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Shelved  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

2. Sending Apache Kafka metrics to Datadog

   As Software Engineer at Wex
   I want to send additional metrics to Datadog
   so that I can send important metrics from Aiven's cluster as these ones:
   IsrShrinksPerSec
   IsrExpandsPerSec
   ActiveControllerCount
   OfflinePartitionsCount
   TotalTimeMs
   PurgatorySize
   RequestsPerSec
   Network bytes sent/received
   BytesInPerSec/BytesOutPerSec

   According to Datadog's documentation, these metrics are considered highly significant.
   https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/#kafka-emitted-metrics

   2 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Shelved  ·  0 comments  ·  Aiven for Apache Kafka®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

3. Monitoring consume lag for kafka not out of the box

   As a Solutions Architect
   I want to have consumer lag for kafka consumers available out of the box
   so that I can correctly monitor streaming applications without having to setup an external prometheus. In addition Consumer lag is the key metric to monitor for end to end health of streaming apps(ie to ensure they are keeping up with demand), you cannot put a streaming app into production with out correct monitoring and alerting on this metric.

   Background
   1. there is a consumer lag on the default metrics dashboard but it does not work.
   2. I contact support and found that consumer lag is an early access feature that they enabled for me, but in order to get it into grafana it requires setting up an external prometheus(we cant do it all natively in Aiven)
   3. Here is support ticket for Reference: #89595

   As a Solutions Architect
   I want to have consumer lag for kafka consumers available out of the box
   so that I can correctly monitor streaming applications without having to setup an external prometheus. In addition Consumer lag is the key metric to monitor for end to end health of streaming apps(ie to ensure they are keeping up with demand), you cannot put a streaming app into production with out correct monitoring and alerting on this metric.

   Background
   1. there is a consumer lag on the default metrics dashboard but it does not work.
   2. I contact support and found that… more

   1 vote

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Shelved  ·  1 comment  ·  Aiven for Apache Kafka®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

4. Support for both allow and black lists in Kafka service

   As a managed Kafka administrator
   I want to have the ability to black-list a bunch of IP addresses I believe are suspicious from my Kafka service, so that I can prevent my service being disrupted by unexpected traffic
   In addition, I would like to keep the current allow-list to be able to allow know IPs and a way to resolve a conflict between allow and block list where block list takes priority.

   1 vote

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   0 comments  ·  Aiven for Apache Kafka®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close
   Shelved  ·  AdminMichael Tansini (Senior Product Manager, Aiven.io) responded

   at the moment we recommend using our current networking whitelisting capabilities