73 results found

1. Promote Follower Cluster to Leader Cluster for OpenSearch

   As a developer or devops engineers
   I want to auto-promote follower OpenSearch Cluster to leader OpenSearch Cluster after I set up OS CrossClusterReplication in case of outage
   so that I can make sure that there will not be any disruption
   In addition, auto-resume would be beneficial once the Leader Cluster is stable

   40 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Gathering Interest  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

2. Tiered storage for OpenSearch

   As a developer or database administrator,
   I would like to utilise object storage in my Aiven for OpenSearch instance,
   so that I can store larger amounts of data at a lower cost than attached SSD or HDD.

   35 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close
   Roadmapped  ·  AdminJohn Joseph Kennedy (Head of Databases, Aiven.io) responded

   This is being planned into the roadmap for later in the year. 

3. Implement OpenSearch dedicated node role

   As an OpenSearch admin/developer,
   I want to assign certain dedicated role to each the node in my OpenSearch clusters
   In order to optimise the performance of my OS clusters

   24 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Gathering Interest  ·  2 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

4. Opensearch backpressure mechanisms

   As an Opensearch administrator, I want to be able to limit the impact of heavy requests on my cluster.
   So that when some client applications make these requests, I can mitigate impacts for other client applications.

   An example would be to be able to use backpressure mechanism
   https://opensearch.org/docs/latest/tuning-your-cluster/availability-and-recovery/search-backpressure/

   13 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

5. OpenSearch Dashboards custom branding

   As an OpenSearch customer,
   I want to change the branding from "OpenSearch" to my own branding,
   In order to allow my end-customer to have access to the same OpenSearch Dashboard that I have

   9 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Gathering Interest  ·  1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

6. make shard_indexing_pressure configurable

   Dear Aiven Community,

   As a DevOps Engineer,
   I want to be able to configure the shardindexingpressure settings directly within the Aiven platform and through the Aiven Terraform provider,
   so that I can better manage indexing loads on Opensearch clusters, optimize performance during high data throughput, and prevent potential bottlenecks.

   In addition, this configuration capability is essential for dynamically adjusting indexing pressure based on real-time data demands. Currently, trying to enable or modify shardindexingpressure settings results in a 403 error, indicating that the feature is not supported in Aiven's current Opensearch offerings. Enabling this feature would allow users to set parameters like softlimit, minlimit, and maxoutstandingrequests to improve operational efficiency and resource utilization.

   This idea is important to me because it supports critical DevOps principles such as infrastructure as code and automation, which are essential for scalable, efficient deployment and management of large-scale search environments. By allowing users to configure these settings, Aiven can enhance its service offerings, making it a more attractive option for enterprises requiring robust, adaptable search infrastructure.

   The benefits of enabling shardindexingpressure in Aiven Opensearch include:

   Improved Performance Management: Users gain the ability to finely tune their cluster's response to varying indexing loads, enhancing overall system responsiveness and stability.
   Greater Flexibility and Control: Configurability via both the Aiven console and Terraform promotes a more tailored approach to resource management, which is especially beneficial in environments with fluctuating data loads.
   Enhanced Resource Efficiency: Proper management of shard indexing pressure prevents overutilization of shard resources, facilitating better distribution and utilization of resources across the cluster.
   I urge the community to support this feature request, as it will significantly enhance the utility and manageability of Aiven's Opensearch service for all users facing similar challenges.

   Thank you for considering this enhancement.

   Best regards,

   Dear Aiven Community,

   As a DevOps Engineer,
   I want to be able to configure the shardindexingpressure settings directly within the Aiven platform and through the Aiven Terraform provider,
   so that I can better manage indexing loads on Opensearch clusters, optimize performance during high data throughput, and prevent potential bottlenecks.

   In addition, this configuration capability is essential for dynamically adjusting indexing pressure based on real-time data demands. Currently, trying to enable or modify shardindexingpressure settings results in a 403 error, indicating that the feature is not supported in Aiven's current Opensearch offerings. Enabling this feature would allow users to set parameters… more

   • 

   8 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

7. Offer support for Learning To Rank Opensearch plugin

   As an AI engineers, developer using OpenSearch for ML applications,
   I want to incorporating machine learning in relevance ranking
   So that I can better improve my application with proper ranking-> recommendation

   8 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Gathering Interest  ·  3 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

8. Enable cross region replication

   As a business owner,
   I would like to have the ability to set up a replication of my Aiven for ClickHouse service, and all the object storage attached to it, to a secondary region,
   so that in the case of needing disaster recovery from the primary region going down, we could fail our workload traffic over to the secondary region.

   The replicated secondary region does not need to be writable until the primary is unavailable, but we would like to read from it to validate consistency. As a customer we'll handle the failover mechanism.

   7 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Gathering Interest  ·  0 comments  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

9. S3Queue Engine in v23.8

   As developer against ClickHouse,
   I want to utilise the S3Queue engine available in v23.8
   so that I can watch an S3 bucket, and auto consume new files as they appear, via a materialized view, as soon as they arrive.

   This will enable me to keep my analytics up to date with no need for additional engineering effort or streaming pipelines.

   6 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Gathering Interest  ·  0 comments  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

10. Performance insights for ClickHouse

    As someone managing a Clickhouse instance that delivers my production workloads,
    I want to have better insight into what is causing slow queries against my data,
    so that I can get to the root cause and take corrective actions.
    In addition, it's important to have these metrics available for export to my monitoring system

    6 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

11. Support exactly-once semantics when connecting Kafka to ClickHouse

    As a developer using Kafka to stream messages to ClickHouse,
    I want to be sure that messages as delivered and ingested exactly once, as opposed to at-least-once, to ClickHouse to not have to deal with duplicated data that I have to deduplicate down the line. This removes both a cognitive and operational load from my data pipeline
    c.f. https://github.com/ClickHouse/clickhouse-kafka-connect

    The exactly-once semantics has been implemented in the newer version of the ClickHouse Kafka Connect Sink (https://github.com/ClickHouse/clickhouse-kafka-connect).

    4 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Roadmapped  ·  0 comments  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

12. Add support for the DeltaLake Engine to ClickHouse

    As a customer of Aiven, I would like to pull data from many disparate sources into my ClickHouse data warehouse to provide my users best-in-class analytics and performance. Adding support for DeltaLake would open up new sources from which I can seamlessly consume from.

    4 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Roadmapped  ·  0 comments  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

13. Opensearch mTLS authentication

    As developer
    I want to connect to Opensearch using mTLS connection
    so that I can rely on a trusted connection instead only on IP filtering or other mechanisms.

    4 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

14. Support protobuf as format for ClickHouse <> Kafka integration

    As a user sending Kafka messages to Aiven for ClickHouse,
    I want to be able to send those messages using the protobuf format

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

15. Opensearch ML Plugin cluster settings in UI

    As Developer
    I want to be able to leverage the new ML capabilities in OpenSearch (https://opensearch.org/docs/latest/ml-commons-plugin/)
    so that I can use new features like Semantic search, leveraging external models etc.
    There are various cluster settings that needs to be exposed to the end-users to enable these features.

    The most urgent is "onlyrunonmlnode" which is set to "true" in Aiven Clusters. This needs to be set to "false" to allow ML workloads to be executed on any node (until we have the capability to assign dedicated ML-nodes in the cluster)

    There are more configs that needs to be exposed but "onlyrunonmlnode" is a direct blocker for any ML use-case.

    As Developer
    I want to be able to leverage the new ML capabilities in OpenSearch (https://opensearch.org/docs/latest/ml-commons-plugin/)
    so that I can use new features like Semantic search, leveraging external models etc.
    There are various cluster settings that needs to be exposed to the end-users to enable these features.

    The most urgent is "onlyrunonmlnode" which is set to "true" in Aiven Clusters. This needs to be set to "false" to allow ML workloads to be executed on any node (until we have the capability to assign dedicated ML-nodes in the cluster)

    There are more configs that… more

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

16. Support for 3rd party ETL tools with Aiven for ClickHouse

    As an Data Engineer
    I want to use 3rd party ETL tools to populate Clickhouse tables
    so that I can use clickhouse as my warehouse. Currently popular tools such as airbyte do not work when connected to Aiven clickhouse due to the fact that it creates internal state tables within clickhouse, and it fails given that tables are not allow to be created outside the context of the Aiven console. Customers are unable to use external tools that can self manage state and required the permission.

    2024-01-26 22:37:45 normalization > Code: 497. DB::Exception: avnadmin: Not enough privileges. To execute this query, it's necessary to have the grant CREATE DATABASE ON airbytedefault.*. (ACCESS_DENIED) (version 23.8.8.1)

    As an Data Engineer
    I want to use 3rd party ETL tools to populate Clickhouse tables
    so that I can use clickhouse as my warehouse. Currently popular tools such as airbyte do not work when connected to Aiven clickhouse due to the fact that it creates internal state tables within clickhouse, and it fails given that tables are not allow to be created outside the context of the Aiven console. Customers are unable to use external tools that can self manage state and required the permission.

    2024-01-26 22:37:45 normalization > Code: 497. DB::Exception: avnadmin: Not enough privileges. To execute this… more

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  1 comment  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

17. Make OpenSearch Dashboards session timeout configurable

    As a developer
    I would like to have the following configuration options exposed:

    opensearch_security.cookie.ttl
    opensearch_security.session.ttl
    opensearch_security.session.keepalive

    so that I can lengthen the dashboard session timeout for my users.

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

18. Inability to extract fields upon search

    As a database admin
    I want to define field patterns at search
    so that I can effectively work with new field pattern

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

19. Internal data table/lookup functionality

    As a database admin
    I want to have queries run upon a schedule and populate internal data tables
    so that I can enrich the search and alerting functionality

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

20. Option for ClickHouse Tiered Storage to use my own object storage

    As a user of Aiven for ClickHouse on AWS, Microsoft Azure or Google Cloud:
    I would like to leverage my own object storage account with Tiered Storage for Aiven for ClickHouse (that I am already using BYOC on).

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Roadmapped  ·  0 comments  ·  Aiven for ClickHouse®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close