89 results found
-
Promote Follower Cluster to Leader Cluster for OpenSearch
As a developer or devops engineers
I want to auto-promote follower OpenSearch Cluster to leader OpenSearch Cluster after I set up OS CrossClusterReplication in case of outage
so that I can make sure that there will not be any disruption
In addition, auto-resume would be beneficial once the Leader Cluster is stable40 votes -
Tiered storage for OpenSearch
As a developer or database administrator,
I would like to utilise object storage in my Aiven for OpenSearch instance,
so that I can store larger amounts of data at a lower cost than attached SSD or HDD.37 votesThis is being planned into the roadmap for later in the year.
-
Implement OpenSearch dedicated node role
As an OpenSearch admin/developer,
I want to assign certain dedicated role to each the node in my OpenSearch clusters
In order to optimise the performance of my OS clusters26 votes -
Opensearch backpressure mechanisms
As an Opensearch administrator, I want to be able to limit the impact of heavy requests on my cluster.
So that when some client applications make these requests, I can mitigate impacts for other client applications.An example would be to be able to use backpressure mechanism
https://opensearch.org/docs/latest/tuning-your-cluster/availability-and-recovery/search-backpressure/13 votes -
OpenSearch Dashboards custom branding
As an OpenSearch customer,
I want to change the branding from "OpenSearch" to my own branding,
In order to allow my end-customer to have access to the same OpenSearch Dashboard that I have9 votes -
make shard_indexing_pressure configurable
Dear Aiven Community,
As a DevOps Engineer,
I want to be able to configure the shardindexingpressure settings directly within the Aiven platform and through the Aiven Terraform provider,
so that I can better manage indexing loads on Opensearch clusters, optimize performance during high data throughput, and prevent potential bottlenecks.In addition, this configuration capability is essential for dynamically adjusting indexing pressure based on real-time data demands. Currently, trying to enable or modify shardindexingpressure settings results in a 403 error, indicating that the feature is not supported in Aiven's current Opensearch offerings. Enabling this feature would allow users to set parameters…
8 votes -
Offer support for Learning To Rank Opensearch plugin
As an AI engineers, developer using OpenSearch for ML applications,
I want to incorporating machine learning in relevance ranking
So that I can better improve my application with proper ranking-> recommendation8 votes -
S3Queue Engine in v23.11
As developer against ClickHouse,
I want to utilise the S3Queue engine available in v23.11
so that I can watch an S3 bucket, and auto consume new files as they appear, via a materialized view, as soon as they arrive.This will enable me to keep my analytics up to date with no need for additional engineering effort or streaming pipelines.
7 votes -
Enable cross region replication
As a business owner,
I would like to have the ability to set up a replication of my Aiven for ClickHouse service, and all the object storage attached to it, to a secondary region,
so that in the case of needing disaster recovery from the primary region going down, we could fail our workload traffic over to the secondary region.The replicated secondary region does not need to be writable until the primary is unavailable, but we would like to read from it to validate consistency. As a customer we'll handle the failover mechanism.
7 votes -
Performance insights for ClickHouse
As someone managing a Clickhouse instance that delivers my production workloads,
I want to have better insight into what is causing slow queries against my data,
so that I can get to the root cause and take corrective actions.
In addition, it's important to have these metrics available for export to my monitoring system6 votes -
Support protobuf as format for ClickHouse <> Kafka integration
As a user sending Kafka messages to Aiven for ClickHouse,
I want to be able to send those messages using the protobuf format5 votes -
Opensearch ML Plugin cluster settings in UI
As Developer
I want to be able to leverage the new ML capabilities in OpenSearch (https://opensearch.org/docs/latest/ml-commons-plugin/)
so that I can use new features like Semantic search, leveraging external models etc.
There are various cluster settings that needs to be exposed to the end-users to enable these features.The most urgent is "onlyrunonmlnode" which is set to "true" in Aiven Clusters. This needs to be set to "false" to allow ML workloads to be executed on any node (until we have the capability to assign dedicated ML-nodes in the cluster)
There are more configs that…
5 votes -
Support exactly-once semantics when connecting Kafka to ClickHouse
As a developer using Kafka to stream messages to ClickHouse,
I want to be sure that messages as delivered and ingested exactly once, as opposed to at-least-once, to ClickHouse to not have to deal with duplicated data that I have to deduplicate down the line. This removes both a cognitive and operational load from my data pipeline
c.f. https://github.com/ClickHouse/clickhouse-kafka-connectThe exactly-once semantics has been implemented in the newer version of the ClickHouse Kafka Connect Sink (https://github.com/ClickHouse/clickhouse-kafka-connect).
5 votes -
Opensearch mTLS authentication
As developer
I want to connect to Opensearch using mTLS connection
so that I can rely on a trusted connection instead only on IP filtering or other mechanisms.5 votes -
Aiven for ClickHouse on Oracle Cloud
As an Aiven user and Aiven for ClickHouse user,
I want to be able to use Aiven for ClickHouse on Oracle Cloud with all the Aiven capabilities available on the other cloud providers, seamlessly.4 votes -
Make index snapshots possible for faster data restoration
As a SRE or operations engineer
I want to be able to create index snapshots manually or with a policy
so that I can easily and quickly restore partial data after an unintentional index corruption.
In addition, I understand this would require a shared storage between cluster nodes which means additional storage so it would make sense to make it a paid feature and/or include it in the tiered storage project.4 votesThanks for posting the idea, the idea is reasonable. I will update the status once we know more about plan with this idea
-
Option for ClickHouse Tiered Storage to use my own object storage
As a user of Aiven for ClickHouse on AWS, Microsoft Azure or Google Cloud:
I would like to leverage my own object storage account with Tiered Storage for Aiven for ClickHouse (that I am already using BYOC on).4 votes -
Backup to another region for ClickHouse
As a developer, as a DR requirement, I would like to be able to restore the service from its backup in cases where the service's hosting region is down.
4 votes -
Add support for the DeltaLake Engine to ClickHouse
As a customer of Aiven, I would like to pull data from many disparate sources into my ClickHouse data warehouse to provide my users best-in-class analytics and performance. Adding support for DeltaLake would open up new sources from which I can seamlessly consume from.
4 votes -
Enable index rollup settings
There is a reported issue where incomplete results are returned when querying rollup indexes in OpenSearch. The issue was created upstream and found here:
https://github.com/opensearch-project/index-management/issues/903#issuecomment-2146610171
The solution suggested is to enable the plugin "plugins.rollup.search.searchalljobs" and local testing confirms that enabling this resolves the bug report, but access to the /_cluster/settings are currently not supported.
3 votes
- Don't see your idea?