74 results found
-
Opensearch backpressure mechanisms
As an Opensearch administrator, I want to be able to limit the impact of heavy requests on my cluster.
So that when some client applications make these requests, I can mitigate impacts for other client applications.An example would be to be able to use backpressure mechanism
https://opensearch.org/docs/latest/tuning-your-cluster/availability-and-recovery/search-backpressure/13 votes -
make shard_indexing_pressure configurable
Dear Aiven Community,
As a DevOps Engineer,
I want to be able to configure the shardindexingpressure settings directly within the Aiven platform and through the Aiven Terraform provider,
so that I can better manage indexing loads on Opensearch clusters, optimize performance during high data throughput, and prevent potential bottlenecks.In addition, this configuration capability is essential for dynamically adjusting indexing pressure based on real-time data demands. Currently, trying to enable or modify shardindexingpressure settings results in a 403 error, indicating that the feature is not supported in Aiven's current Opensearch offerings. Enabling this feature would allow users to set parameters…
8 votes -
Promote Follower Cluster to Leader Cluster for OpenSearch
As a developer or devops engineers
I want to auto-promote follower OpenSearch Cluster to leader OpenSearch Cluster after I set up OS CrossClusterReplication in case of outage
so that I can make sure that there will not be any disruption
In addition, auto-resume would be beneficial once the Leader Cluster is stable40 votes -
Implement OpenSearch dedicated node role
As an OpenSearch admin/developer,
I want to assign certain dedicated role to each the node in my OpenSearch clusters
In order to optimise the performance of my OS clusters24 votes -
Tiered storage for OpenSearch
As a developer or database administrator,
I would like to utilise object storage in my Aiven for OpenSearch instance,
so that I can store larger amounts of data at a lower cost than attached SSD or HDD.35 votesThis is being planned into the roadmap for later in the year.
-
Support AzureBlobStorage engine for Clickhouse
I need to read and write Parquet format files to/from Azure Blob Storage.
3 votes -
Support protobuf as format for ClickHouse <> Kafka integration
As a user sending Kafka messages to Aiven for ClickHouse,
I want to be able to send those messages using the protobuf format3 votes -
Make index snapshots possible for faster data restoration
As a SRE or operations engineer
I want to be able to create index snapshots manually or with a policy
so that I can easily and quickly restore partial data after an unintentional index corruption.
In addition, I understand this would require a shared storage between cluster nodes which means additional storage so it would make sense to make it a paid feature and/or include it in the tiered storage project.3 votesThanks for posting the idea, the idea is reasonable. I will update the status once we know more about plan with this idea
-
Inability to extract fields upon search
As a database admin
I want to define field patterns at search
so that I can effectively work with new field pattern3 votes -
Support custom plugins in OpenSearch
As a developer
I want to use a custom plugin in OpenSearch
so that I can implement custom scoring or text analysis or use a community open source plugin.2 votesWe need to validate each plugins installed in Aiven for OpenSearch to ensure that the plugin wont cause any harm to our services.
-
Opensearch ML Plugin cluster settings in UI
As Developer
I want to be able to leverage the new ML capabilities in OpenSearch (https://opensearch.org/docs/latest/ml-commons-plugin/)
so that I can use new features like Semantic search, leveraging external models etc.
There are various cluster settings that needs to be exposed to the end-users to enable these features.The most urgent is "onlyrunonmlnode" which is set to "true" in Aiven Clusters. This needs to be set to "false" to allow ML workloads to be executed on any node (until we have the capability to assign dedicated ML-nodes in the cluster)
There are more configs that…
3 votes -
OpenSearch Dashboards custom branding
As an OpenSearch customer,
I want to change the branding from "OpenSearch" to my own branding,
In order to allow my end-customer to have access to the same OpenSearch Dashboard that I have9 votes -
View the underlying data of a visualisations in OpenSearch Dashboard
As an OpenSearch user
I want to view the data underneath the visualisation
so that I can quickly identify root cause of some abnormal behaviour of my system2 votes -
Internal data table/lookup functionality
As a database admin
I want to have queries run upon a schedule and populate internal data tables
so that I can enrich the search and alerting functionality3 votes -
Option for ClickHouse Tiered Storage to use my own object storage
As a user of Aiven for ClickHouse on AWS, Microsoft Azure or Google Cloud:
I would like to leverage my own object storage account with Tiered Storage for Aiven for ClickHouse (that I am already using BYOC on).3 votes -
Offer support for Learning To Rank Opensearch plugin
As an AI engineers, developer using OpenSearch for ML applications,
I want to incorporating machine learning in relevance ranking
So that I can better improve my application with proper ranking-> recommendation8 votes -
Support exactly-once semantics when connecting Kafka to ClickHouse
As a developer using Kafka to stream messages to ClickHouse,
I want to be sure that messages as delivered and ingested exactly once, as opposed to at-least-once, to ClickHouse to not have to deal with duplicated data that I have to deduplicate down the line. This removes both a cognitive and operational load from my data pipeline
c.f. https://github.com/ClickHouse/clickhouse-kafka-connectThe exactly-once semantics has been implemented in the newer version of the ClickHouse Kafka Connect Sink (https://github.com/ClickHouse/clickhouse-kafka-connect).
4 votes -
Opensearch Large Shard Warning
As an operator of Opensearch,
I want to be alerted when my shards are outside of recommend best practices of 10-50GB / shard,
so that I can avoid having overly large shard size cause performance problems for ingestion and query.In addition, please tell me how within the alert to split my shards if they do get too large.
1 voteThanks Jason. We can roadmap this. WIll update the idea when we have more concrete timeline
-
PPL & Observability SIEM features in OpenSearch
As a Security Analyst,
I want to utilise the Observability plugin & PPL in an efficient manner. Features such as tooltips and autocomplete would help a lot, as well as bug fixes and regular updates.
The syntax is not well nor widely understood, and there are lingering bugs, which for a user are very hard to duplicate across the microcosm of repositories which bundle into the suite.
Observabilitiy & PPL feels like a very promising place for OpenSearch to become more useful to a security operations team, where currently the capabilities are extremely limiting.
While OpenSearch Dashboards, with tenancy and…
2 votes -
Make OpenSearch Dashboards session timeout configurable
As a developer
I would like to have the following configuration options exposed:opensearch_security.cookie.ttl
opensearch_security.session.ttl
opensearch_security.session.keepaliveso that I can lengthen the dashboard session timeout for my users.
3 votes
- Don't see your idea?