48 results found

1. Opensearch backpressure mechanisms

   As an Opensearch administrator, I want to be able to limit the impact of heavy requests on my cluster.
   So that when some client applications make these requests, I can mitigate impacts for other client applications.

   An example would be to be able to use backpressure mechanism
   https://opensearch.org/docs/latest/tuning-your-cluster/availability-and-recovery/search-backpressure/

   13 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Roadmapped  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

2. make shard_indexing_pressure configurable

   Dear Aiven Community,

   As a DevOps Engineer,
   I want to be able to configure the shardindexingpressure settings directly within the Aiven platform and through the Aiven Terraform provider,
   so that I can better manage indexing loads on Opensearch clusters, optimize performance during high data throughput, and prevent potential bottlenecks.

   In addition, this configuration capability is essential for dynamically adjusting indexing pressure based on real-time data demands. Currently, trying to enable or modify shardindexingpressure settings results in a 403 error, indicating that the feature is not supported in Aiven's current Opensearch offerings. Enabling this feature would allow users to set parameters like softlimit, minlimit, and maxoutstandingrequests to improve operational efficiency and resource utilization.

   This idea is important to me because it supports critical DevOps principles such as infrastructure as code and automation, which are essential for scalable, efficient deployment and management of large-scale search environments. By allowing users to configure these settings, Aiven can enhance its service offerings, making it a more attractive option for enterprises requiring robust, adaptable search infrastructure.

   The benefits of enabling shardindexingpressure in Aiven Opensearch include:

   Improved Performance Management: Users gain the ability to finely tune their cluster's response to varying indexing loads, enhancing overall system responsiveness and stability.
   Greater Flexibility and Control: Configurability via both the Aiven console and Terraform promotes a more tailored approach to resource management, which is especially beneficial in environments with fluctuating data loads.
   Enhanced Resource Efficiency: Proper management of shard indexing pressure prevents overutilization of shard resources, facilitating better distribution and utilization of resources across the cluster.
   I urge the community to support this feature request, as it will significantly enhance the utility and manageability of Aiven's Opensearch service for all users facing similar challenges.

   Thank you for considering this enhancement.

   Best regards,

   Dear Aiven Community,

   As a DevOps Engineer,
   I want to be able to configure the shardindexingpressure settings directly within the Aiven platform and through the Aiven Terraform provider,
   so that I can better manage indexing loads on Opensearch clusters, optimize performance during high data throughput, and prevent potential bottlenecks.

   In addition, this configuration capability is essential for dynamically adjusting indexing pressure based on real-time data demands. Currently, trying to enable or modify shardindexingpressure settings results in a 403 error, indicating that the feature is not supported in Aiven's current Opensearch offerings. Enabling this feature would allow users to set parameters… more

   • 

   8 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Roadmapped  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

3. Enable index rollup settings

   There is a reported issue where incomplete results are returned when querying rollup indexes in OpenSearch. The issue was created upstream and found here:

   https://github.com/opensearch-project/index-management/issues/903#issuecomment-2146610171

   The solution suggested is to enable the plugin "plugins.rollup.search.searchalljobs" and local testing confirms that enabling this resolves the bug report, but access to the /_cluster/settings are currently not supported.

   3 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Roadmapped  ·  1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

4. Promote Follower Cluster to Leader Cluster for OpenSearch

   As a developer or devops engineers
   I want to auto-promote follower OpenSearch Cluster to leader OpenSearch Cluster after I set up OS CrossClusterReplication in case of outage
   so that I can make sure that there will not be any disruption
   In addition, auto-resume would be beneficial once the Leader Cluster is stable

   40 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Roadmapped  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

5. Allow customer to stick with one minor OpenSearch version for an extended period

   As a DB admin
   I want to stick w a minor OS version until I have done all my testing with the new minor versions to make sure it does not break anything
   so that I can confidently upgrade my OS.

   1 vote

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Pending Review  ·  0 comments  ·  Aiven for OpenSearch®  ·  Edit…  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

6. Implement OpenSearch dedicated node role

   As an OpenSearch admin/developer,
   I want to assign certain dedicated role to each the node in my OpenSearch clusters
   In order to optimise the performance of my OS clusters

   26 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Roadmapped  ·  2 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

7. Support and/or adopt PGSync to help users maintain real-time sync between Postgres and Opensearch

   As an OpenSearch and Postgres user
   I want to easily keep these databases in sync
   so that I can provide low latency, high throughput full text search that doesn't impact my transactional database.

   Ever since search engines were invented, developers have struggled with keeping their system of records (typically relational databases like Oracle, Postgres, MySQL, etc) in sync with the search engine. Batch oriented processes are often not real-time enough resulting in poor user experiences where the search results don't return the same information as what's represented in the system of record. Event-oriented solutions such as writing updates from the app layer to Kafka which are then consumed by multiple databases can result in consistency issues and data stores becoming wildly out of sync, requiring a full re-index.

   PGSync could be a helpful tool to address this common challenge: https://pgsync.com/

   As an OpenSearch and Postgres user
   I want to easily keep these databases in sync
   so that I can provide low latency, high throughput full text search that doesn't impact my transactional database.

   Ever since search engines were invented, developers have struggled with keeping their system of records (typically relational databases like Oracle, Postgres, MySQL, etc) in sync with the search engine. Batch oriented processes are often not real-time enough resulting in poor user experiences where the search results don't return the same information as what's represented in the system of record. Event-oriented solutions such as writing updates from the… more

   1 vote

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Pending Review  ·  0 comments  ·  Aiven for OpenSearch®  ·  Edit…  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

8. Opensearch Backup to another Region

   Provide a capability to backup opensearch to a secondary region in the even of hyperscaller regional outage allowing for customers to develop DR strategies meeting their RTO/RPO.

   2 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   Roadmapped  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

9. Make index snapshots possible for faster data restoration

   As a SRE or operations engineer
   I want to be able to create index snapshots manually or with a policy
   so that I can easily and quickly restore partial data after an unintentional index corruption.
   In addition, I understand this would require a shared storage between cluster nodes which means additional storage so it would make sense to make it a paid feature and/or include it in the tiered storage project.

   4 votes

   Vote Vote Vote

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close

   Vote

   We’ll send you updates on this idea

   1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
   How important is this to you?

   Nice to have You must login first! Should have You must login first! Must have You must login first!

   We're glad you're here

   Please sign in to leave feedback

   Signed in as (Sign out)

   Close

   Close
   Gathering Interest  ·  AdminHoang Minh Vo (Product Manager, Aiven.io) responded

   Thanks for posting the idea, the idea is reasonable. I will update the status once we know more about plan with this idea

10. Restore from external snapshot

    As a database administrator
    I want to restore from external snapshot that isnt hosted on Aiven
    so that I can migrate data from certain OpenSearch and Elasticsearch cluster (Aiven and Non-Aiven) to Aiven for OpenSearch

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Roadmapped  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

11. Tiered storage for OpenSearch

    As a developer or database administrator,
    I would like to utilise object storage in my Aiven for OpenSearch instance,
    so that I can store larger amounts of data at a lower cost than attached SSD or HDD.

    37 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close
    Roadmapped  ·  AdminJohn Joseph Kennedy (Head of Databases, Aiven.io) responded

    This is being planned into the roadmap for later in the year. 

12. Support externally hosted models in OpenSearch

    As developer
    I want to configure OpenSearch to generate embeddings using remote models on OpenAI, Cohere, Sagemaker, etc.
    so that I can use the best available models on the market and simplify my codebase by letting OpenSearch generate these embeddings

    https://opensearch.org/docs/latest/ml-commons-plugin/remote-models/index/

    1 vote

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

13. Opensearch ML Plugin cluster settings in UI

    As Developer
    I want to be able to leverage the new ML capabilities in OpenSearch (https://opensearch.org/docs/latest/ml-commons-plugin/)
    so that I can use new features like Semantic search, leveraging external models etc.
    There are various cluster settings that needs to be exposed to the end-users to enable these features.

    The most urgent is "onlyrunonmlnode" which is set to "true" in Aiven Clusters. This needs to be set to "false" to allow ML workloads to be executed on any node (until we have the capability to assign dedicated ML-nodes in the cluster)

    There are more configs that needs to be exposed but "onlyrunonmlnode" is a direct blocker for any ML use-case.

    As Developer
    I want to be able to leverage the new ML capabilities in OpenSearch (https://opensearch.org/docs/latest/ml-commons-plugin/)
    so that I can use new features like Semantic search, leveraging external models etc.
    There are various cluster settings that needs to be exposed to the end-users to enable these features.

    The most urgent is "onlyrunonmlnode" which is set to "true" in Aiven Clusters. This needs to be set to "false" to allow ML workloads to be executed on any node (until we have the capability to assign dedicated ML-nodes in the cluster)

    There are more configs that… more

    5 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Roadmapped  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

14. Ability to change refresh interval for Index using Terraform

    As a DBRE
    I want to change the index refresh interval from a default value to some non-default value as a part of our latency optimization. With that, I would like this ability through IAC and control through our codebase.

    The idea here is to control this value from IAC and in more organized fashion.

    1 vote

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Pending Review  ·  0 comments  ·  Aiven for OpenSearch®  ·  Edit…  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

15. Simplified Data Visualization Dashboard

    As a Data Analyst, I propose developing a user-friendly data visualization dashboard tailored for non-technical users. The goal is to make data insights accessible without requiring advanced analytics skills. This dashboard would feature drag and drop functionality, allowing users to easily customize charts and graphs. Pre-built templates for common metrics could help streamline the process, and real-time data updates would ensure users always see the most current information.

    Incorporating interactive elements like clickable filters and tooltips would enhance usability, enabling users to explore data without feeling overwhelmed. By focusing on intuitive design and ease of use, this dashboard could empower teams to make data-driven decisions more effectively, bridging the gap between complex analytics and everyday business needs.

    As a Data Analyst, I propose developing a user-friendly data visualization dashboard tailored for non-technical users. The goal is to make data insights accessible without requiring advanced analytics skills. This dashboard would feature drag and drop functionality, allowing users to easily customize charts and graphs. Pre-built templates for common metrics could help streamline the process, and real-time data updates would ensure users always see the most current information.

    Incorporating interactive elements like clickable filters and tooltips would enhance usability, enabling users to explore data without feeling overwhelmed. By focusing on intuitive design and ease of use, this dashboard could empower… more

    1 vote

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

16. Inability to extract fields upon search

    As a database admin
    I want to define field patterns at search
    so that I can effectively work with new field pattern

    3 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

17. Support custom plugins in OpenSearch

    As a developer
    I want to use a custom plugin in OpenSearch
    so that I can implement custom scoring or text analysis or use a community open source plugin.

    2 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    0 comments  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close
    Shelved  ·  AdminHoang Minh Vo (Product Manager, Aiven.io) responded

    We need to validate each plugins installed in Aiven for OpenSearch to ensure that the plugin wont cause any harm to our services.

18. OpenSearch Dashboards custom branding

    As an OpenSearch customer,
    I want to change the branding from "OpenSearch" to my own branding,
    In order to allow my end-customer to have access to the same OpenSearch Dashboard that I have

    9 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

19. PPL & Observability SIEM features in OpenSearch

    As a Security Analyst,

    I want to utilise the Observability plugin & PPL in an efficient manner. Features such as tooltips and autocomplete would help a lot, as well as bug fixes and regular updates.

    The syntax is not well nor widely understood, and there are lingering bugs, which for a user are very hard to duplicate across the microcosm of repositories which bundle into the suite.

    Observabilitiy & PPL feels like a very promising place for OpenSearch to become more useful to a security operations team, where currently the capabilities are extremely limiting.

    While OpenSearch Dashboards, with tenancy and VisBuilder have been used, they are complicated, and the search capabilities limit the ability to work in an effective, visual and fast manner.

    Visual aspects are too separate from Search, drill downs are minimal or with a massive time overhead; search is relegated largely to the very basics, for a little more capability they need to be written as an api style query.

    Observability & PPL could be a great improvement if it grows, particularly with security team workflows in mind.

    As a Security Analyst,

    I want to utilise the Observability plugin & PPL in an efficient manner. Features such as tooltips and autocomplete would help a lot, as well as bug fixes and regular updates.

    The syntax is not well nor widely understood, and there are lingering bugs, which for a user are very hard to duplicate across the microcosm of repositories which bundle into the suite.

    Observabilitiy & PPL feels like a very promising place for OpenSearch to become more useful to a security operations team, where currently the capabilities are extremely limiting.

    While OpenSearch Dashboards, with tenancy and… more

    2 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Shelved  ·  1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

20. View the underlying data of a visualisations in OpenSearch Dashboard

    As an OpenSearch user
    I want to view the data underneath the visualisation
    so that I can quickly identify root cause of some abnormal behaviour of my system

    2 votes

    Vote Vote Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close

    Vote

    We’ll send you updates on this idea

    Gathering Interest  ·  1 comment  ·  Aiven for OpenSearch®  ·  Delete…  ·  Admin →
    How important is this to you?

    Nice to have You must login first! Should have You must login first! Must have You must login first!

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    Close

    Close