v2.9.0 of the OpenSearch has marked Neural Search as production ready and out of box.
Previously Lucene had a limit of 1,024 dimension vectors but OpenAI provided embedding with 1,536 dimensions. With OpenSearch 2.9, we can now use embedding created using OpenAI as FAISS support now has 2,048 dimension vector support.
It would be nice for Aiven to update OpenSearch to v2.9 as I am sure the new AI-powered semantic search and ML model support in this release is a big news.
v2.9.0 of the OpenSearch has marked Neural Search as production ready and out of box.
Previously Lucene had a limit of 1,024 dimension vectors but OpenAI provided embedding with 1,536 dimensions. With OpenSearch 2.9, we can now use embedding created using OpenAI as FAISS support now has 2,048 dimension vector support.
It would be nice for Aiven to update OpenSearch to v2.9 as I am sure the new AI-powered semantic search and ML model support in this release is a big news.
https://opensearch.org/blog/introducing-opensearch-2.9.0/