Blog
-
Byte-quantized vectors in OpenSearch
In OpenSearch k-NN plugin when we index and query vectors of type float, each vector element occupies 4 bytes. This is getting expensive in terms of memory and storage, especially for large-scale use cases. Starting with the OpenSearch 2.9 release, using the new byte vector feature we can reduce memory and storage requirements, significant reduction in query latencies with a...
Read More -
Growth and community take the spotlight at OpenSearchCon 2023
More than 300 attendees—an increase of 60% year-over-year—arrived at the Sheraton Grand Seattle for 3 days of connecting, sharing, and learning with the OpenSearch community. We renewed old friendships and built some new ones too! Thanks to everyone who took time out of their schedules to be a part of it. There were 32 conference sessions, an unconference, a partner...
Read More -
New IP2Geo processor with automatic update in OpenSearch
When you host a service across geographic regions, it often helps to understand load patterns from various geographies. In many cases it helps to analyze anomalies and attacks. Starting with the 2.10 release, the OpenSearch IP2Geo processor allows you to filter the sources to the city level. Additionally, the IP2Geo processor periodically updates the IP-to-Geo mapping data in the background,...
Read More -
Improve search relevance with hybrid search, generally available in OpenSearch 2.10
In an earlier blog post, a group of Amazon scientists and engineers described methods of combining keyword-based search with dense vector search in order to improve search relevance. With OpenSearch 2.10, you can tune search relevance by using hybrid search, which combines and normalizes query relevance scores. In this post, we’ll describe what hybrid search is and how to use...
Read More -
Improved durability in OpenSearch with remote-backed storage
We are excited to announce remote-backed storage, a new feature that enables request-level durability with remote storage options like Amazon Simple Storage Service (Amazon S3), Oracle Cloud Infrastructure Object Storage, Azure Blob Storage, and Google Cloud Storage. This was introduced as an experimental feature in OpenSearch 2.3 and is now generally available in OpenSearch 2.10. With this feature, users can...
Read More