1 views collected around this technical thread.
This article explains what vectors and vector databases are, how they differ from traditional databases, their core technologies, their relationship with large language models, market trends, and details of Tencent Cloud VectorDB’s capabilities, architecture, real‑world applications, and future competitive challenges.
Vector databases store and search large-scale vector data, and in 2023 the five leading solutions—Chroma, Pinecone, Weaviate, Milvus, and Faiss—offer scalable, high-performance options for applications such as LLM-driven services, audio search, recommendation systems, image/video analysis, and semantic retrieval across various industries.
The article explains what vector databases are, how vectors and embeddings work, the main embedding methods such as matrix factorization, NLP and graph techniques, the characteristics and high‑availability requirements of vector databases, and common AI‑driven application scenarios like semantic search, recommendation and anomaly detection.
This tutorial explains what Faiss is, how to install it, construct various indexes such as IndexFlatL2, IndexIVFFlat, and IndexIVFPQ, and demonstrates code examples for building and querying vector similarity search pipelines while discussing speed‑accuracy trade‑offs.
This article examines the challenges of performing time‑series similarity queries on massive datasets and presents three scalable solutions—partition‑based indexing, dimensionality‑reduction using MinHash, and a combined approach with Locality Sensitive Hashing—to reduce computation while preserving similarity accuracy.
This article introduces the background of vector representations in machine learning, explains the K‑Nearest Neighbors algorithm and its key parameters, reviews traditional tree‑based and modern high‑performance search solutions, and demonstrates how FAISS can achieve microsecond‑level KNN queries on large‑scale high‑dimensional data.
MSQL+ is a plugin toolkit that embeds similarity‑search capabilities directly into distributed relational databases such as Tencent’s TDSQL, using B‑tree indexes on generated signatures, customizable DIST functions, and various pivot‑selection strategies to enable scalable, SQL‑standard, approximate queries across sharded data.