/ (one folder per collection) # - header.bin (HNSW index configuration) # - data_level0.bin (HNSW graph layer 0) # - length.bin (element count) col = client.get_or_create_collection("notes") col.add( documents=["Remember to buy milk", "Meeting at 3pm tomorrow"], ids=["n1", "n2"], ) # Data is persisted immediately — no commit needed # Verify data survives restart: del client, col # simulate process exit client2 = chromadb.PersistentClient(path="./my_vector_db") col2 = client2.get_collection("notes") print(col2.count()) # 2 — still there! print(col2.get(ids=["n1"])["documents"]) # ["Remember to buy milk"] # Check the files on disk for root, dirs, files in os.walk("./my_vector_db"): for f in files: print(os.path.join(root, f))"> / (one folder per collection) # - header.bin (HNSW index configuration) # - data_level0.bin (HNSW graph layer 0) # - length.bin (element count) col = client.get_or_create_collection("notes") col.add( documents=["Remember to buy milk", "Meeting at 3pm tomorrow"], ids=["n1", "n2"], ) # Data is persisted immediately — no commit needed # Verify data survives restart: del client, col # simulate process exit client2 = chromadb.PersistentClient(path="./my_vector_db") col2 = client2.get_collection("notes") print(col2.count()) # 2 — still there! print(col2.get(ids=["n1"])["documents"]) # ["Remember to buy milk"] # Check the files on disk for root, dirs, files in os.walk("./my_vector_db"): for f in files: print(os.path.join(root, f))" />

Prev Next

Database / ChromaDB Interview Questions

How does ChromaDB's PersistentClient store data on disk, and what are its limitations?

The PersistentClient stores data in a directory you specify. Inside, ChromaDB uses SQLite for metadata (IDs, document text, metadata key-value pairs) and binary files for the HNSW vector index. All writes are flushed to disk automatically — there is no explicit save/commit step.

import chromadb
import os

# Create or open a persistent database
client = chromadb.PersistentClient(path="./my_vector_db")

# After this call, ./my_vector_db/ contains:
# - chroma.sqlite3         (metadata, documents, IDs)
# - <uuid>/               (one folder per collection)
#   - header.bin          (HNSW index configuration)
#   - data_level0.bin     (HNSW graph layer 0)
#   - length.bin          (element count)

col = client.get_or_create_collection("notes")
col.add(
    documents=["Remember to buy milk", "Meeting at 3pm tomorrow"],
    ids=["n1", "n2"],
)
# Data is persisted immediately — no commit needed

# Verify data survives restart:
del client, col  # simulate process exit
client2 = chromadb.PersistentClient(path="./my_vector_db")
col2 = client2.get_collection("notes")
print(col2.count())   # 2 — still there!
print(col2.get(ids=["n1"])["documents"])  # ["Remember to buy milk"]

# Check the files on disk
for root, dirs, files in os.walk("./my_vector_db"):
    for f in files:
        print(os.path.join(root, f))
PersistentClient limitations
LimitationDetail
Single writer onlySQLite allows only one writer at a time — concurrent writes from multiple processes cause errors
No built-in replicationThe SQLite file is a single point of failure; back it up manually
No horizontal scalingCannot distribute load across multiple machines
File lockingMoving or copying the directory while the client is open can corrupt data
MigrationUpgrading ChromaDB versions may require running migration scripts on the SQLite DB

For multi-process or production deployments, prefer running chroma run --path ./data as a server and connecting with HttpClient.

Why is PersistentClient not suitable for concurrent writes from multiple Python processes?
What database engine does ChromaDB's PersistentClient use to store metadata and document text?

Invest now in Acorns!!! 🚀 Join Acorns and get your $5 bonus!

Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!

Earn passively and while sleeping

Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.

Invest now!!! Get Free equity stock (US, UK only)!

Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.

The Robinhood app makes it easy to trade stocks, crypto and more.


Webull! Receive free stock by signing up using the link: Webull signup.

More Related questions...

What is ChromaDB and what problem does it solve? What are embeddings and why are they central to how ChromaDB works? What distance metrics does ChromaDB support and how do you choose between them? What is a ChromaDB collection and how do you create, list, get, and delete collections? How do you add documents to a ChromaDB collection? How do you query a ChromaDB collection for similar documents? How do you retrieve, update, and delete specific documents in ChromaDB? How do you filter query results using metadata in ChromaDB? What is the difference between ChromaDB's in-memory and persistent storage modes? What is ChromaDB's default embedding function and how does it work? How do you use the OpenAI embedding function with ChromaDB? How do you use HuggingFace models as embedding functions in ChromaDB? How do you create a custom embedding function for ChromaDB? How does ChromaDB's PersistentClient store data on disk, and what are its limitations? What is the HNSW index in ChromaDB and what parameters can you tune? How do you efficiently add large numbers of documents to ChromaDB using batching? What is the where_document filter in ChromaDB and how does it differ from where? How do you control what data ChromaDB returns in query and get results using include? How do you design metadata schemas for effective filtering in ChromaDB? How do you inspect a ChromaDB collection's contents and configuration? How do you build a basic RAG (Retrieval-Augmented Generation) pipeline with ChromaDB? What are effective document chunking strategies when indexing documents into ChromaDB for RAG? How do you use ChromaDB as a vector store with LangChain? How do you implement multi-tenancy or data isolation in ChromaDB? What is embedding consistency and why is it critical in ChromaDB applications? How do you run ChromaDB as a standalone HTTP server and connect to it from multiple clients? When should you use upsert() instead of add() in ChromaDB, and what are common patterns? What are best practices for structuring ChromaDB collection metadata for production use? How does ChromaDB compare to FAISS, and when should you choose one over the other? What are common ChromaDB errors and how do you handle them in production code? How do you back up and restore a ChromaDB persistent database? How do you ensure the correct embedding function is used when reopening a persistent ChromaDB collection? How do you interpret ChromaDB query distances and convert them into meaningful relevance scores? What are ChromaDB's practical size limits and performance characteristics at scale? How do you use ChromaDB to detect and remove near-duplicate or semantically similar documents? How do you reset or clear a ChromaDB collection without deleting and recreating it? What configuration settings does ChromaDB support and how do you disable telemetry? What is a production readiness checklist for a ChromaDB-based application?
Show more question and Answers...

Integration

Comments & Discussions