Tag archive

#databases

Topic-specific entry points for internal linking, discovery, and deeper subject exploration.

31 articles

Bloom Filters: The Speed Secret of Modern NoSQL Databases

Bloom Filters: Avoiding the Disk Bottleneck In high-performance databases like Cassandra, RocksDB, and BigTable, the biggest performance killer is unnecessary disk I/O. When you query for a key that doesn't exist, the da…

Apr 20, 20262 min read

Deep Dive

#databases#bloom-filters#nosql

DatabasesAdvanced

Cassandra Gotchas: Dealing with Tombstones and Wide Partitions

Cassandra Gotchas: Managing Distributed Scale Cassandra is built for extreme availability, but its "append-only" storage model (LSM-trees) introduces specific behaviors that can catch developers off guard. Here are the m…

Apr 20, 20263 min read

Deep Dive

#cassandra#databases#performance

DatabasesAdvanced

Cassandra Internals: LSM-Trees, Gossip, and Eventual Consistency

Cassandra Internals: Built for Scale Apache Cassandra is a peer-to-peer distributed database designed to handle massive amounts of data across many commodity servers. Its "Masterless" architecture and high write throughp…

Apr 20, 20262 min read

Deep Dive

#cassandra#databases#lsm-trees

DatabasesAdvanced

Cassandra Multi-Region Architecture: Designing for Global Scale

Cassandra Multi-Region: The Blueprint for 99.999% Availability In a global application, serving data from a single region leads to high latency for distant users and a single point of failure for the entire system. Apach…

Apr 20, 20262 min read

Deep Dive

#cassandra#databases#distributed-systems

System DesignAdvanced

Cloud-Native Databases: Why the Log is the Database

Cloud-Native Databases: The Log is the Database Traditional databases (PostgreSQL, MySQL) were designed to run on a single machine where CPU and Disk are tightly coupled. In the cloud, this architecture hits a ceiling. M…

Apr 20, 20262 min read

Deep Dive

#cloud-native#databases#amazon-aurora

DatabasesAdvanced

Distributed Transactions Part 6: Event Sourcing & CQRS

Part 6: Event Sourcing & CQRS Traditional databases store the "Current State." Event Sourcing stores the "Log of Changes." 1. Why Event Sourcing? It provides a 100% accurate audit trail. You can reconstruct the state of…

Apr 20, 20261 min read

Deep DiveDistributed Transactions Mastery

#event-sourcing#cqrs#databases

DatabasesAdvanced

DynamoDB Pitfalls: Throttling, Hot Partitions, and the 400KB Limit

DynamoDB Pitfalls: Mastering the Serverless Scale DynamoDB is a powerful, fully managed NoSQL database, but its serverless nature comes with strict constraints. If you don't design your schema with these limits in mind,…

Apr 20, 20263 min read

Deep Dive

#dynamodb#aws#databases

System DesignAdvanced

Linearizability vs. Sequential Consistency: A Developer's Guide to Correctness

Linearizability vs. Sequential Consistency If you use a "Consistent" database, what guarantees are you actually getting? In distributed computing, there are two major models of "Strong" consistency. 1. Linearizability (T…

Apr 20, 20263 min read

Deep DiveReliability Engineering Mastery

#distributed-systems#consistency#linearizability

DatabasesAdvanced

Inside the Linux Page Cache: The Invisible Database Accelerator

Inside the Linux Page Cache When your database (PostgreSQL, MongoDB, etc.) reads a row from disk, it doesn't just read the bytes and forget them. The Linux kernel intercepts the request and caches the data in a region of…

Apr 20, 20262 min read

Deep DiveBackend Systems Mastery

#linux#kernel#databases

DatabasesAdvanced

LSM-Tree Compaction Strategies: Leveled vs. Size-Tiered

LSM-Tree Compaction Strategies LSM-tree based databases (Cassandra, RocksDB, ScyllaDB) don't update data in place. They write immutable SSTables. Over time, these files must be merged to reclaim space and improve reads.…

Apr 20, 20262 min read

Deep DiveBackend Systems Mastery

#databases#lsm-trees#cassandra

DatabasesAdvanced

MongoDB Aggregation Pipeline: Optimization and Performance

MongoDB Aggregation: From Query to Performance The Aggregation Framework is MongoDB's powerful data processing engine. It allows you to transform, filter, and group data using a series of stages. However, a poorly optimi…

Apr 20, 20262 min read

Deep Dive

#mongodb#databases#performance

DatabasesIntermediate

MongoDB Anti-Patterns: From Unbounded Arrays to Shard Imbalance

MongoDB Anti-Patterns: Building Scalable Document Stores MongoDB's flexibility is its greatest strength, but it's also a trap for those coming from relational backgrounds. Here are the most critical "gotchas" and anti-pa…

Apr 20, 20263 min read

Deep Dive

#mongodb#databases#performance

DatabasesAdvanced

MongoDB Internals: Deep Dive into WiredTiger and Replication

MongoDB Internals: Under the Hood MongoDB has evolved from a simple JSON-like store into a sophisticated distributed database. Most of its power comes from its default storage engine, WiredTiger, and its robust replicati…

Apr 20, 20262 min read

Deep Dive

#mongodb#databases#wiredtiger

DatabasesAdvanced

NoSQL Schema Evolution: Strategies for Zero-Downtime Data Growth

NoSQL Schema Evolution: Managing Data over Time The biggest lie in software engineering is that NoSQL is "schema-less." In reality, it's just schema-on-read. While the database doesn't enforce a structure, your applicati…

Apr 20, 20263 min read

Deep Dive

#nosql#databases#schema-design

System DesignAdvanced

Beyond CAP: Why PACELC is the Real Rule for Distributed Databases

Beyond CAP: Understanding the PACELC Theorem The CAP theorem (Consistency, Availability, Partition-tolerance) is a useful abstraction, but it only describes what happens when the network is broken. In the real world, the…

Apr 20, 20262 min read

Deep DiveBackend Systems Mastery

#distributed-systems#pacelc#cap-theorem

System DesignBeginner

Beyond CAP: The PACELC Theorem for Distributed Databases

Beyond CAP: Understanding the PACELC Theorem Most engineers know the CAP Theorem: in the presence of a network partition (P), you must choose between Consistency (C) and Availability (A). However, CAP only tells us what…

Apr 20, 20262 min read

Deep Dive

#distributed-systems#pacelc#cap-theorem

DatabasesAdvanced

PostgreSQL MVCC: How Transactions Work Without Locking

PostgreSQL MVCC: ACID Without the Waiting One of the biggest advantages of PostgreSQL is its ability to handle many concurrent users without blocking. This is achieved through MVCC (Multi-Version Concurrency Control). 1.…

Apr 20, 20262 min read

Deep Dive

#postgresql#databases#mvcc

DatabasesAdvanced

Redis Internals: Event Loop, Data Structures, and Persistence

Redis Internals: The Speed of Single-Threading Redis is often categorized as just a "cache," but its internal architecture makes it a powerful data structure server. Let's dive into the core technologies that make Redis…

Apr 20, 20262 min read

Deep Dive

#redis#databases#event-loop

DatabasesAdvanced

Redis Lua Scripting: Ensuring Atomicity in Complex Workflows

Redis Lua Scripting: The Power of Atomicity In distributed systems, race conditions are a constant threat. While Redis offers simple commands like INCR and SETNX, complex workflows often require checking multiple keys or…

Apr 20, 20262 min read

Deep Dive

#redis#databases#lua

DatabasesAdvanced

B-Trees vs. LSM-Trees: The Battle of Storage Engine Internals

B-Trees vs. LSM-Trees: Choosing Your Storage Engine At the heart of every database is a storage engine that decides how data is laid out on disk. The two most dominant architectures are B-Trees and LSM-Trees. Understandi…

Apr 20, 20262 min read

Deep Dive

#databases#storage-engines#btrees

System DesignAdvanced

System Design: Data Partitioning and Sharding Strategies

System Design: Data Partitioning and Sharding When your database outgrows a single machine, you have two choices: Scale Up (bigger machine) or Scale Out (multiple machines). Sharding (Horizontal Partitioning) is the art…

Apr 20, 20262 min read

Deep Dive

#system-design#sharding#partitioning

DatabasesAdvanced

SQL vs NoSQL: Which One for Your Next Production MVP?

SQL vs NoSQL: Making the Right Choice One of the most debated topics in software engineering is whether to use a Relational (SQL) or Non-Relational (NoSQL) database. As a senior engineer, your choice shouldn't be based o…

Apr 20, 20262 min read

ComparisonBackend Systems Mastery

#sql#nosql#databases

DatabasesAdvanced

The Write-Ahead Log (WAL): The Universal Engine of Data Durability

The Write-Ahead Log (WAL): The Heart of Data Safety Whether you are using a relational database like PostgreSQL or a NoSQL store like Cassandra, they all share a common secret for durability and performance: the Write-Ah…

Apr 20, 20262 min read

Deep Dive

#databases#wal#durability

System DesignAdvanced

System Design: Building an Inventory Reservation System

Inventory looks easy until traffic spikes. A product has 10 units. Ten customers should be able to buy it. The eleventh should not. In practice, that clean rule gets blurred by carts, payment retries, partial failures, s…

Apr 10, 202616 min read

Deep Dive

#system design#inventory#ecommerce

System DesignAdvanced

System Design: Building a Payment Reconciliation Engine

Payments look simple from the product surface. A customer pays. The UI says success. The order moves forward. Under the hood, though, the money and the system state do not move in a single atomic transaction. A payment g…

Apr 10, 202616 min read

Deep Dive

#system design#payments#reconciliation

DatabasesAdvanced

PostgreSQL Performance Tuning: From Slow Queries to Sub-Millisecond Reads

PostgreSQL ships with defaults tuned for a 512MB machine from 2005. Every production deployment needs to be re-tuned. Beyond that, most slow queries are not a PostgreSQL problem — they're a query design problem that Post…

Jun 3, 20259 min read

Deep Dive

#postgresql#databases#performance

DatabasesAdvanced

Designing a Database Sharding Strategy for 100 Million Users

Vertical scaling has a ceiling. For most applications, that ceiling arrives somewhere between 1 million and 10 million users, depending on write patterns and data size. At 100 million users, the question is not whether t…

Apr 14, 20259 min read

Case StudyBackend Systems Mastery

#databases#sharding#postgresql

DatabasesIntermediate

Time-Series Databases: InfluxDB vs TimescaleDB vs Prometheus

Time-series data is fundamentally different from general-purpose data: it arrives in time order, is queried by time ranges, has predictable decay in value, and has write patterns that overwhelm traditional relational dat…

Mar 29, 202511 min read

Deep Dive

#time-series#influxdb#timescaledb

DatabasesAdvanced

Database Indexing Deep Dive: B-Trees, Hash Indexes, and Query Planning

Indexes are the single most impactful optimization in database performance. A 10-second query becomes 20ms with the right index. A wrong index slows writes and misleads the query planner. Understanding the internals — no…

Mar 9, 202512 min read

Deep DiveBackend Systems Mastery

#postgresql#indexing#b-tree

DatabasesAdvanced

Elasticsearch Deep Dive: Inverted Index, Mappings, and Query DSL

Most engineers use Elasticsearch as a black box: index some JSON, run a search, get results. When search quality is poor or performance degrades at scale, they reach for random settings without understanding why. This ar…

Feb 24, 202511 min read

Deep Dive

#elasticsearch#search#inverted index

DatabasesAdvanced

PostgreSQL vs MongoDB vs DynamoDB: When to Use Which Database

Every database choice is a bet on your access patterns. PostgreSQL, MongoDB, and DynamoDB are all excellent databases — for different problems. The mistake engineers make is choosing based on hype ("NoSQL scales better")…

Jan 12, 202511 min read

Comparison

#postgresql#mongodb#dynamodb