Tag archive

#storage

Topic-specific entry points for internal linking, discovery, and deeper subject exploration.

7 articles

S3 Express One Zone: When to Use it for Stateful Workloads

S3 Express One Zone Amazon S3 Express One Zone stores data in a single AZ, reducing network hops and latency. It's not a general-purpose storage; it's a specialized tool. 1. Use Case: Transient Data Perfect for Spark Shu…

Apr 20, 20261 min read

Deep DiveBackend Systems Mastery

#aws#s3#storage

MessagingAdvanced

Kafka Internals: Zero-Copy, Log Storage, and High Throughput

Kafka Internals: The Secret to 10M+ Messages/Sec Apache Kafka is often described as a distributed streaming platform, but at its heart, it is a distributed commit log. Its ability to handle millions of messages per secon…

Apr 20, 20263 min read

Deep Dive

#kafka#messaging#distributed-systems

MessagingAdvanced

Kafka Internals: The Storage Layer, Zero-Copy, and High Throughput

Kafka Internals: The Quest for 10M msg/sec Apache Kafka is often described as a distributed streaming platform, but its heart is a Distributed Commit Log. Its ability to handle massive throughput with sub-millisecond lat…

Apr 20, 20263 min read

Deep DiveKafka & Event-Driven Mastery

#kafka#internals#zero-copy

DatabasesAdvanced

Inside the Linux Page Cache: The Invisible Database Accelerator

Inside the Linux Page Cache When your database (PostgreSQL, MongoDB, etc.) reads a row from disk, it doesn't just read the bytes and forget them. The Linux kernel intercepts the request and caches the data in a region of…

Apr 20, 20262 min read

Deep DiveBackend Systems Mastery

#linux#kernel#databases

DatabasesAdvanced

LSM-Tree Compaction Strategies: Leveled vs. Size-Tiered

LSM-Tree Compaction Strategies LSM-tree based databases (Cassandra, RocksDB, ScyllaDB) don't update data in place. They write immutable SSTables. Over time, these files must be merged to reclaim space and improve reads.…

Apr 20, 20262 min read

Deep DiveBackend Systems Mastery

#databases#lsm-trees#cassandra

DatabasesAdvanced

PostgreSQL Vacuum Tuning: Internals of Bloat Control

PostgreSQL Vacuum Tuning: Mastering Bloat Postgres is an MVCC (Multi-Version Concurrency Control) database. When you update a row, Postgres doesn't overwrite it; it marks the old row as "dead" and inserts a new one. Over…

Apr 20, 20261 min read

Deep DiveDatabase Internals

#postgresql#vacuum#bloat

AWSAdvanced

S3 Express One Zone: When to use it

S3 Express One Zone For stateful data processing (like Spark shuffle files), standard S3 latency is too high. S3 Express One Zone offers sub-millisecond access for transient data.

Apr 20, 20261 min read

Deep DiveBackend Systems Mastery

#aws#s3#storage