Designing Idempotent Backfill Checkpoints
Backfills rarely finish in one perfect run. Checkpoint design determines whether a data migration can survive interruption and restart safely.
Database
Explore the category through a featured entry point, a short recommended reading flow, and the tags that appear most often here.
This category currently contains 20 posts.
Featured In This Category
Best Place To Start
Designing Idempotent Backfill Checkpoints
Backfills rarely finish in one perfect run. Checkpoint design determines whether a data migration can survive interruption and restart safely.
Popular Picks
Popular posts in this category
POPULAR
A Complete Guide to Database Transactions and Isolation Levels
This post summarizes ACID properties, transaction isolation levels (Read Uncommitted, Read Committed, Repeatable Read, Serializable), and the problems that occur at each level with practical examples.
POPULAR
A Practical Guide to SQL Performance Optimization
A production-focused guide to SQL tuning that treats performance as a workload problem. Learn how to read plans, reduce data access, tune indexes honestly, and avoid premature query heroics.
POPULAR
Database Partitioning Strategies β Sharding, Horizontal/Vertical Splitting
This post summarizes partitioning strategies for managing large-scale data efficiently. It covers MySQL partitions, horizontal and vertical splitting, and the concepts and implementation approaches behind sharding.
Reading Flow
A Good Order To Read
STEP 1
Applying Expand-Contract to Database Schema Changes
Trying to finish schema changes in one step raises deployment risk. Expand-contract breaks them into safer stages.
STEP 2
Backfill and Data Reconciliation Playbook
The hardest part of a large backfill is often not loading data, but proving the target is correct. Here is a practical reconciliation approach.
STEP 3
Designing Soft Delete and Archive Strategy
A deleted flag is not the end of deletion design. This guide explains how production systems should separate soft delete, archive, and purge.
Key Tags
Most Common Tags Here
Archive
All Posts
Applying Expand-Contract to Database Schema Changes
Trying to finish schema changes in one step raises deployment risk. Expand-contract breaks them into safer stages.
Backfill and Data Reconciliation Playbook
The hardest part of a large backfill is often not loading data, but proving the target is correct. Here is a practical reconciliation approach.
Designing Soft Delete and Archive Strategy
A deleted flag is not the end of deletion design. This guide explains how production systems should separate soft delete, archive, and purge.
Database Learning Path: Beginner to Advanced
A structured database roadmap from indexing and query basics to replication, partitioning, and schema-safe operations.
Read Replica Consistency Playbook
A practical guide to handling lag, read-after-write expectations, and replica-safe query paths in production systems.
Schema Contracts for Data Pipelines
How to manage backward compatibility, field ownership, and change safety across analytics and event pipelines.
Change Data Capture Pipeline Playbook
How to design CDC pipelines for search, analytics, eventing, and downstream sync without turning the database log into uncontrolled system coupling.
A Guide to Zero-Downtime Schema Migration
A practical guide to schema evolution in production using expand-migrate-contract patterns, compatibility windows, and operational safeguards.
A Practical Database Index Design Playbook
A production-oriented playbook for index design that covers read/write tradeoffs, composite indexes, covering indexes, cardinality, execution plans, anti-patterns, and an operational review workflow.
MySQL Index Optimization Strategies β Query Analysis with EXPLAIN
This post explains how MySQL indexes work and how to optimize them using EXPLAIN analysis. It covers composite indexes, covering indexes, and index hints with practical examples.
A Complete Guide to Redis Data Structures β String, Hash, List, Set, ZSet
This post summarizes Redis's five core data structures and practical use cases. It covers how to build sessions, rankings, real-time feeds, and distributed locks with Redis.
A Practical Guide to PostgreSQL
A production-focused guide to PostgreSQL that explains why its real strength is not feature count but the ability to combine relational rigor, analytical SQL, and operational discipline in one system.
A Guide to MongoDB Schema Design
This post explains MongoDB schema design from a practical perspective, going beyond embedding-vs-reference comparisons to cover access patterns, document boundaries, indexes, aggregations, and transaction cost.
A Complete Guide to Database Transactions and Isolation Levels
This post summarizes ACID properties, transaction isolation levels (Read Uncommitted, Read Committed, Repeatable Read, Serializable), and the problems that occur at each level with practical examples.
A Practical Guide to Elasticsearch
This post explains Elasticsearch from a practical engineering perspective: search design, mappings, analyzers, aggregations, and operational cost, rather than just installation and query examples.
A Complete Guide to Solving the JPA N+1 Problem
This post covers multiple ways to solve the N+1 problem, one of the most common JPA performance issues. It explains when to use Fetch Join, EntityGraph, Batch Size, and direct DTO queries.
Database Partitioning Strategies β Sharding, Horizontal/Vertical Splitting
This post summarizes partitioning strategies for managing large-scale data efficiently. It covers MySQL partitions, horizontal and vertical splitting, and the concepts and implementation approaches behind sharding.
A Practical Guide to SQL Performance Optimization
A production-focused guide to SQL tuning that treats performance as a workload problem. Learn how to read plans, reduce data access, tune indexes honestly, and avoid premature query heroics.
Oracle vs. MySQL Differences β Syntax, Functions, and Sequences
This post summarizes the main syntax and feature differences you need to know when migrating from Oracle to MySQL, or from MySQL to Oracle, with practical query examples.