Curriculum planned

Stage 05 · Data Formats, Storage & Distributed Systems

Object Storage, S3 Concepts and MinIO

A complete object-storage course covering S3 concepts and APIs, MinIO deployment, mc administration, buckets and objects, metadata/tags, multipart and range operations, presigned access, consistency and concurrency, versioning, lifecycle, object locking/WORM, erasure coding, healing, distributed server pools, bucket/site replication, encryption/KMS, IAM/STS/OIDC/LDAP, TLS, events, batch operations, observability, performance, application SDKs, data-lake integration, governance, upgrades, disaster recovery, and production architecture.

Browse planned curriculum Back to all courses

30planned chapters

150reserved lesson paths

Beginner → Advancedlearning level

Plannedcourse state

Coverage baselineCurrent MinIO/S3-compatible operational concepts, including erasure coding, distributed deployments, versioning-dependent replication, site replication, KMS-backed server-side encryption, lifecycle/object locking, identity integration, and high-performance data-lake/AI storage patterns

Course brief

Operate object storage as a distributed data platform by understanding S3 semantics, MinIO erasure-coded architecture, identity/security, lifecycle, replication, performance, and failure recovery.

This syllabus deliberately separates foundations, data/model semantics, internals, reliability, security, performance, operations, and production design so advanced material is not compressed into generic catch-all chapters.

By the end

You will be able to

Use S3-compatible APIs and MinIO tooling for buckets, objects, multipart/range operations, metadata, tags, versioning, lifecycle, retention, and presigned access
Design MinIO topologies around drives, erasure sets, read/write quorum, healing, server pools, failure domains, and capacity headroom
Secure object storage with TLS, IAM policies, STS, OIDC/LDAP integration, KMS-backed encryption, object locking, audit evidence, and least privilege
Configure and reason about bucket/site replication, event notifications, observability, performance, upgrades, and disaster-recovery workflows
Integrate S3-compatible storage with analytical engines and applications while measuring request, throughput, latency, durability, and cost tradeoffs

Complete planned syllabus

30 chapters · 150 lesson paths.

Every lesson path is reserved now but intentionally not linked until its lesson HTML is actually published. The sequence moves from foundations through advanced implementation, architecture, operations, reliability, security, tuning, and a production capstone.

Chapter 1

Object Storage Foundations: Objects, Buckets, Keys, Metadata, S3 Compatibility, and Workload Fit

5 lessons

Object Storage vs Filesystems, Block Storage, Databases, and Distributed File Systems: Naming, Mutability, and Access SemanticsPlanned lesson · reserved path Chapter01/Lesson1.html

Planned02

Buckets, Object Keys, Prefixes, Metadata, Tags, Versions, Checksums, and the Flat Namespace IllusionPlanned lesson · reserved path Chapter01/Lesson2.html

Planned03

S3 API as an Ecosystem Contract: Compatibility Is Behavioral, Not Merely Endpoint SyntaxPlanned lesson · reserved path Chapter01/Lesson3.html

Planned04

Consistency, Durability, Availability, Throughput, Latency, and Cost Dimensions for Object WorkloadsPlanned lesson · reserved path Chapter01/Lesson4.html

Planned05

Design a Workload-Fit Matrix for Backups, Data Lakes, Media, ML Artifacts, Logs, Static Assets, and Transactional MisusePlanned lesson · reserved path Chapter01/Lesson5.html

Planned

Chapter 2

HTTP and S3 API Mechanics: Requests, Authentication, Endpoints, Regions, and Error Semantics

5 lessons

S3 REST Operations, HTTP Methods, Headers, Status Codes, XML/JSON Responses, and Idempotency ExpectationsPlanned lesson · reserved path Chapter02/Lesson1.html

Planned02

Virtual-Hosted vs Path-Style Addressing, Endpoints, Regions, DNS, Proxies, and TLS Certificate ImplicationsPlanned lesson · reserved path Chapter02/Lesson2.html

Planned03

Signature V4 Concepts, Canonical Requests, Signed Headers, Clock Skew, Access/Secret Keys, and Credential ScopePlanned lesson · reserved path Chapter02/Lesson3.html

Planned04

Common Error Families: AccessDenied, NoSuchKey, SlowDown/Throttling, SignatureMismatch, Timeout, and RetryabilityPlanned lesson · reserved path Chapter02/Lesson4.html

Planned05

Trace a PUT and GET with CLI/SDK Debug Logging and Classify Every Network, Auth, and Storage-Layer StepPlanned lesson · reserved path Chapter02/Lesson5.html

Planned

Chapter 3

MinIO Architecture, Editions/Deployment Choices, and Reproducible Lab Setup

5 lessons

MinIO as S3-Compatible Software-Defined Object Storage and the Role of Erasure CodingPlanned lesson · reserved path Chapter03/Lesson1.html

Planned02

Single-Node/Single-Drive, Single-Node/Multi-Drive, and Multi-Node/Multi-Drive Topologies and Reliability BoundariesPlanned lesson · reserved path Chapter03/Lesson2.html

Planned03

Install MinIO Locally or in Containers, Configure Drives/Volumes, Start Server, and Verify HealthPlanned lesson · reserved path Chapter03/Lesson3.html

Planned04

Console, S3 API, Admin API, Configuration Environment, Credentials, and Storage Directory OwnershipPlanned lesson · reserved path Chapter03/Lesson4.html

Planned05

Build a Reproducible Lab with Multiple Drives/Nodes, TLS, mc, Metrics, Sample Objects, and Safe Reset ProceduresPlanned lesson · reserved path Chapter03/Lesson5.html

Planned

Chapter 4

MinIO Client (mc) and Administrative Workflows

5 lessons

Configure mc Aliases, Credentials, TLS Trust, Output Modes, and Multiple EnvironmentsPlanned lesson · reserved path Chapter04/Lesson1.html

Planned02

mc ls/stat/cp/mirror/rm/cat/head/find/du/tree-Like Workflows for Object OperationsPlanned lesson · reserved path Chapter04/Lesson2.html

Planned03

mc admin info/config/service/trace/logs/prometheus-Like Operational Commands and Safety BoundariesPlanned lesson · reserved path Chapter04/Lesson3.html

Planned04

Scripting mc with JSON Output, Exit Codes, Idempotency, and Non-Interactive CredentialsPlanned lesson · reserved path Chapter04/Lesson4.html

Planned05

Create an Admin Runbook that Diagnoses Cluster Health Without Directly Modifying MinIO's Internal Drive FilesPlanned lesson · reserved path Chapter04/Lesson5.html

Planned

Chapter 5

Buckets, Objects, Prefixes, Metadata, Tags, Checksums, and Naming Design

5 lessons

Bucket Naming, Creation/Deletion, Region Semantics, Empty-Bucket Requirements, and Tenant BoundariesPlanned lesson · reserved path Chapter05/Lesson1.html

Planned02

Object Keys, Prefix Organization, Delimiters, Listing Pagination, Lexicographic Behavior, and Hot Prefix Myths/RealityPlanned lesson · reserved path Chapter05/Lesson2.html

Planned03

Content-Type, Cache-Control, Content-Disposition, User Metadata, Tags, and Metadata Replacement on CopyPlanned lesson · reserved path Chapter05/Lesson3.html

Planned04

ETag vs Content Checksum, Multipart ETag Caveats, Explicit Checksum Algorithms, and Integrity VerificationPlanned lesson · reserved path Chapter05/Lesson4.html

Planned05

Design an Object-Key/Metadata Contract for Partitioned Analytical Data with Stable Naming and Lifecycle TagsPlanned lesson · reserved path Chapter05/Lesson5.html

Planned

Chapter 6

PUT/GET/HEAD/COPY/DELETE, Range Reads, Conditional Requests, and Concurrency Control

5 lessons

Single-Part Upload/Download, HEAD Metadata Reads, Server-Side COPY, Delete, and Error HandlingPlanned lesson · reserved path Chapter06/Lesson1.html

Planned02

HTTP Range GET for Large Objects, Parquet/ORC Footer Access, Resumable Reads, and Proxy/CDN InteractionPlanned lesson · reserved path Chapter06/Lesson2.html

Planned03

Conditional Requests with ETag/If-Match/If-None-Match Concepts for Optimistic ConcurrencyPlanned lesson · reserved path Chapter06/Lesson3.html

Planned04

Concurrent Writers to the Same Key, Last-Writer Semantics, Versioning Interaction, and Application-Level CoordinationPlanned lesson · reserved path Chapter06/Lesson4.html

Planned05

Build a Safe Read-Modify-Publish Workflow that Avoids Treating Object Storage Like an Atomic POSIX FilesystemPlanned lesson · reserved path Chapter06/Lesson5.html

Planned

Chapter 7

Multipart Uploads, Parallel Transfers, Resume/Abort, and Large-Object Engineering

5 lessons

Multipart Upload Lifecycle: Initiate, Upload Parts, List Parts, Complete, Abort, and Resulting Object AtomicityPlanned lesson · reserved path Chapter07/Lesson1.html

Planned02

Part Size/Count Constraints, Parallelism, Memory, Network Saturation, Retry Scope, and Throughput TuningPlanned lesson · reserved path Chapter07/Lesson2.html

Planned03

Incomplete Multipart Upload Accumulation, Cleanup/Lifecycle, Billing/Capacity Impact, and Operational MonitoringPlanned lesson · reserved path Chapter07/Lesson3.html

Planned04

Multipart Copy and Large-Object Migration Patterns Without Downloading Through the ClientPlanned lesson · reserved path Chapter07/Lesson4.html

Planned05

Benchmark Single vs Multipart Upload with Varying Part Sizes/Concurrency and Measure p95 Throughput/Failure RecoveryPlanned lesson · reserved path Chapter07/Lesson5.html

Planned

Chapter 8

Presigned URLs, Temporary Access, Browser Uploads, and Application Delegation

5 lessons

Presigned GET/PUT Concepts, Signature Scope, Expiration, Headers, and Why the URL Itself Is a CredentialPlanned lesson · reserved path Chapter08/Lesson1.html

Planned02

POST Policies for Browser/Form Uploads, Object-Key Constraints, Size Limits, Content-Type, and User ExperiencePlanned lesson · reserved path Chapter08/Lesson2.html

Planned03

Delegating Direct Client-to-Object-Store Uploads to Reduce Application Server BandwidthPlanned lesson · reserved path Chapter08/Lesson3.html

Planned04

Revocation Limitations, Short TTLs, Credential Rotation, Network Exposure, and Audit CorrelationPlanned lesson · reserved path Chapter08/Lesson4.html

Planned05

Design a Secure Upload/Download Service with Presigning, Validation, Virus Scanning/Quarantine, and Metadata CommitPlanned lesson · reserved path Chapter08/Lesson5.html

Planned

Chapter 9

Versioning, Delete Markers, Recovery, and Object History

5 lessons

Bucket Versioning States, Unique Version IDs, Latest Version Semantics, and Historical ReadsPlanned lesson · reserved path Chapter09/Lesson1.html

Planned02

Delete Markers vs Permanent Version Deletion and the Difference Between Logical and Physical RemovalPlanned lesson · reserved path Chapter09/Lesson2.html

Planned03

Recover from Accidental Overwrite/Delete by Restoring Prior Versions and Verifying Application ReferencesPlanned lesson · reserved path Chapter09/Lesson3.html

Planned04

Version Accumulation, Lifecycle Cleanup, Storage Growth, Replication Dependencies, and GovernancePlanned lesson · reserved path Chapter09/Lesson4.html

Planned05

Run an Accidental-Deletion Drill and Measure Recovery Time, Required Permissions, and Evidence RetentionPlanned lesson · reserved path Chapter09/Lesson5.html

Planned

Chapter 10

Lifecycle Management: Expiration, Noncurrent Versions, Multipart Cleanup, and Tiering

5 lessons

Lifecycle Rule Filters by Prefix/Tags, Rule Ordering/Overlap, and Evaluation SemanticsPlanned lesson · reserved path Chapter10/Lesson1.html

Planned02

Expire Current Objects, Delete Markers, Noncurrent Versions, and Incomplete Multipart Uploads SafelyPlanned lesson · reserved path Chapter10/Lesson2.html

Planned03

Transition/Tiering Concepts, Remote Tiers, Data-Access Cost, Recall Latency, and Retention RequirementsPlanned lesson · reserved path Chapter10/Lesson3.html

Planned04

Lifecycle with Versioning, Replication, Object Locking, Legal Holds, and Compliance ConflictsPlanned lesson · reserved path Chapter10/Lesson4.html

Planned05

Design and Simulate Retention/Tiering Rules from Business Policy, Storage Cost, Recovery, and Access FrequencyPlanned lesson · reserved path Chapter10/Lesson5.html

Planned

Chapter 11

Object Locking, WORM, Retention Modes, Legal Holds, and Immutability

5 lessons

WORM/Object Lock Concepts, Versioning Dependency, Governance vs Compliance Retention, and Protected VersionsPlanned lesson · reserved path Chapter11/Lesson1.html

Planned02

Default Bucket Retention vs Per-Object Retention Dates and Permission BoundariesPlanned lesson · reserved path Chapter11/Lesson2.html

Planned03

Legal Holds Independent of Retention Expiry and Operational Procedures for Applying/Releasing HoldsPlanned lesson · reserved path Chapter11/Lesson3.html

Planned04

Replication of Locked Objects, Matching Destination Capabilities, and Cross-Site Compliance ConsistencyPlanned lesson · reserved path Chapter11/Lesson4.html

Planned05

Design an Immutable Backup/Records Bucket with Separation of Duties and Test Attempts to Bypass RetentionPlanned lesson · reserved path Chapter11/Lesson5.html

Planned

Chapter 12

Erasure Coding, Data/Parity Shards, Read/Write Quorum, and Capacity Tradeoffs

5 lessons

Reed-Solomon Erasure Coding Concepts: K Data + M Parity, Reconstruction, and Storage EfficiencyPlanned lesson · reserved path Chapter12/Lesson1.html

Planned02

Erasure Sets, Drive Distribution, Parity Levels, Read Quorum, Write Quorum, and Split-Brain PreventionPlanned lesson · reserved path Chapter12/Lesson2.html

Planned03

Drive/Node Failure Tolerance vs Usable Capacity and Why RAID Is Not a Substitute for MinIO Erasure CodingPlanned lesson · reserved path Chapter12/Lesson3.html

Planned04

Object Placement, Immutable Shards, Direct-Drive Access Prohibition, and Corruption RisksPlanned lesson · reserved path Chapter12/Lesson4.html

Planned05

Use a Capacity/Failure Model to Choose Node/Drive/Parity Topology and Document Survived Failure ScenariosPlanned lesson · reserved path Chapter12/Lesson5.html

Planned

Chapter 13

Healing, Bit-Rot Protection, Drive Replacement, and Data Integrity Operations

5 lessons

Checksums/Bit-Rot Detection, Read-Time Healing, Background Healing, and Reconstruction from Healthy ShardsPlanned lesson · reserved path Chapter13/Lesson1.html

Planned02

Drive/Node Replacement Procedures, Rejoining Capacity, Healing Queues, and Performance ImpactPlanned lesson · reserved path Chapter13/Lesson2.html

Planned03

Lost Read Quorum vs Recoverable Shard Loss, Irrecoverable Objects, and Escalation PathsPlanned lesson · reserved path Chapter13/Lesson3.html

Planned04

Monitoring Heal Progress, Error Counters, Drive Health, Latency, and Capacity During RecoveryPlanned lesson · reserved path Chapter13/Lesson4.html

Planned05

Inject Drive Failure/Corruption in a Lab and Verify Read Availability, Healing, Data Integrity, and AlertingPlanned lesson · reserved path Chapter13/Lesson5.html

Planned

Chapter 14

Distributed MinIO, Server Pools, Scale-Out, Failure Domains, and Capacity Planning

5 lessons

Multi-Node/Multi-Drive Topology, Server Pools, Erasure-Set Boundaries, and Data Placement Across PoolsPlanned lesson · reserved path Chapter14/Lesson1.html

Planned02

Adding Capacity with New Server Pools vs Expanding Existing Erasure Sets and the Resulting Data DistributionPlanned lesson · reserved path Chapter14/Lesson2.html

Planned03

Failure Domains across Nodes, Racks/Zones, Network Paths, Power, and Storage ControllersPlanned lesson · reserved path Chapter14/Lesson3.html

Planned04

Headroom for Healing, Rebalance-Like Growth, Temporary Failures, Maintenance, and Peak WorkloadPlanned lesson · reserved path Chapter14/Lesson4.html

Planned05

Design a Petabyte-Scale Topology on Paper with Capacity, Parity, Network, Failure, and Expansion AssumptionsPlanned lesson · reserved path Chapter14/Lesson5.html

Planned

Chapter 15

Bucket Replication: Versioning, Filters, Deletes, Resynchronization, and Active-Active Patterns

5 lessons

Replication Requirements, Versioning Dependency, Source/Destination Roles, Credentials, and Matching CapabilitiesPlanned lesson · reserved path Chapter15/Lesson1.html

Planned02

Replicate Existing/New Objects, Delete Markers, Deletes, Metadata, Tags, and Retention-Locked VersionsPlanned lesson · reserved path Chapter15/Lesson2.html

Planned03

Prefix/Tag Filters, Priority, Multiple Destinations, Bandwidth, Backlog, and ResynchronizationPlanned lesson · reserved path Chapter15/Lesson3.html

Planned04

Active-Active/Bi-Directional Patterns, Conflict Expectations, Loop Avoidance, and Application SemanticsPlanned lesson · reserved path Chapter15/Lesson4.html

Planned05

Break a Replication Link, Accumulate Changes, Recover, Resynchronize, and Reconcile Versions/DeletesPlanned lesson · reserved path Chapter15/Lesson5.html

Planned

Chapter 16

Site Replication: Multi-Site Buckets, IAM Synchronization, Failover, and Geo-Resilience

5 lessons

Site Replication vs Bucket Replication: Broader Synchronization of Buckets, Objects, IAM, Policies, and SettingsPlanned lesson · reserved path Chapter16/Lesson1.html

Planned02

Peer Sites, Replication of Users/Groups/Policies/Access Keys, Versioning, and Configuration ExpectationsPlanned lesson · reserved path Chapter16/Lesson2.html

Planned03

Network Latency, Bandwidth, Site Failure, Write Locality, DNS/Application Failover, and Conflict BoundariesPlanned lesson · reserved path Chapter16/Lesson3.html

Planned04

RPO/RTO Design for Regional Failure and Testing Planned/Unplanned Site SwitchoverPlanned lesson · reserved path Chapter16/Lesson4.html

Planned05

Build a Site-Failure Runbook Covering Client Routing, Data Verification, Replication Catch-Up, and FailbackPlanned lesson · reserved path Chapter16/Lesson5.html

Planned

Chapter 17

Server-Side Encryption, KMS/KES Concepts, Key Rotation, and Encryption Boundaries

5 lessons

Encryption in Transit vs at Rest and Why TLS Remains Required Even When Objects Are Server-Side EncryptedPlanned lesson · reserved path Chapter17/Lesson1.html

Planned02

SSE-S3/SSE-KMS/SSE-C-Like Models, Key Ownership, Envelope Encryption, and Compatibility ExpectationsPlanned lesson · reserved path Chapter17/Lesson2.html

Planned03

External KMS/KES-Style Architecture, Master Keys, Data Keys, Authentication, Availability, and Failure ModesPlanned lesson · reserved path Chapter17/Lesson3.html

Planned04

Default Bucket Encryption, Per-Object Keys, Key Rotation/Rewrap, Backups, and Disaster Recovery of Key MaterialPlanned lesson · reserved path Chapter17/Lesson4.html

Planned05

Perform an Encryption/KMS Failure Drill and Document Which Operations Fail, Which Data Remains Recoverable, and WhyPlanned lesson · reserved path Chapter17/Lesson5.html

Planned

Chapter 18

IAM Policies, Users, Groups, Service Accounts, and Least-Privilege Authorization

5 lessons

Policy Documents, Actions, Resources, Conditions, Allow/Deny Evaluation, and Bucket/Object ARN-Like ScopesPlanned lesson · reserved path Chapter18/Lesson1.html

Planned02

Users, Groups, Policies, Access Keys, Service Accounts, Application Identities, and Root Credential MinimizationPlanned lesson · reserved path Chapter18/Lesson2.html

Planned03

Prefix/Tenant Isolation, Read-Only/Write-Only Patterns, Admin Separation, and Dangerous WildcardsPlanned lesson · reserved path Chapter18/Lesson3.html

Planned04

Policy Testing, Denied Requests, Audit Evidence, Credential Rotation, and Secret DistributionPlanned lesson · reserved path Chapter18/Lesson4.html

Planned05

Design Role-Based Access for Data Engineers, Applications, Backup Operators, Auditors, and Platform AdministratorsPlanned lesson · reserved path Chapter18/Lesson5.html

Planned

Chapter 19

STS, OIDC, LDAP/Active Directory, Temporary Credentials, and Enterprise Identity

5 lessons

Security Token Service Concepts, Temporary Credentials, Expiration, Session Policies, and Reduced Credential LifetimePlanned lesson · reserved path Chapter19/Lesson1.html

Planned02

OIDC/JWT Identity Integration: Issuer, Claims, Groups/Roles, Policy Mapping, and Token ValidationPlanned lesson · reserved path Chapter19/Lesson2.html

Planned03

LDAP/Active Directory Integration: Users, Groups, Bind/TLS, Policy Mapping, and Directory AvailabilityPlanned lesson · reserved path Chapter19/Lesson3.html

Planned04

Identity Provider Outage, Clock/Certificate Rotation, Group Changes, Session Revocation, and Break-Glass AccessPlanned lesson · reserved path Chapter19/Lesson4.html

Planned05

Build an Enterprise Auth Flow and Test Least Privilege, Expiration, Group Removal, and IdP FailurePlanned lesson · reserved path Chapter19/Lesson5.html

Planned

Chapter 20

TLS, Certificates, Network Segmentation, Proxies, and Secure Transport

5 lessons

TLS Certificates, SANs, Private/Public CAs, Trust Stores, Hostnames, and Certificate RotationPlanned lesson · reserved path Chapter20/Lesson1.html

Planned02

Secure API/Console/Admin Endpoints, Disable Plaintext Exposure, and Protect Root/Admin InterfacesPlanned lesson · reserved path Chapter20/Lesson2.html

Planned03

Firewalls, Load Balancers, Reverse Proxies, Private Networks, DNS, MTU, and East-West Cluster TrafficPlanned lesson · reserved path Chapter20/Lesson3.html

Planned04

mTLS/Client-Certificate Concepts Where Applicable and Separation of Storage, Management, and Monitoring NetworksPlanned lesson · reserved path Chapter20/Lesson4.html

Planned05

Create a Network Threat Model for Eavesdropping, Credential Theft, SSRF, Public Buckets, and Misconfigured ProxiesPlanned lesson · reserved path Chapter20/Lesson5.html

Planned

Chapter 21

Event Notifications, Webhooks, Queues, and Event-Driven Object Pipelines

5 lessons

Object-Created/Removed/Access-Like Event Categories, Prefix/Suffix Filters, and Delivery TargetsPlanned lesson · reserved path Chapter21/Lesson1.html

Planned02

Webhook/Queue/Streaming Destinations, Connection Configuration, Authentication, and BackpressurePlanned lesson · reserved path Chapter21/Lesson2.html

Planned03

At-Least-Once Delivery Expectations, Duplicate Events, Ordering, Retries, Dead Consumers, and IdempotencyPlanned lesson · reserved path Chapter21/Lesson3.html

Planned04

Build Virus Scan, Metadata Index, ETL, or Catalog Workflows Without Assuming Event Delivery Is a TransactionPlanned lesson · reserved path Chapter21/Lesson4.html

Planned05

Test Duplicate, Delayed, Missing-Consumer, and Replay Scenarios and Reconcile from Authoritative Object ListingsPlanned lesson · reserved path Chapter21/Lesson5.html

Planned

Chapter 22

Batch Operations, Mirroring, Large-Scale Copy/Delete, and Administrative Automation

5 lessons

mc mirror/cp/rm/find and Batch-Job Concepts for Large Object Sets and Repeatable AdministrationPlanned lesson · reserved path Chapter22/Lesson1.html

Planned02

Parallelism, Resume/Retry, Delete Propagation, Overwrite Rules, Checksums, and Dry-Run/Safety ControlsPlanned lesson · reserved path Chapter22/Lesson2.html

Planned03

Bulk Replication/Key-Rotation/Expiration-Like Jobs, Progress Tracking, Failure Reports, and RestartabilityPlanned lesson · reserved path Chapter22/Lesson3.html

Planned04

Avoiding Catastrophic Wildcard/Delete Errors with Scope Guards, Versioning, Object Lock, and Change ReviewPlanned lesson · reserved path Chapter22/Lesson4.html

Planned05

Automate a Million-Object Migration with Checkpointing, Rate Limits, Reconciliation, and RollbackPlanned lesson · reserved path Chapter22/Lesson5.html

Planned

Chapter 23

Observability: Metrics, Logs, Audit Events, Health Endpoints, Tracing, and Alerting

5 lessons

Liveness/Readiness/Cluster Health Endpoints and Distinguishing Node Reachability from Write AvailabilityPlanned lesson · reserved path Chapter23/Lesson1.html

Planned02

Prometheus Metrics for Requests, Errors, Latency, Capacity, Drives, Healing, Replication, and Resource UsagePlanned lesson · reserved path Chapter23/Lesson2.html

Planned03

Server Logs, mc admin trace, Audit Logs, Request IDs, User/Policy Evidence, and Sensitive-Data HandlingPlanned lesson · reserved path Chapter23/Lesson3.html

Planned04

SLIs/SLOs for GET/PUT p95, Error Rate, Replication Lag, Healing, Capacity, Availability, and KMS/IdP DependenciesPlanned lesson · reserved path Chapter23/Lesson4.html

Planned05

Build Dashboards and Symptom-to-Signal Runbooks for Slow Storage, 5xx Errors, Capacity Pressure, and Auth FailuresPlanned lesson · reserved path Chapter23/Lesson5.html

Planned

Chapter 24

Performance Engineering: Hardware, Network, Drives, Parallelism, Object Size, and Benchmarking

5 lessons

CPU, RAM, NICs, Storage Media/Controllers, NUMA, Filesystems, and Avoiding Shared/Unpredictable BottlenecksPlanned lesson · reserved path Chapter24/Lesson1.html

Planned02

Small vs Large Objects, Multipart Part Size, Client Concurrency, Connection Pools, and Request OverheadPlanned lesson · reserved path Chapter24/Lesson2.html

Planned03

Read/Write Throughput vs p95/p99 Latency, Mixed Workloads, Erasure Coding CPU, and Healing/Replication ContentionPlanned lesson · reserved path Chapter24/Lesson3.html

Planned04

Benchmark Tools/Methodology, Warm/Cold Cache, Dataset Shape, Client Location, Network Paths, and Failure TestingPlanned lesson · reserved path Chapter24/Lesson4.html

Planned05

Create a Capacity Model from Peak Throughput, Object Count, Average Size, Growth, Parity, Replication, and Maintenance HeadroomPlanned lesson · reserved path Chapter24/Lesson5.html

Planned

Chapter 25

Application SDK Patterns: Upload/Download, Streaming, Retries, Checksums, and Connection Management

5 lessons

S3 SDK Clients, Endpoint/Region/Credential Configuration, Path Style, TLS Trust, and TimeoutsPlanned lesson · reserved path Chapter25/Lesson1.html

Planned02

Streaming Upload/Download, Multipart Helpers, Range Reads, Backpressure, Cancellation, and Memory BoundariesPlanned lesson · reserved path Chapter25/Lesson2.html

Planned03

Retryable vs Non-Retryable Errors, Exponential Backoff/Jitter, Idempotency, and Duplicate Side EffectsPlanned lesson · reserved path Chapter25/Lesson3.html

Planned04

Connection Pools, DNS, Proxying, Presigned URLs, Checksums, and Request-Level ObservabilityPlanned lesson · reserved path Chapter25/Lesson4.html

Planned05

Build a Robust Object Repository Layer with Typed Metadata, Validation, Retries, Metrics, and Integration TestsPlanned lesson · reserved path Chapter25/Lesson5.html

Planned

Chapter 26

Data Lake, Analytics, AI/ML, and S3-Compatible Integration Patterns

5 lessons

Parquet/ORC/CSV/JSON on Object Storage: Partition Layout, Range Reads, Footers, and Small-File PathologyPlanned lesson · reserved path Chapter26/Lesson1.html

Planned02

Integrate Spark, Trino, DuckDB, ClickHouse, Hadoop S3A, and Other Engines with S3-Compatible EndpointsPlanned lesson · reserved path Chapter26/Lesson2.html

Planned03

Credentials/STS, Path Style, TLS, Multipart, Consistency, and Engine-Specific S3 SettingsPlanned lesson · reserved path Chapter26/Lesson3.html

Planned04

AI/ML Datasets, Model Artifacts, Checkpoints, Feature Data, and High-Throughput Training/Inference AccessPlanned lesson · reserved path Chapter26/Lesson4.html

Planned05

Design a Shared Data-Lake Layout that Separates Raw/Curated/Serving Data, Ownership, Retention, and Access PoliciesPlanned lesson · reserved path Chapter26/Lesson5.html

Planned

Chapter 27

Governance, Compliance, Data Retention, Auditability, and Cost Control

5 lessons

Data Classification, Bucket/Tenant Boundaries, Sensitive Metadata/Tags, and Policy-as-CodePlanned lesson · reserved path Chapter27/Lesson1.html

Planned02

Retention vs Deletion Obligations, Object Lock, Legal Hold, Versioning, Lifecycle, and Right-to-Erasure TensionsPlanned lesson · reserved path Chapter27/Lesson2.html

Planned03

Audit Logs, Access Reviews, Credential Rotation, Encryption/KMS Evidence, and Incident InvestigationPlanned lesson · reserved path Chapter27/Lesson3.html

Planned04

Chargeback/Showback by Bucket/Prefix/Tags, Storage Growth, Request Costs, Replication, and EgressPlanned lesson · reserved path Chapter27/Lesson4.html

Planned05

Create a Governance Matrix Connecting Data Class to Encryption, Retention, Replication, Access, Audit, and Deletion ControlsPlanned lesson · reserved path Chapter27/Lesson5.html

Planned

Chapter 28

Upgrades, Configuration Management, Release Compatibility, and Operational Change Control

5 lessons

Version/Release Awareness, Upgrade Paths, Client/Server Compatibility, and Replication Requirement for Matching VersionsPlanned lesson · reserved path Chapter28/Lesson1.html

Planned02

Configuration-as-Code, Environment Variables/Config Stores, Secrets, Certificates, and Drift DetectionPlanned lesson · reserved path Chapter28/Lesson2.html

Planned03

Rolling/Coordinated Maintenance, Node Availability, Quorum Headroom, Healing, and Background Work During ChangePlanned lesson · reserved path Chapter28/Lesson3.html

Planned04

Canary/Staging Validation, SDK Compatibility, KMS/IdP/Monitoring Integration Tests, and Rollback PlanningPlanned lesson · reserved path Chapter28/Lesson4.html

Planned05

Build an Upgrade Checklist with Prechecks, Backup/DR Validation, Health Gates, Functional Tests, and Post-Change MonitoringPlanned lesson · reserved path Chapter28/Lesson5.html

Planned

Chapter 29

Disaster Recovery, Backup Strategy, Metadata Protection, and Failure Exercises

5 lessons

Object Storage as a Backup Target vs Backing Up the Object Store Itself: Different Failure ModelsPlanned lesson · reserved path Chapter29/Lesson1.html

Planned02

Replication vs Backup vs Versioning/Object Lock: Protection Against Hardware Loss, Site Loss, Corruption, and Operator ErrorPlanned lesson · reserved path Chapter29/Lesson2.html

Planned03

Protect External Dependencies: IAM/IdP Configuration, KMS Keys, Certificates, DNS, Infrastructure Code, and MonitoringPlanned lesson · reserved path Chapter29/Lesson3.html

Planned04

RPO/RTO for Drive/Node/Site Loss, Logical Deletion, Credential Compromise, KMS Loss, and Regional DisasterPlanned lesson · reserved path Chapter29/Lesson4.html

Planned05

Run a Tabletop and Technical Recovery Drill and Verify Data, Versions, Policies, Encryption Keys, Applications, and AuditabilityPlanned lesson · reserved path Chapter29/Lesson5.html

Planned

Chapter 30

Production Capstone: Build, Secure, Scale, Replicate, and Operate a MinIO S3 Platform

5 lessons

Define Object Count/Size, Throughput, Availability, Durability, RPO/RTO, Identity, Retention, Compliance, and Growth RequirementsPlanned lesson · reserved path Chapter30/Lesson1.html

Planned02

Design Server Pools/Erasure Sets, Network/TLS, IAM/STS, Encryption/KMS, Versioning/Lifecycle/Object Lock, and Client AccessPlanned lesson · reserved path Chapter30/Lesson2.html

Planned03

Configure Replication/Site Resilience, Observability, Alerts, Event Pipelines, Data-Lake Integrations, and Capacity PoliciesPlanned lesson · reserved path Chapter30/Lesson3.html

Planned04

Load-Test, Fail Drives/Nodes/Sites, Heal, Restore Access, Rotate Keys, Upgrade, and Execute Incident RunbooksPlanned lesson · reserved path Chapter30/Lesson4.html

Planned05

Present the Architecture with Capacity/Parity Math, Failure Matrix, Security Model, Cost Assumptions, Measured Performance, and Known LimitsPlanned lesson · reserved path Chapter30/Lesson5.html

Planned