System Design Interview Questions

Topic Guide

System Design Interview Questions

Real system design questions asked at top tech companies, covering distributed systems, scalability, caching, databases, microservices, and more.

System design is the most consistently tested competency in senior backend, cloud, and SRE interviews. Unlike algorithm questions, design questions are open-ended: there’s no single correct answer, and interviewers are evaluating your reasoning process as much as the solution.

What’s Tested

What system design interviews actually test

Breadth of knowledge

Load balancers, caches, message queues, databases, CDNs, API gateways, service meshes.

Judgment under constraints

Trade-offs like strong consistency vs. availability, cost vs. performance — knowing why, not just that both exist.

Scalability thinking

Identifying bottlenecks, designing for 10x load, when to shard, cache, or go async.

Communication

Explaining reasoning clearly in real time, not just stating a conclusion.

Core Topics

Core system design topics to master

  • Caching — when to cache, invalidation strategies, eviction policies, distributed caches.
  • Databases — RDBMS vs. NoSQL, ACID, indexing, read replicas, sharding, OLTP vs. OLAP.
  • Message queues — Kafka vs. RabbitMQ vs. SQS, delivery guarantees, backpressure.
  • Microservices — service decomposition, REST vs. gRPC, API gateways, circuit breakers.
  • API design — REST vs. GraphQL, versioning, rate limiting, auth, pagination.
  • Load balancing and scaling — horizontal vs. vertical, stateless design, autoscaling.
  • Networking and CDN — DNS, TCP/IP fundamentals, edge caching.
Framework

How to structure a system design answer

  1. Clarify requirements (2–3 min)
  2. Estimate scale (1–2 min)
  3. High-level design (5–10 min)
  4. Dive deep on bottlenecks (10–15 min)
  5. Handle trade-offs explicitly
By Company

Companies that test system design heavily

CompanyRolesTypical depth
GoogleSRE, Cloud Eng, BackendVery deep, distributed systems at scale
NetflixSRE, Backend, DevOpsDeep, reliability and fault tolerance
MicrosoftBackend, Cloud EngMid-deep, Azure integration often comes up
TCS, Infosys, HCLBackend, Full StackMid, architecture reasoning and trade-offs
OracleBackend, DBADeep on database design specifically