Good question.

The separation of compute and storage doesn’t directly address how a database will respond to an increase in storage. What we’re seeing with modern architectures however, is that with the separation of compute and storage, storage is often shared amongst all compute nodes (meaning that each compute node can directly access all of the data in the database).

With this setup, and if the database has been architected properly, the shard rebalancing amongst compute nodes can be done logically, instead of physically (i.e. instead of physically rebalancing the data by moving bytes around on disk, or worse, over the network, the mapping of shard ownership to compute node can be modified without touching the physical bytes on disk).

The end result is that a shard rebalancing can be completed in seconds (or even sub-second) whereas physical rebalancing can take hours or days. Obviously a huge improvement.

--

--

--

Adam has been developing and designing complex software systems for the last two decades. He is also a son, brother, husband and father.

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Adam Storm

Adam Storm

Adam has been developing and designing complex software systems for the last two decades. He is also a son, brother, husband and father.

More from Medium

Ginny Good: Chapter 8, Coyote Point (Spring, 1963)

When Faith Is Critical

The graphic contains four, empty speech bubbles in the background. In the foreground is text framed by a white square that reads, “#31DaysIBPOC.”  Underneath this are two lines that state, “Celebrating the teacher voices of Indigenous, Black, & People of Color this May!” The bottom of the graphic lists the following information, “Hosted by @TchKimPossible @triciaebarvia.”

Culture through my lenses

Is it more important to be respected or liked?