What is a SQL database? (People also often ask, “What is a SQL database” or “What is an SQL database?” depending on how they pronounce “SQL” – some say “sequel” while others spell it out as an initialism, “es cue el.” ) Originally, SQL databases were designed to be system-of-record workhorses, built for data consistency, vertical scalability, and tight integration. They did this very well for the long era of monolithic applications running on dedicated, single-server environments.
When the paradigm shifted to distributed applications in the cloud, however, businesses began to find that the relational databases behind some of their most critical applications were holding them back. Why?
"The architecture of these original relational databases frequently conflicts with the architectural needs of modern cloud applications: distributed computing, elasticity, and microservices," says Jordan Lewis, Head of Cloud at Cockroach Labs. "Now, applications need to scale horizontally across multiple servers or containers, adapt to ephemeral or unreliable infrastructure, and support rapid deployment cycles. The original, single-node relational databases, with their fixed schemas, licensing constraints, and lack of support for distributed data models, simply were not suited to the cloud.
"For a time, this was a real conundrum," Lewis continues. "Organizations need the power and reliability of a tested relational data store, such as Oracle, SQL Server databases, Postgres, and MySQL, but with the benefits of inherent scale and global coverage that comes with the cloud."
Some have turned to NoSQL stores to try to meet these requirements. These alternatives can typically meet the scale requirements but then fall short as a transactional database because they were not designed from the ground up to provide true consistency. Some NoSQL solutions have begun to offer “ACID transactions” but they’re full of caveats and fail at delivering isolation levels necessary for mission-critical workloads like a financial ledger, inventory control, and identity management. For many critical workloads, though, “eventual consistency” does not suffice.
The birth of distributed SQL, a new category of database
Some of the world’s most successful companies were the first to tackle the problem, creating purpose-built databases able to function at global scale. One of the earliest examples of this came in 2012 when Google published a paper that demonstrated a new way of looking at the relational database, one that was rooted in distributed systems and global scale.
“Spanner is Google’s scalable, multi-version, globally distributed, and synchronously-replicated database. It is the first system to distribute data at global scale and support externally-consistent distributed transactions.” – Spanner: Google’s Globally-Distributed Database
The paper is 14 pages of pure genius and outlines the foundation of the next evolution of the database: Distributed SQL.
What is a distributed SQL database?
"Distributed SQL combines the consistency and structure of the early relational databases with the scalability, survivability, and performance first pioneered in NoSQL," Lewis explains. "Distributed SQL databases like CockroachDB use this architecture to provide a single logical database that replicates data across multiple physical nodes at any scale, on any infrastructure, and anywhere in the world."
A distributed SQL database provides several core capabilities:
Scale
A distributed SQL database must seamlessly scale in order to mirror the capabilities of cloud environments without introducing operational complexity. Just as we can scale up compute without heavy lifting, the database should be able to scale as well. This includes an ability to evenly distribute data across multiple distributed participants in the database.
Consistency
A distributed SQL database must deliver a high level of isolation in a distributed environment. In a cloud-based world where distributed systems and microservices are the default architectures, transactional consistency becomes difficult when multiple operators may be trying to work on the same data. A true distributed SQL database should mediate contention and deliver the same level of isolation for transactions expected in a single instance database.
Resilience
A distributed SQL database must naturally deliver the highest level of resilience without any need of external tooling to accomplish this. The cloud presents an always-on environment for our workloads; a database should have the same properties. With a distributed database we can reduce the time it takes to recover from a failure down to near zero and replicate data naturally without any external configuration.
Geo-replication
A distributed SQL database should allow for distribution of data throughout a complex, widely dispersed geographic environment. The cloud presents an ability to reach every corner of the globe with an acceptable quality of service and the database should not restrict your applications from doing so. It should perform to meet your expectations
SQL
While these four technical requirements are paramount, there is one key prerequisite above all. "The database must speak SQL," states Lewis. "It is the language of data and the default for all application logic. We should not have to retrain developers to use the database. They should be able to use the SQL dialect they are already familiar with."
There are a few databases that meet these requirements. The list includes Spanner, of course, but you could also consider Amazon Aurora, Yugabyte, FaunaDB and CockroachDB as members of this new category. All of these members meet the requirements in some form, some better than others. Noticeably missing from this list are Oracle, Postgres, MySQL and all of the NoSQL options. While each may meet some of the requirements, none of them meet all of the requirements.
Distributed SQL databases must offer data locality
Once you live in a distributed world, it becomes apparent that the database itself could actually take care of domiciling data. With participants located in various regions or data centers, it becomes possible to understand the location of each and then tie the data that it stores to a location.
"Some application architects have implemented this as part of an application but this approach is error-prone and brittle," cautions Lewis. "Using the database to geo-partition data based on some field in a table is a new requirement for distributed SQL. This allows you to use the database to address data sovereignty concerns. It can also be used to have data follow a user so you can ensure low latency access to their information or to tie data to an explicit cloud so you can minimize egress charges."
Truly distributed SQL databases must be multi-cloud
A unique trait of a distributed SQL database is that it has semi-autonomous units that all participate in a larger system. Each unit should be able to be deployed by itself and then join the larger system, the CockroachDB cluster. This is an inherent trait that fuels the first five requirements listed above. However, this can also be used to extend the database to be truly multi-cloud.
"The database should not rely on a single network to accomplish distribution," Lewis says. "It should be divorced from these limits so that a participant can be located anywhere, from any public cloud, a private cloud and even a single on-premise instance. This requirement is important for the future of compute where we live in a distributed hybrid and multi-cloud world."
Foundational requirements for distributed SQL
While the aforementioned seven requirements are unique to distributed SQL (well, all of them except the SQL thing), it is important to note that it is still a database and, of course, is required to deliver on the baseline requirements to be a database. There are a set of expectations around the following:
Administration: You should be able to easily install and configure the database with a set of command line and graphical based tools. This includes the abilities to control the environment and control data lifecycle for backup/restore. As well as the ability to create tables, define and implement schema, set indexes/partitions and recreate the DDL.
Optimization: The database should allow a DBA to gain insight into the performance of queries and the ability to optimize their execution. This includes such advanced features as a cost-based optimizer, which in a distributed world becomes a tricky and new concept.
Security: As with any enterprise software package, security is critical and the database should provide the key AAA capabilities of authentication, authorization, and accountability. It should not stand on its own and should integrate with a central source of truth for identity management and governance so that consistent policy can be set for the data (at the table, row and column levels) it contains.
Integration: A database does not function alone and should integrate with your existing applications using well tested or known drivers. It should integrate well with existing ORMs and also provide the ability for bulk ingest or export. It should also provide key capabilities that allow it to work with ETL tools and change data capture capabilities to integrate with more advanced services such as streaming analytics or cloud storage.
"These 'foundational' requirements are critical and signal a more mature, enterprise-ready database," Lewis remarks. "They may not be the most exciting features but are critical for adoption and success within any project."
How to evaluate distributed SQL databases
CockroachDB is a wonderful option for your cloud-native distributed SQL database. It has helped hundreds of organizations transition both the very most mundane workloads and some of the most business-critical to the cloud. It has been the foundation of a cloud-native strategy within more advanced orchestrated environments. We are quite proud of what we have built.
We are also advocates of this emerging category and believe that distributed SQL is a proper evolution of the database and the future of the way we manage data in the cloud. To this end, we feel strongly that our solution and every other should be held to the highest regard when it comes to these core requirements:
Scale
Consistency
Resilience
Geo-replication
SQL
Locality
Multi-cloud
Administration
Optimization
Security
Integration
"A database that meets all of these requirements has sufficiently matured to be trusted for the mission-critical (and even not-so-mission-critical) applications," Lewis says. "And some of these requirements are not simple. These are advanced topics that take time to get right."
When you discuss these items with your vendor, we encourage you to go deep on concepts like consistency and locality. While everyone has read the same papers, ultimately it comes down to implementation and (more importantly) production use. Because it is only in production where the complex corner cases and issues can be identified and fixed. So, we guess then, the final (and 12th) requirement is maturity.
Additional resources
If you enjoyed this article, check out this interactive session on demystifying distributed SQL between two experts from Cockroach Labs: Tejas Baldev, Director of Sales - APAC, and Paresh Saraf, Principal Sales Engineer - APAC. They cover the basics of distributed SQL and the unique benefits that Cockroach Labs can provide for your business.
