Blog
Product
How to cut your data streaming and export costs by 40%
Moving and processing data between systems is a common pain point. Users need up-to-date data across systems for use in business analytics, for event-driven architectures, for creating audit trails, or for archiving data. One way to do that is to set up an external service that regularly polls the database for changes.
Abbey Russell
December 19, 2022
applications
Santa Paws: Gift exchange sample app for dogs
‘Tis the season for gift giving. And, if you’re like me, you enjoy getting gifts for dogs. Atticus (my tri-color corgi) gets his fair share of balls and stuffed toys (that he promptly destroys), but those are all from me. We’ve never participated in a pet-specific holiday gift exchange before, until this year. While Atticus doesn’t have his own Instagram account, mine is pretty much exclusively Atticus content and we follow many of his corgi friends. In a recent story, his friend Lulu invited fellow dog owners to join a gift exchange. All that’s required is for me to send a gift valued at least $10 to the assigned dog and in return, Atticus could receive anywhere between 6-36 gifts!
Aydrian Howard
December 16, 2022
Product
Rubbing control theory on the Go scheduler
For multi-tenant mixed-workload systems like CockroachDB, performance predictability and isolation are critical. Most forms of shared infrastructure approximate these properties, be it through physical isolation within data centers, virtualized resource limits, drastic over-provisioning, and more. For CockroachDB it’s not just about protecting latencies across workload/tenant boundaries, it’s also about isolation from the system’s internal/elastic work like LSM compactions, MVCC garbage collection, and backups, and also from user-initiated bulk work like changefeed backfills. For ill-considered reasons this is something they let me work on. Here we’ll describe generally applicable techniques we applied under the umbrella of admission control, how we arrived at them, and why they were effective. We’ll use control theory, study CPU scheduler latencies, build forms of cooperative scheduling, and patch the Go runtime. We hope for it to be relevant to most systems builders (and aspiring ones!), even if the problems motivating the work were found in this oddly-named database.
Irfan Sharif
December 15, 2022
Product
SSO to CockroachDB clusters using JWT
Secure authentication is a fundamental requirement when evaluating a database product. Architecture and Security teams prefer capabilities which could somehow be managed centrally, ideally using existing security tools in the enterprise tech stack. Over decades of advancements in the OLTP database ecosystem, we’ve seen a number of solutions emerge for secure authentication. Whether it be PKI/certificates, LDAP integration with enterprise identity directory, GSSAPI/Kerberos, SCRAM and so on, those mechanisms have enabled organizations to adopt a variety of new databases over time. We also support most of those capabilities in CockroachDB that are utilized by the majority of our security-conscious customers.
Abhinav Garg
December 14, 2022
applications
Use cases for trigram indexes (when not to use Full Text Search)
We’ve been planning a visit to Orange County, California, where I grew up, over the upcoming holidays. My favorite Mexican restaurant is there, in Placentia: Q-Tortas! I have frequent cravings for their carnitas burrito, so a visit there is obligatory (I promise this blog is about search).
Michael Goddard
December 12, 2022
Culture
Happy birthday, amazing Grace Hopper
Lt. Grace Hopper at the programming console for the Mark I computer, 1944. Programming the Mark I required feeding in long rolls of paper punched with holes that the computer translated into instructions. Back in the days before startups and GitHub and nerds being cool — long before the Internet, and only shortly after there were “computing machines” at all — Grace Hopper was the first person to see that these room-sized citadels of circuitry could do more than mathematical calculations. Grace Hopper theorized and then wrote the first compiler, essentially “teaching” computers to speak English and thereby ushering in the world of computing that we know today.
Michelle Gienow
December 8, 2022
Product
Distributed UDFs: How we're building database functions from the ground up
Efficiency matters. When you’re working with large amounts of data, it matters a lot. Every trip between your application and the database incurs real costs, both in terms of time and money. So how can you minimize those trips?
Charlie Custer
December 5, 2022
applications
Global payments orchestration platform architecture
Modern hyper-growth merchants do not want to manage complex payment system architecture. They want to expand network tokenization offerings and make their systems more automated and API driven. Merchants like SeatGeek, for example, want to build a ticket sales system that makes payment processing simple and performant for their end users. The challenge for merchants like SeatGeek is that they need to adopt modern tools and push for automation while also continuing to meet all the standard data protection requirements of the financial services industry. At the most fundamental level, when merchants migrate from single datacenter architecture to a cloud-native, distributed architecture the data has to stay safe (at rest and in flight) and consistent. It requires a specific set of tools to meet fintech security standards while also modernizing the tech stack and distributing the data. That’s exactly the journey that Spreedly embarked on when they decided to migrate their payments orchestration service from a legacy database to CockroachDB.
Dan Kelly
November 20, 2022
Product
How to migrate from Heroku Postgres to CockroachDB serverless
In case you hadn’t already heard, Heroku is shutting down its free plans. The change has left many developers scrambling to replace what Heroku offered with other free services. And while CockroachDB doesn’t replace everything Heroku’s free tier offered, developers looking to replace the free cloud Postgres database that Heroku offered can already access an excellent replacement in CockroachDB serverless, a forever-free cloud database that actually offers some major advantages over Heroku Postgres.
Charlie Custer
November 17, 2022