Let's take a look at the top 15 new databases that could disrupt software development in the future. Many new serverless databases leverage tools like Postgres and MySQL, while others attempt build entirely new systems from scratch. 

This video is NOT sponsored. No company paid to be on this list. 

#database #programming #tech 

💬 Chat with Me on Discord

https://discord.gg/fireship

🔗 Resources

- 7 Database Paradigms https://youtu.be/W2Z7fbCLSTw
- SQL in 100 Seconds https://youtu.be/zsjvFFKOm3c

🔥 Get More Content - Upgrade to PRO

Upgrade at https://fireship.io/pro
Use code YT25 for 25% off PRO access 

🎨 My Editor Settings

- Atom One Dark 
- vscode-icons
- Fira Code Font

🔖 Topics Covered

- Modern database paradigms
- Most popluar new databases
- Alternatives to SQL RDBMS
- Artificial Intelligence embedded in databases
- Planetscale
- Yugabye
- NeonDB
- Dolt
- CockroachDB
- Cloudflare D1
- Xata
- 8base
- EdgeDB
- SurrealDB
- FaunaDB
- memgraph
- KeyDB
- Meilisearch
- MindsDB
2024-02-04T05:12:44.422Z
nova-2
2-general-nova
2024-01-09.29447
30089e05-99d1-4376-b32e-c263170674af
f7af05b1-388c-4707-8553-ed581a94f151
173f5642ecb631ab9cd9ba478fad051805d07fc028656a856b7bba4e75be51a7
67875a7f-c9c4-48a0-aa55-5bdb8a91c34a
deprecated
If you wanna be successful in tech, you need to move fast and break things.
That's exactly what I said to my boss before he fired me for deleting a production database.
I should fire you and burn down your friggin' house.
The relational database management system is one of the most successful ideas in the history of computing.
SQL is 19 seventies tech that still forms the backbone of the modern big data world.
Oracle dominates enterprise, while MySQL is the primary database for platforms like YouTube and Facebook.
But SQL is by no means perfect.
In 20 23, there's a whole new wave of futuristic, cutting edge, avant garde game changing databases looking to move fast and break things.
Some of them on top of existing relational patterns, while others bring entirely new ideas to the table that you've never seen before.
No pun intended.
Over the next few minutes, We'll look at 15 crazy ass new databases and talk about the problems they're trying to solve.
1st on the list, we have PlanetScale, which is not a new database, but rather a serverless platform for MySQL.
Phone.
Like I mentioned before, YouTube uses MySQL.
However, back in 2010 when it was getting popular, it was extremely difficult to scale, at least for an app with millions of simultaneous connections.
Instead of switching to a NoSQL document database, they developed a library called vTest, which makes some trade offs to scale MySQL horizontally, fleet.
And this is the technology that PlanetScale is based on.
It provides a fully managed database that can scale with V test, and makes it available from a nice dashboard with SDKs to go along with it.
And it also integrates nicely with tools like Prisma.
It has a free tier and a good pricing on the paid tier that they're likely losing money on.
By comparison, a basic database on Heroku is $50 and Unreasonably expensive on AWS and Google Cloud.
PlanetScale is not the only company with this serverless database idea, though.
YogaByte has its own open source solution for post Its goal is to scale infinitely in the cloud, but attempt to support all the native features in Postgres, which is not easy to do in a cloud native environment.
You can actually use a multi cloud strategy g to host your database on multiple clouds at the same time, eliminating the dreaded vendor lock in issue.
But there's another option for scaling Postgres called Neon.
It's currently in technical preview, but Looks extremely promising.
It's serverless and can scale down to 0 and has a highly polished admin dashboard to go along with it.
And most importantly, it's written in Rust, which is the only thing that matters if you wanna cool in front of your friends.
It also supports branching, which I think was inspired by another database called Dult.
This database would be like if MySQL and Git had a Maybe.
Most importantly, it allows you to create branches from the main database where you can experiment with new data without breaking things.
It makes it easy to analyze the diff between changes, and when Everything looks good.
The changes can be merged back into the main branch.
And it's done with the same conventions found in Git that virtually every developer is familiar Dolts has a hosted option, but it is quite expensive.
They've raised $21,000,000 and because I'm extremely entitled, I demand they burn more of this money to give us Free tier.
I just paid $8 for a dozen eggs and can't afford to put another $50 on my mom's credit card.
Now, another sequel flavor I wanna talk about is CockroachDB.
Feet.
It's been around for quite a while and was developed by ex Google employees and is often referred to as New SQL.
It's compatible with Postgres, but was built from the ground up with Go to To scale horizontally in the cloud.
It has a nice free tier pretty similar to PlanetScale, then becomes pay as you go pricing after that.
It's yet another great option, but you might also want to consider FoundationDB or TitaniumDB as well, which are also in this new SQL class.
But in some cases, you might prefer A lightweight alternative like Cloudflare d one.
This is a brand new product that's still in beta, and basically, it's a SQLite database that runs on the edge.
Cloudflare Flare already has its own key value store for workers as well as r 2 for object storage, but d one allows you to create data on the edge that Can be queried.
One trade off though is that native transactions will not work.
However, they're taking a very cool approach to overcome that limitation by Allowing developers to write stored procedures with JavaScript, which are just snippets of code that run directly in your database, which can be used to create transactions or other reusable queries.
This approach has a ton of potential, because historically, stored procedures are a pain to work with.
But if it's in JavaScript, even I could do it.
Pretty cool, but it's not production But yet, if you want something that's ready to go today, check out Zeta, yet another serverless relational database that's based on Postgres and Elasticsearch under the hood.
What makes it special is that it treats your data like a spreadsheet.
It feels kind of like a developer friendly alternative to Airtable or Notion.
And what's really awesome is that it has full text search Built in without needing to duplicate your data in some other service like Algolia.
It has SDKs for TypeScript and Python and has a schema editor that makes It's very easy to create and visualize relationships between tables, and it can also do branching like we looked at in DoltDB.
For pricing, it has a solid free tier, then it scales up in a linear way based on usage.
But another tool that takes things one step further is 8base.
It's also a relational database that provides a GraphQL API for your data out of box, making it similar to tools like Hasura.
What makes it unique though is that it also comes with a low code tool for quickly building front end applications That connect to your back end.
It's like a back end as a service that can also build your front end, but that's enough talk about relational databases.
Now we enter the post SQL Era with EdgeDB.
It's a graph relational database that's powered by Postgres under the hood.
When it comes to relationships, humans don't naturally think of columns and rows, but rather objects connected to each other, like a graph.
Instead of defining tables like you would in SQL, you define types like you would in most programming languages.
These types link to other types, which is awesome because it eliminates the need for joins and simplifies the way you make queries.
Overall, it almost feels like an ORM for Postgres That allows you to think about relationships in a far more human friendly way.
Currently, it's open source and can be self hosted, but there's a wait list for their cloud service.
Now another relational graph like database is surreal DB.
It's written in Rust, and I have a full tutorial on my second channel, Beyond Fireship.
It's designed to support asset transactions while scaling horizontally, but what I really like about it is how easy and flexible it makes data modeling.
For the most part, it feels like SQL, but also uses arrows to connect nodes edges, like you would in Cypher with a graph database like Neo4j.
It takes the best elements of relational, document, and graph databases, and combines them into one Easy to use API.
Currently, it can only be self hosted, but they do have a cloud service coming soon.
The multi model idea is nothing new though.
Another database pushing the limits is Fauna.
It was Created by ex Twitter engineers who set out to build the perfect database.
It's extremely easy to use like a document database similar to MongoDB, but unlike a document database, it supports features like native Jib joins, which is the number one missing feature in document databases.
And that means Spana is more well suited for complex relational data like social graphs.
To interact with it, it has its own custom query language called FQL, but also comes with a GraphQL API.
It is a closed source product, So you can't self host it, but its fully managed service has a nice free tier.
Another new database you've likely never heard of is Memgraph.
It's a drop in replacement for Neo4j, 4 j, which is the gold standard for graph databases, but Memgraph is focused on building real time data pipelines.
Like Neo 4 j, it can be queried with Cypher, but it's written in c plus plus with a memory first architecture that claims to achieve better performance.
Overall, it looks like it would be a great choice for building something Like a real time analytics platform.
Next up, we'll look at KeyDB, which is a faster alternative to the already extremely fast Redis.
It was recently acquired iSnap, a company that needs to fetch data as fast as humanly possible.
It can handle over 1,000,000 operations per second on a single node, which sounds like a lot to me, but it's Not something you would use as your primary database, rather it's mostly used as an in memory cache to duplicate high priority data from another database, making it load Faster for the end user.
It also has a library called modjs, allowing you to extend the database with your own custom commands and functionality With JavaScript, another specialty database to look into is Melee Search.
The full text search engine space is dominated by tools like Elasticsearch and Algolia.
Melee search is an open source rust based alternative that makes it easy to implement an awesome search feature into your app.
It's not a primary database, but instead a place where you would duplicate data that needs to be in complex ways, like you can fine tune different parameters to control which attributes have a higher ranking in the search.
In addition, it has a bunch of client like instant melee search that can quickly implement a search feature in a front end web application.
And finally, that brings us to MindsDB, A database that integrates popular machine learning frameworks.
It created a concept called AI tables that embed predictive models directly into the database.
At first glance, it feels like SQL, except you can use it to write statements that train machine learning models.
When the model's done training, you can then use Select to make predictions from it.
So basically, it provides an integrated way to handle the MLOps life cycle, and it can also integrate with your existing machine learning models or those from third parties like Hugging Face or OpenAI.
In the not so distant future, I believe embedding AI directly into databases will be a huge thing, and MindsDB gives you an idea of how that could look.
And now, You have 15 different futuristic databases to choose from for your next failed side project.
Good luck with that.
If I missed anything, let me know in the comments.
And if you wanna learn more about awesome serverless databases like Firestore and Supabase, support my work as a pro member on Fireship IO.
Thanks for watching, and I will see you in the next one.

Speaker 0: If you wanna be successful in tech, you need to move fast and break things. That's exactly what I said to my boss before he fired me for deleting a production database. I should fire you and burn down your friggin' house. The relational database management system is one of the most successful ideas in the history of computing. SQL is 19 seventies tech that still forms the backbone of the modern big data world.

Oracle dominates enterprise, while MySQL is the primary database for platforms like YouTube and Facebook. But SQL is by no means perfect. In 20 23, there's a whole new wave of futuristic, cutting edge, avant garde game changing databases looking to move fast and break things. Some of them on top of existing relational patterns, while others bring entirely new ideas to the table that you've never seen before. No pun intended.

Over the next few minutes, We'll look at 15 crazy ass new databases and talk about the problems they're trying to solve. 1st on the list, we have PlanetScale, which is not a new database, but rather a serverless platform for MySQL. Phone. Like I mentioned before, YouTube uses MySQL. However, back in 2010 when it was getting popular, it was extremely difficult to scale, at least for an app with millions of simultaneous connections.

Instead of switching to a NoSQL document database, they developed a library called vTest, which makes some trade offs to scale MySQL horizontally, fleet. And this is the technology that PlanetScale is based on. It provides a fully managed database that can scale with V test, and makes it available from a nice dashboard with SDKs to go along with it. And it also integrates nicely with tools like Prisma. It has a free tier and a good pricing on the paid tier that they're likely losing money on.

By comparison, a basic database on Heroku is $50 and Unreasonably expensive on AWS and Google Cloud. PlanetScale is not the only company with this serverless database idea, though. YogaByte has its own open source solution for post Its goal is to scale infinitely in the cloud, but attempt to support all the native features in Postgres, which is not easy to do in a cloud native environment. You can actually use a multi cloud strategy g to host your database on multiple clouds at the same time, eliminating the dreaded vendor lock in issue. But there's another option for scaling Postgres called Neon.

It's currently in technical preview, but Looks extremely promising. It's serverless and can scale down to 0 and has a highly polished admin dashboard to go along with it. And most importantly, it's written in Rust, which is the only thing that matters if you wanna cool in front of your friends. It also supports branching, which I think was inspired by another database called Dult. This database would be like if MySQL and Git had a Maybe.

Most importantly, it allows you to create branches from the main database where you can experiment with new data without breaking things. It makes it easy to analyze the diff between changes, and when Everything looks good. The changes can be merged back into the main branch. And it's done with the same conventions found in Git that virtually every developer is familiar Dolts has a hosted option, but it is quite expensive. They've raised $21,000,000 and because I'm extremely entitled, I demand they burn more of this money to give us Free tier.

I just paid $8 for a dozen eggs and can't afford to put another $50 on my mom's credit card. Now, another sequel flavor I wanna talk about is CockroachDB. Feet. It's been around for quite a while and was developed by ex Google employees and is often referred to as New SQL. It's compatible with Postgres, but was built from the ground up with Go to To scale horizontally in the cloud.

It has a nice free tier pretty similar to PlanetScale, then becomes pay as you go pricing after that. It's yet another great option, but you might also want to consider FoundationDB or TitaniumDB as well, which are also in this new SQL class. But in some cases, you might prefer A lightweight alternative like Cloudflare d one. This is a brand new product that's still in beta, and basically, it's a SQLite database that runs on the edge. Cloudflare Flare already has its own key value store for workers as well as r 2 for object storage, but d one allows you to create data on the edge that Can be queried.

One trade off though is that native transactions will not work. However, they're taking a very cool approach to overcome that limitation by Allowing developers to write stored procedures with JavaScript, which are just snippets of code that run directly in your database, which can be used to create transactions or other reusable queries. This approach has a ton of potential, because historically, stored procedures are a pain to work with. But if it's in JavaScript, even I could do it. Pretty cool, but it's not production But yet, if you want something that's ready to go today, check out Zeta, yet another serverless relational database that's based on Postgres and Elasticsearch under the hood.

What makes it special is that it treats your data like a spreadsheet. It feels kind of like a developer friendly alternative to Airtable or Notion. And what's really awesome is that it has full text search Built in without needing to duplicate your data in some other service like Algolia. It has SDKs for TypeScript and Python and has a schema editor that makes It's very easy to create and visualize relationships between tables, and it can also do branching like we looked at in DoltDB. For pricing, it has a solid free tier, then it scales up in a linear way based on usage.

But another tool that takes things one step further is 8base. It's also a relational database that provides a GraphQL API for your data out of box, making it similar to tools like Hasura. What makes it unique though is that it also comes with a low code tool for quickly building front end applications That connect to your back end. It's like a back end as a service that can also build your front end, but that's enough talk about relational databases. Now we enter the post SQL Era with EdgeDB.

It's a graph relational database that's powered by Postgres under the hood. When it comes to relationships, humans don't naturally think of columns and rows, but rather objects connected to each other, like a graph. Instead of defining tables like you would in SQL, you define types like you would in most programming languages. These types link to other types, which is awesome because it eliminates the need for joins and simplifies the way you make queries. Overall, it almost feels like an ORM for Postgres That allows you to think about relationships in a far more human friendly way.

Currently, it's open source and can be self hosted, but there's a wait list for their cloud service. Now another relational graph like database is surreal DB. It's written in Rust, and I have a full tutorial on my second channel, Beyond Fireship. It's designed to support asset transactions while scaling horizontally, but what I really like about it is how easy and flexible it makes data modeling. For the most part, it feels like SQL, but also uses arrows to connect nodes edges, like you would in Cypher with a graph database like Neo4j.

It takes the best elements of relational, document, and graph databases, and combines them into one Easy to use API. Currently, it can only be self hosted, but they do have a cloud service coming soon. The multi model idea is nothing new though. Another database pushing the limits is Fauna. It was Created by ex Twitter engineers who set out to build the perfect database.

It's extremely easy to use like a document database similar to MongoDB, but unlike a document database, it supports features like native Jib joins, which is the number one missing feature in document databases. And that means Spana is more well suited for complex relational data like social graphs. To interact with it, it has its own custom query language called FQL, but also comes with a GraphQL API. It is a closed source product, So you can't self host it, but its fully managed service has a nice free tier. Another new database you've likely never heard of is Memgraph.

It's a drop in replacement for Neo4j, 4 j, which is the gold standard for graph databases, but Memgraph is focused on building real time data pipelines. Like Neo 4 j, it can be queried with Cypher, but it's written in c plus plus with a memory first architecture that claims to achieve better performance. Overall, it looks like it would be a great choice for building something Like a real time analytics platform. Next up, we'll look at KeyDB, which is a faster alternative to the already extremely fast Redis. It was recently acquired iSnap, a company that needs to fetch data as fast as humanly possible.

It can handle over 1,000,000 operations per second on a single node, which sounds like a lot to me, but it's Not something you would use as your primary database, rather it's mostly used as an in memory cache to duplicate high priority data from another database, making it load Faster for the end user. It also has a library called modjs, allowing you to extend the database with your own custom commands and functionality With JavaScript, another specialty database to look into is Melee Search. The full text search engine space is dominated by tools like Elasticsearch and Algolia. Melee search is an open source rust based alternative that makes it easy to implement an awesome search feature into your app. It's not a primary database, but instead a place where you would duplicate data that needs to be in complex ways, like you can fine tune different parameters to control which attributes have a higher ranking in the search.

In addition, it has a bunch of client like instant melee search that can quickly implement a search feature in a front end web application. And finally, that brings us to MindsDB, A database that integrates popular machine learning frameworks. It created a concept called AI tables that embed predictive models directly into the database. At first glance, it feels like SQL, except you can use it to write statements that train machine learning models. When the model's done training, you can then use Select to make predictions from it.

So basically, it provides an integrated way to handle the MLOps life cycle, and it can also integrate with your existing machine learning models or those from third parties like Hugging Face or OpenAI. In the not so distant future, I believe embedding AI directly into databases will be a huge thing, and MindsDB gives you an idea of how that could look. And now, You have 15 different futuristic databases to choose from for your next failed side project. Good luck with that. If I missed anything, let me know in the comments.

And if you wanna learn more about awesome serverless databases like Firestore and Supabase, support my work as a pro member on Fireship IO. Thanks for watching, and I will see you in the next one.
If you wanna be successful in tech, you need to move fast and break things. That's exactly what I said to my boss before he fired me for deleting a production database. I should fire you and burn down your friggin' house. The relational database management system is one of the most successful ideas in the history of computing. SQL is 19 seventies tech that still forms the backbone of the modern big data world. Oracle dominates enterprise, while MySQL is the primary database for platforms like YouTube and Facebook. But SQL is by no means perfect. In 20 23, there's a whole new wave of futuristic, cutting edge, avant garde game changing databases looking to move fast and break things. Some of them on top of existing relational patterns, while others bring entirely new ideas to the table that you've never seen before. No pun intended. Over the next few minutes, We'll look at 15 crazy ass new databases and talk about the problems they're trying to solve. 1st on the list, we have PlanetScale, which is not a new database, but rather a serverless platform for MySQL. Phone. Like I mentioned before, YouTube uses MySQL. However, back in 2010 when it was getting popular, it was extremely difficult to scale, at least for an app with millions of simultaneous connections. Instead of switching to a NoSQL document database, they developed a library called vTest, which makes some trade offs to scale MySQL horizontally, fleet. And this is the technology that PlanetScale is based on. It provides a fully managed database that can scale with V test, and makes it available from a nice dashboard with SDKs to go along with it. And it also integrates nicely with tools like Prisma. It has a free tier and a good pricing on the paid tier that they're likely losing money on. By comparison, a basic database on Heroku is $50 and Unreasonably expensive on AWS and Google Cloud. PlanetScale is not the only company with this serverless database idea, though. YogaByte has its own open source solution for post Its goal is to scale infinitely in the cloud, but attempt to support all the native features in Postgres, which is not easy to do in a cloud native environment. You can actually use a multi cloud strategy g to host your database on multiple clouds at the same time, eliminating the dreaded vendor lock in issue. But there's another option for scaling Postgres called Neon. It's currently in technical preview, but Looks extremely promising. It's serverless and can scale down to 0 and has a highly polished admin dashboard to go along with it.
databases
data management
management
microsoft
youtube
And most importantly, it's written in Rust, which is the only thing that matters if you wanna cool in front of your friends. It also supports branching, which I think was inspired by another database called Dult. This database would be like if MySQL and Git had a Maybe. Most importantly, it allows you to create branches from the main database where you can experiment with new data without breaking things. It makes it easy to analyze the diff between changes, and when Everything looks good. The changes can be merged back into the main branch.
databases
data
data management
data analysis
And it's done with the same conventions found in Git that virtually every developer is familiar Dolts has a hosted option, but it is quite expensive. They've raised $21,000,000 and because I'm extremely entitled, I demand they burn more of this money to give us Free tier. I just paid $8 for a dozen eggs and can't afford to put another $50 on my mom's credit card.
Now, another sequel flavor I wanna talk about is CockroachDB. Feet. It's been around for quite a while and was developed by ex Google employees and is often referred to as New SQL. It's compatible with Postgres, but was built from the ground up with Go to To scale horizontally in the cloud.
databases
It has a nice free tier pretty similar to PlanetScale, then becomes pay as you go pricing after that.
It's yet another great option, but you might also want to consider FoundationDB or TitaniumDB as well, which are also in this new SQL class. But in some cases, you might prefer A lightweight alternative like Cloudflare d one. This is a brand new product that's still in beta, and basically, it's a SQLite database that runs on the edge. Cloudflare Flare already has its own key value store for workers as well as r 2 for object storage, but d one allows you to create data on the edge that Can be queried. One trade off though is that native transactions will not work. However, they're taking a very cool approach to overcome that limitation by Allowing developers to write stored procedures with JavaScript, which are just snippets of code that run directly in your database, which can be used to create transactions or other reusable queries. This approach has a ton of potential, because historically, stored procedures are a pain to work with. But if it's in JavaScript, even I could do it. Pretty cool, but it's not production But yet, if you want something that's ready to go today, check out Zeta, yet another serverless relational database that's based on Postgres and Elasticsearch under the hood. What makes it special is that it treats your data like a spreadsheet. It feels kind of like a developer friendly alternative to Airtable or Notion.
databases
data management
commerce
operations
And what's really awesome is that it has full text search Built in without needing to duplicate your data in some other service like Algolia. It has SDKs for TypeScript and Python and has a schema editor that makes It's very easy to create and visualize relationships between tables, and it can also do branching like we looked at in DoltDB. For pricing, it has a solid free tier, then it scales up in a linear way based on usage. But another tool that takes things one step further is 8base. It's also a relational database that provides a GraphQL API for your data out of box, making it similar to tools like Hasura. What makes it unique though is that it also comes with a low code tool for quickly building front end applications That connect to your back end. It's like a back end as a service that can also build your front end, but that's enough talk about relational databases. Now we enter the post SQL Era with EdgeDB. It's a graph relational database that's powered by Postgres under the hood. When it comes to relationships, humans don't naturally think of columns and rows, but rather objects connected to each other, like a graph. Instead of defining tables like you would in SQL, you define types like you would in most programming languages. These types link to other types, which is awesome because it eliminates the need for joins and simplifies the way you make queries. Overall, it almost feels like an ORM for Postgres That allows you to think about relationships in a far more human friendly way. Currently, it's open source and can be self hosted, but there's a wait list for their cloud service. Now another relational graph like database is surreal DB. It's written in Rust, and I have a full tutorial on my second channel, Beyond Fireship. It's designed to support asset transactions while scaling horizontally, but what I really like about it is how easy and flexible it makes data modeling. For the most part, it feels like SQL, but also uses arrows to connect nodes edges, like you would in Cypher with a graph database like Neo4j. It takes the best elements of relational, document, and graph databases, and combines them into one Easy to use API. Currently, it can only be self hosted, but they do have a cloud service coming soon. The multi model idea is nothing new though. Another database pushing the limits is Fauna. It was Created by ex Twitter engineers who set out to build the perfect database. It's extremely easy to use like a document database similar to MongoDB, but unlike a document database, it supports features like native Jib joins, which is the number one missing feature in document databases. And that means Spana is more well suited for complex relational data like social graphs. To interact with it, it has its own custom query language called FQL, but also comes with a GraphQL API. It is a closed source product, So you can't self host it, but its fully managed service has a nice free tier. Another new database you've likely never heard of is Memgraph. It's a drop in replacement for Neo4j, 4 j, which is the gold standard for graph databases, but Memgraph is focused on building real time data pipelines. Like Neo 4 j, it can be queried with Cypher, but it's written in c plus plus with a memory first architecture that claims to achieve better performance. Overall, it looks like it would be a great choice for building something Like a real time analytics platform. Next up, we'll look at KeyDB, which is a faster alternative to the already extremely fast Redis. It was recently acquired iSnap, a company that needs to fetch data as fast as humanly possible. It can handle over 1,000,000 operations per second on a single node, which sounds like a lot to me, but it's Not something you would use as your primary database, rather it's mostly used as an in memory cache to duplicate high priority data from another database, making it load Faster for the end user. It also has a library called modjs, allowing you to extend the database with your own custom commands and functionality With JavaScript, another specialty database to look into is Melee Search. The full text search engine space is dominated by tools like Elasticsearch and Algolia. Melee search is an open source rust based alternative that makes it easy to implement an awesome search feature into your app. It's not a primary database, but instead a place where you would duplicate data that needs to be in complex ways, like you can fine tune different parameters to control which attributes have a higher ranking in the search. In addition, it has a bunch of client like instant melee search that can quickly implement a search feature in a front end web application. And finally, that brings us to MindsDB, A database that integrates popular machine learning frameworks. It created a concept called AI tables that embed predictive models directly into the database. At first glance, it feels like SQL, except you can use it to write statements that train machine learning models. When the model's done training, you can then use Select to make predictions from it. So basically, it provides an integrated way to handle the MLOps life cycle, and it can also integrate with your existing machine learning models or those from third parties like Hugging Face or OpenAI. In the not so distant future, I believe embedding AI directly into databases will be a huge thing, and MindsDB gives you an idea of how that could look. And now, You have 15 different futuristic databases to choose from for your next failed side project. Good luck with that. If I missed anything, let me know in the comments. And if you wanna learn more about awesome serverless databases like Firestore and Supabase, support my work as a pro member on Fireship IO. Thanks for watching, and I will see you in the next one.
databases
machine learning
programming
artificial intelligence
mining
modeling
wildlife
data management
data
networking
technology
neural networks
websites
ecology
If you wanna be successful in tech, you need to move fast and break things. That's exactly what I said to my boss before he fired me for deleting a production database. I should fire you and burn down your friggin' house. The relational database management system is one of the most successful ideas in the history of computing. SQL is 19 seventies tech that still forms the backbone of the modern big data world. Oracle dominates enterprise, while MySQL is the primary database for platforms like YouTube and Facebook. But SQL is by no means perfect. In 20 23, there's a whole new wave of futuristic, cutting edge, avant garde game changing databases looking to move fast and break things. Some of them on top of existing relational patterns, while others bring entirely new ideas to the table that you've never seen before. No pun intended. Over the next few minutes, We'll look at 15 crazy ass new databases and talk about the problems they're trying to solve. 1st on the list, we have PlanetScale, which is not a new database, but rather a serverless platform for MySQL. Phone. Like I mentioned before, YouTube uses MySQL. However, back in 2010 when it was getting popular, it was extremely difficult to scale, at least for an app with millions of simultaneous connections. Instead of switching to a NoSQL document database, they developed a library called vTest, which makes some trade offs to scale MySQL horizontally, fleet. And this is the technology that PlanetScale is based on. It provides a fully managed database that can scale with V test, and makes it available from a nice dashboard with SDKs to go along with it. And it also integrates nicely with tools like Prisma. It has a free tier and a good pricing on the paid tier that they're likely losing money on. By comparison, a basic database on Heroku is $50 and Unreasonably expensive on AWS and Google Cloud. PlanetScale is not the only company with this serverless database idea, though. YogaByte has its own open source solution for post Its goal is to scale infinitely in the cloud, but attempt to support all the native features in Postgres, which is not easy to do in a cloud native environment. You can actually use a multi cloud strategy g to host your database on multiple clouds at the same time, eliminating the dreaded vendor lock in issue. But there's another option for scaling Postgres called Neon. It's currently in technical preview, but Looks extremely promising. It's serverless and can scale down to 0 and has a highly polished admin dashboard to go along with it. And most importantly, it's written in Rust, which is the only thing that matters if you wanna cool in front of your friends. It also supports branching, which I think was inspired by another database called Dult. This database would be like if MySQL and Git had a Maybe. Most importantly, it allows you to create branches from the main database where you can experiment with new data without breaking things. It makes it easy to analyze the diff between changes, and when Everything looks good. The changes can be merged back into the main branch. And it's done with the same conventions found in Git that virtually every developer is familiar Dolts has a hosted option, but it is quite expensive. They've raised $21,000,000 and because I'm extremely entitled, I demand they burn more of this money to give us Free tier. I just paid $8 for a dozen eggs and can't afford to put another $50 on my mom's credit card. Now, another sequel flavor I wanna talk about is CockroachDB. Feet. It's been around for quite a while and was developed by ex Google employees and is often referred to as New SQL. It's compatible with Postgres, but was built from the ground up with Go to To scale horizontally in the cloud. It has a nice free tier pretty similar to PlanetScale, then becomes pay as you go pricing after that. It's yet another great option, but you might also want to consider FoundationDB or TitaniumDB as well, which are also in this new SQL class. But in some cases, you might prefer A lightweight alternative like Cloudflare d one. This is a brand new product that's still in beta, and basically, it's a SQLite database that runs on the edge. Cloudflare Flare already has its own key value store for workers as well as r 2 for object storage, but d one allows you to create data on the edge that Can be queried. One trade off though is that native transactions will not work. However, they're taking a very cool approach to overcome that limitation by Allowing developers to write stored procedures with JavaScript, which are just snippets of code that run directly in your database, which can be used to create transactions or other reusable queries. This approach has a ton of potential, because historically, stored procedures are a pain to work with. But if it's in JavaScript, even I could do it. Pretty cool, but it's not production But yet, if you want something that's ready to go today, check out Zeta, yet another serverless relational database that's based on Postgres and Elasticsearch under the hood. What makes it special is that it treats your data like a spreadsheet. It feels kind of like a developer friendly alternative to Airtable or Notion. And what's really awesome is that it has full text search Built in without needing to duplicate your data in some other service like Algolia. It has SDKs for TypeScript and Python and has a schema editor that makes It's very easy to create and visualize relationships between tables, and it can also do branching like we looked at in DoltDB. For pricing, it has a solid free tier, then it scales up in a linear way based on usage. But another tool that takes things one step further is 8base. It's also a relational database that provides a GraphQL API for your data out of box, making it similar to tools like Hasura. What makes it unique though is that it also comes with a low code tool for quickly building front end applications That connect to your back end. It's like a back end as a service that can also build your front end, but that's enough talk about relational databases. Now we enter the post SQL Era with EdgeDB. It's a graph relational database that's powered by Postgres under the hood. When it comes to relationships, humans don't naturally think of columns and rows, but rather objects connected to each other, like a graph. Instead of defining tables like you would in SQL, you define types like you would in most programming languages. These types link to other types, which is awesome because it eliminates the need for joins and simplifies the way you make queries. Overall, it almost feels like an ORM for Postgres That allows you to think about relationships in a far more human friendly way. Currently, it's open source and can be self hosted, but there's a wait list for their cloud service. Now another relational graph like database is surreal DB. It's written in Rust, and I have a full tutorial on my second channel, Beyond Fireship. It's designed to support asset transactions while scaling horizontally, but what I really like about it is how easy and flexible it makes data modeling. For the most part, it feels like SQL, but also uses arrows to connect nodes edges, like you would in Cypher with a graph database like Neo4j. It takes the best elements of relational, document, and graph databases, and combines them into one Easy to use API. Currently, it can only be self hosted, but they do have a cloud service coming soon. The multi model idea is nothing new though. Another database pushing the limits is Fauna. It was Created by ex Twitter engineers who set out to build the perfect database. It's extremely easy to use like a document database similar to MongoDB, but unlike a document database, it supports features like native Jib joins, which is the number one missing feature in document databases. And that means Spana is more well suited for complex relational data like social graphs. To interact with it, it has its own custom query language called FQL, but also comes with a GraphQL API. It is a closed source product, So you can't self host it, but its fully managed service has a nice free tier. Another new database you've likely never heard of is Memgraph. It's a drop in replacement for Neo4j, 4 j, which is the gold standard for graph databases, but Memgraph is focused on building real time data pipelines. Like Neo 4 j, it can be queried with Cypher, but it's written in c plus plus with a memory first architecture that claims to achieve better performance. Overall, it looks like it would be a great choice for building something Like a real time analytics platform. Next up, we'll look at KeyDB, which is a faster alternative to the already extremely fast Redis. It was recently acquired iSnap, a company that needs to fetch data as fast as humanly possible. It can handle over 1,000,000 operations per second on a single node, which sounds like a lot to me, but it's Not something you would use as your primary database, rather it's mostly used as an in memory cache to duplicate high priority data from another database, making it load Faster for the end user. It also has a library called modjs, allowing you to extend the database with your own custom commands and functionality With JavaScript, another specialty database to look into is Melee Search. The full text search engine space is dominated by tools like Elasticsearch and Algolia. Melee search is an open source rust based alternative that makes it easy to implement an awesome search feature into your app. It's not a primary database, but instead a place where you would duplicate data that needs to be in complex ways, like you can fine tune different parameters to control which attributes have a higher ranking in the search. In addition, it has a bunch of client like instant melee search that can quickly implement a search feature in a front end web application. And finally, that brings us to MindsDB, A database that integrates popular machine learning frameworks. It created a concept called AI tables that embed predictive models directly into the database. At first glance, it feels like SQL, except you can use it to write statements that train machine learning models. When the model's done training, you can then use Select to make predictions from it. So basically, it provides an integrated way to handle the MLOps life cycle, and it can also integrate with your existing machine learning models or those from third parties like Hugging Face or OpenAI. In the not so distant future, I believe embedding AI directly into databases will be a huge thing, and MindsDB gives you an idea of how that could look. And now, You have 15 different futuristic databases to choose from for your next failed side project. Good luck with that. If I missed anything, let me know in the comments. And if you wanna learn more about awesome serverless databases like Firestore and Supabase, support my work as a pro member on Fireship IO. Thanks for watching, and I will see you in the next one.
If
if
you
you
wanna
wanna
be
be
successful
successful
in
in
tech,
tech
you
you
need
need
to
to
move
move
fast
fast
and
and
break
break
things.
things
That's
that's
exactly
exactly
what
what
I
i
said
said
to
to
my
my
boss
boss
before
before
he
he
fired
fired
me
me
for
for
deleting
deleting
a
a
production
production
database.
database
I
i
should
should
fire
fire
you
you
and
and
burn
burn
down
down
your
your
friggin'
friggin'
house.
house
The
the
relational
relational
database
database
management
management
system
system
is
is
one
one
of
of
the
the
most
most
successful
successful
ideas
ideas
in
in
the
the
history
history
of
of
computing.
computing
SQL
sql
is
is
19
19
seventies
seventies
tech
tech
that
that
still
still
forms
forms
the
the
backbone
backbone
of
of
the
the
modern
modern
big
big
data
data
world.
world
Oracle
oracle
dominates
dominates
enterprise,
enterprise
while
while
MySQL
mysql
is
is
the
the
primary
primary
database
database
for
for
platforms
platforms
like
like
YouTube
youtube
and
and
Facebook.
facebook
But
but
SQL
sql
is
is
by
by
no
no
means
means
perfect.
perfect
In
in
20
20
23,
23
there's
there's
a
a
whole
whole
new
new
wave
wave
of
of
futuristic,
futuristic
cutting
cutting
edge,
edge
avant
avant
garde
garde
game
game
changing
changing
databases
databases
looking
looking
to
to
move
move
fast
fast
and
and
break
break
things.
things
Some
some
of
of
them
them
on
on
top
top
of
of
existing
existing
relational
relational
patterns,
patterns
while
while
others
others
bring
bring
entirely
entirely
new
new
ideas
ideas
to
to
the
the
table
table
that
that
you've
you've
never
never
seen
seen
before.
before
No
no
pun
pun
intended.
intended
Over
over
the
the
next
next
few
few
minutes,
minutes
We'll
we'll
look
look
at
at
15
15
crazy
crazy
ass
ass
new
new
databases
databases
and
and
talk
talk
about
about
the
the
problems
problems
they're
they're
trying
trying
to
to
solve.
solve
1st
1st
on
on
the
the
list,
list
we
we
have
have
PlanetScale,
planetscale
which
which
is
is
not
not
a
a
new
new
database,
database
but
but
rather
rather
a
a
serverless
serverless
platform
platform
for
for
MySQL.
mysql
Phone.
phone
Like
like
I
i
mentioned
mentioned
before,
before
YouTube
youtube
uses
uses
MySQL.
mysql
However,
however
back
back
in
in
2010
2010
when
when
it
it
was
was
getting
getting
popular,
popular
it
it
was
was
extremely
extremely
difficult
difficult
to
to
scale,
scale
at
at
least
least
for
for
an
an
app
app
with
with
millions
millions
of
of
simultaneous
simultaneous
connections.
connections
Instead
instead
of
of
switching
switching
to
to
a
a
NoSQL
nosql
document
document
database,
database
they
they
developed
developed
a
a
library
library
called
called
vTest,
vtest
which
which
makes
makes
some
some
trade
trade
offs
offs
to
to
scale
scale
MySQL
mysql
horizontally,
horizontally
fleet.
fleet
And
and
this
this
is
is
the
the
technology
technology
that
that
PlanetScale
planetscale
is
is
based
based
on.
on
It
it
provides
provides
a
a
fully
fully
managed
managed
database
database
that
that
can
can
scale
scale
with
with
V
v
test,
test
and
and
makes
makes
it
it
available
available
from
from
a
a
nice
nice
dashboard
dashboard
with
with
SDKs
sdks
to
to
go
go
along
along
with
with
it.
it
And
and
it
it
also
also
integrates
integrates
nicely
nicely
with
with
tools
tools
like
like
Prisma.
prisma
It
it
has
has
a
a
free
free
tier
tier
and
and
a
a
good
good
pricing
pricing
on
on
the
the
paid
paid
tier
tier
that
that
they're
they're
likely
likely
losing
losing
money
money
on.
on
By
by
comparison,
comparison
a
a
basic
basic
database
database
on
on
Heroku
heroku
is
is
$50
$50
and
and
Unreasonably
unreasonably
expensive
expensive
on
on
AWS
aws
and
and
Google
google
Cloud.
cloud
PlanetScale
planetscale
is
is
not
not
the
the
only
only
company
company
with
with
this
this
serverless
serverless
database
database
idea,
idea
though.
though
YogaByte
yogabyte
has
has
its
its
own
own
open
open
source
source
solution
solution
for
for
post
post
Its
its
goal
goal
is
is
to
to
scale
scale
infinitely
infinitely
in
in
the
the
cloud,
cloud
but
but
attempt
attempt
to
to
support
support
all
all
the
the
native
native
features
features
in
in
Postgres,
postgres
which
which
is
is
not
not
easy
easy
to
to
do
do
in
in
a
a
cloud
cloud
native
native
environment.
environment
You
you
can
can
actually
actually
use
use
a
a
multi
multi
cloud
cloud
strategy
strategy
g
g
to
to
host
host
your
your
database
database
on
on
multiple
multiple
clouds
clouds
at
at
the
the
same
same
time,
time
eliminating
eliminating
the
the
dreaded
dreaded
vendor
vendor
lock
lock
in
in
issue.
issue
But
but
there's
there's
another
another
option
option
for
for
scaling
scaling
Postgres
postgres
called
called
Neon.
neon
It's
it's
currently
currently
in
in
technical
technical
preview,
preview
but
but
Looks
looks
extremely
extremely
promising.
promising
It's
it's
serverless
serverless
and
and
can
can
scale
scale
down
down
to
to
0
0
and
and
has
has
a
a
highly
highly
polished
polished
admin
admin
dashboard
dashboard
to
to
go
go
along
along
with
with
it.
it
And
and
most
most
importantly,
importantly
it's
it's
written
written
in
in
Rust,
rust
which
which
is
is
the
the
only
only
thing
thing
that
that
matters
matters
if
if
you
you
wanna
wanna
cool
cool
in
in
front
front
of
of
your
your
friends.
friends
It
it
also
also
supports
supports
branching,
branching
which
which
I
i
think
think
was
was
inspired
inspired
by
by
another
another
database
database
called
called
Dult.
dult
This
this
database
database
would
would
be
be
like
like
if
if
MySQL
mysql
and
and
Git
git
had
had
a
a
Maybe.
maybe
Most
most
importantly,
importantly
it
it
allows
allows
you
you
to
to
create
create
branches
branches
from
from
the
the
main
main
database
database
where
where
you
you
can
can
experiment
experiment
with
with
new
new
data
data
without
without
breaking
breaking
things.
things
It
it
makes
makes
it
it
easy
easy
to
to
analyze
analyze
the
the
diff
diff
between
between
changes,
changes
and
and
when
when
Everything
everything
looks
looks
good.
good
The
the
changes
changes
can
can
be
be
merged
merged
back
back
into
into
the
the
main
main
branch.
branch
And
and
it's
it's
done
done
with
with
the
the
same
same
conventions
conventions
found
found
in
in
Git
git
that
that
virtually
virtually
every
every
developer
developer
is
is
familiar
familiar
Dolts
dolts
has
has
a
a
hosted
hosted
option,
option
but
but
it
it
is
is
quite
quite
expensive.
expensive
They've
they've
raised
raised
$21,000,000
$21,000,000
and
and
because
because
I'm
i'm
extremely
extremely
entitled,
entitled
I
i
demand
demand
they
they
burn
burn
more
more
of
of
this
this
money
money
to
to
give
give
us
us
Free
free
tier.
tier
I
i
just
just
paid
paid
$8
$8
for
for
a
a
dozen
dozen
eggs
eggs
and
and
can't
can't
afford
afford
to
to
put
put
another
another
$50
$50
on
on
my
my
mom's
mom's
credit
credit
card.
card
Now,
now
another
another
sequel
sequel
flavor
flavor
I
i
wanna
wanna
talk
talk
about
about
is
is
CockroachDB.
cockroachdb
Feet.
feet
It's
it's
been
been
around
around
for
for
quite
quite
a
a
while
while
and
and
was
was
developed
developed
by
by
ex
ex
Google
google
employees
employees
and
and
is
is
often
often
referred
referred
to
to
as
as
New
new
SQL.
sql
It's
it's
compatible
compatible
with
with
Postgres,
postgres
but
but
was
was
built
built
from
from
the
the
ground
ground
up
up
with
with
Go
go
to
to
To
to
scale
scale
horizontally
horizontally
in
in
the
the
cloud.
cloud
It
it
has
has
a
a
nice
nice
free
free
tier
tier
pretty
pretty
similar
similar
to
to
PlanetScale,
planetscale
then
then
becomes
becomes
pay
pay
as
as
you
you
go
go
pricing
pricing
after
after
that.
that
It's
it's
yet
yet
another
another
great
great
option,
option
but
but
you
you
might
might
also
also
want
want
to
to
consider
consider
FoundationDB
foundationdb
or
or
TitaniumDB
titaniumdb
as
as
well,
well
which
which
are
are
also
also
in
in
this
this
new
new
SQL
sql
class.
class
But
but
in
in
some
some
cases,
cases
you
you
might
might
prefer
prefer
A
a
lightweight
lightweight
alternative
alternative
like
like
Cloudflare
cloudflare
d
d
one.
one
This
this
is
is
a
a
brand
brand
new
new
product
product
that's
that's
still
still
in
in
beta,
beta
and
and
basically,
basically
it's
it's
a
a
SQLite
sqlite
database
database
that
that
runs
runs
on
on
the
the
edge.
edge
Cloudflare
cloudflare
Flare
flare
already
already
has
has
its
its
own
own
key
key
value
value
store
store
for
for
workers
workers
as
as
well
well
as
as
r
r
2
2
for
for
object
object
storage,
storage
but
but
d
d
one
one
allows
allows
you
you
to
to
create
create
data
data
on
on
the
the
edge
edge
that
that
Can
can
be
be
queried.
queried
One
one
trade
trade
off
off
though
though
is
is
that
that
native
native
transactions
transactions
will
will
not
not
work.
work
However,
however
they're
they're
taking
taking
a
a
very
very
cool
cool
approach
approach
to
to
overcome
overcome
that
that
limitation
limitation
by
by
Allowing
allowing
developers
developers
to
to
write
write
stored
stored
procedures
procedures
with
with
JavaScript,
javascript
which
which
are
are
just
just
snippets
snippets
of
of
code
code
that
that
run
run
directly
directly
in
in
your
your
database,
database
which
which
can
can
be
be
used
used
to
to
create
create
transactions
transactions
or
or
other
other
reusable
reusable
queries.
queries
This
this
approach
approach
has
has
a
a
ton
ton
of
of
potential,
potential
because
because
historically,
historically
stored
stored
procedures
procedures
are
are
a
a
pain
pain
to
to
work
work
with.
with
But
but
if
if
it's
it's
in
in
JavaScript,
javascript
even
even
I
i
could
could
do
do
it.
it
Pretty
pretty
cool,
cool
but
but
it's
it's
not
not
production
production
But
but
yet,
yet
if
if
you
you
want
want
something
something
that's
that's
ready
ready
to
to
go
go
today,
today
check
check
out
out
Zeta,
zeta
yet
yet
another
another
serverless
serverless
relational
relational
database
database
that's
that's
based
based
on
on
Postgres
postgres
and
and
Elasticsearch
elasticsearch
under
under
the
the
hood.
hood
What
what
makes
makes
it
it
special
special
is
is
that
that
it
it
treats
treats
your
your
data
data
like
like
a
a
spreadsheet.
spreadsheet
It
it
feels
feels
kind
kind
of
of
like
like
a
a
developer
developer
friendly
friendly
alternative
alternative
to
to
Airtable
airtable
or
or
Notion.
notion
And
and
what's
what's
really
really
awesome
awesome
is
is
that
that
it
it
has
has
full
full
text
text
search
search
Built
built
in
in
without
without
needing
needing
to
to
duplicate
duplicate
your
your
data
data
in
in
some
some
other
other
service
service
like
like
Algolia.
algolia
It
it
has
has
SDKs
sdks
for
for
TypeScript
typescript
and
and
Python
python
and
and
has
has
a
a
schema
schema
editor
editor
that
that
makes
makes
It's
it's
very
very
easy
easy
to
to
create
create
and
and
visualize
visualize
relationships
relationships
between
between
tables,
tables
and
and
it
it
can
can
also
also
do
do
branching
branching
like
like
we
we
looked
looked
at
at
in
in
DoltDB.
doltdb
For
for
pricing,
pricing
it
it
has
has
a
a
solid
solid
free
free
tier,
tier
then
then
it
it
scales
scales
up
up
in
in
a
a
linear
linear
way
way
based
based
on
on
usage.
usage
But
but
another
another
tool
tool
that
that
takes
takes
things
things
one
one
step
step
further
further
is
is
8base.
8base
It's
it's
also
also
a
a
relational
relational
database
database
that
that
provides
provides
a
a
GraphQL
graphql
API
api
for
for
your
your
data
data
out
out
of
of
box,
box
making
making
it
it
similar
similar
to
to
tools
tools
like
like
Hasura.
hasura
What
what
makes
makes
it
it
unique
unique
though
though
is
is
that
that
it
it
also
also
comes
comes
with
with
a
a
low
low
code
code
tool
tool
for
for
quickly
quickly
building
building
front
front
end
end
applications
applications
That
that
connect
connect
to
to
your
your
back
back
end.
end
It's
it's
like
like
a
a
back
back
end
end
as
as
a
a
service
service
that
that
can
can
also
also
build
build
your
your
front
front
end,
end
but
but
that's
that's
enough
enough
talk
talk
about
about
relational
relational
databases.
databases
Now
now
we
we
enter
enter
the
the
post
post
SQL
sql
Era
era
with
with
EdgeDB.
edgedb
It's
it's
a
a
graph
graph
relational
relational
database
database
that's
that's
powered
powered
by
by
Postgres
postgres
under
under
the
the
hood.
hood
When
when
it
it
comes
comes
to
to
relationships,
relationships
humans
humans
don't
don't
naturally
naturally
think
think
of
of
columns
columns
and
and
rows,
rows
but
but
rather
rather
objects
objects
connected
connected
to
to
each
each
other,
other
like
like
a
a
graph.
graph
Instead
instead
of
of
defining
defining
tables
tables
like
like
you
you
would
would
in
in
SQL,
sql
you
you
define
define
types
types
like
like
you
you
would
would
in
in
most
most
programming
programming
languages.
languages
These
these
types
types
link
link
to
to
other
other
types,
types
which
which
is
is
awesome
awesome
because
because
it
it
eliminates
eliminates
the
the
need
need
for
for
joins
joins
and
and
simplifies
simplifies
the
the
way
way
you
you
make
make
queries.
queries
Overall,
overall
it
it
almost
almost
feels
feels
like
like
an
an
ORM
orm
for
for
Postgres
postgres
That
that
allows
allows
you
you
to
to
think
think
about
about
relationships
relationships
in
in
a
a
far
far
more
more
human
human
friendly
friendly
way.
way
Currently,
currently
it's
it's
open
open
source
source
and
and
can
can
be
be
self
self
hosted,
hosted
but
but
there's
there's
a
a
wait
wait
list
list
for
for
their
their
cloud
cloud
service.
service
Now
now
another
another
relational
relational
graph
graph
like
like
database
database
is
is
surreal
surreal
DB.
db
It's
it's
written
written
in
in
Rust,
rust
and
and
I
i
have
have
a
a
full
full
tutorial
tutorial
on
on
my
my
second
second
channel,
channel
Beyond
beyond
Fireship.
fireship
It's
it's
designed
designed
to
to
support
support
asset
asset
transactions
transactions
while
while
scaling
scaling
horizontally,
horizontally
but
but
what
what
I
i
really
really
like
like
about
about
it
it
is
is
how
how
easy
easy
and
and
flexible
flexible
it
it
makes
makes
data
data
modeling.
modeling
For
for
the
the
most
most
part,
part
it
it
feels
feels
like
like
SQL,
sql
but
but
also
also
uses
uses
arrows
arrows
to
to
connect
connect
nodes
nodes
edges,
edges
like
like
you
you
would
would
in
in
Cypher
cypher
with
with
a
a
graph
graph
database
database
like
like
Neo4j.
neo4j
It
it
takes
takes
the
the
best
best
elements
elements
of
of
relational,
relational
document,
document
and
and
graph
graph
databases,
databases
and
and
combines
combines
them
them
into
into
one
one
Easy
easy
to
to
use
use
API.
api
Currently,
currently
it
it
can
can
only
only
be
be
self
self
hosted,
hosted
but
but
they
they
do
do
have
have
a
a
cloud
cloud
service
service
coming
coming
soon.
soon
The
the
multi
multi
model
model
idea
idea
is
is
nothing
nothing
new
new
though.
though
Another
another
database
database
pushing
pushing
the
the
limits
limits
is
is
Fauna.
fauna
It
it
was
was
Created
created
by
by
ex
ex
Twitter
twitter
engineers
engineers
who
who
set
set
out
out
to
to
build
build
the
the
perfect
perfect
database.
database
It's
it's
extremely
extremely
easy
easy
to
to
use
use
like
like
a
a
document
document
database
database
similar
similar
to
to
MongoDB,
mongodb
but
but
unlike
unlike
a
a
document
document
database,
database
it
it
supports
supports
features
features
like
like
native
native
Jib
jib
joins,
joins
which
which
is
is
the
the
number
number
one
one
missing
missing
feature
feature
in
in
document
document
databases.
databases
And
and
that
that
means
means
Spana
spana
is
is
more
more
well
well
suited
suited
for
for
complex
complex
relational
relational
data
data
like
like
social
social
graphs.
graphs
To
to
interact
interact
with
with
it,
it
it
it
has
has
its
its
own
own
custom
custom
query
query
language
language
called
called
FQL,
fql
but
but
also
also
comes
comes
with
with
a
a
GraphQL
graphql
API.
api
It
it
is
is
a
a
closed
closed
source
source
product,
product
So
so
you
you
can't
can't
self
self
host
host
it,
it
but
but
its
its
fully
fully
managed
managed
service
service
has
has
a
a
nice
nice
free
free
tier.
tier
Another
another
new
new
database
database
you've
you've
likely
likely
never
never
heard
heard
of
of
is
is
Memgraph.
memgraph
It's
it's
a
a
drop
drop
in
in
replacement
replacement
for
for
Neo4j,
neo4j
4
4
j,
j
which
which
is
is
the
the
gold
gold
standard
standard
for
for
graph
graph
databases,
databases
but
but
Memgraph
memgraph
is
is
focused
focused
on
on
building
building
real
real
time
time
data
data
pipelines.
pipelines
Like
like
Neo
neo
4
4
j,
j
it
it
can
can
be
be
queried
queried
with
with
Cypher,
cypher
but
but
it's
it's
written
written
in
in
c
c
plus
plus
plus
plus
with
with
a
a
memory
memory
first
first
architecture
architecture
that
that
claims
claims
to
to
achieve
achieve
better
better
performance.
performance
Overall,
overall
it
it
looks
looks
like
like
it
it
would
would
be
be
a
a
great
great
choice
choice
for
for
building
building
something
something
Like
like
a
a
real
real
time
time
analytics
analytics
platform.
platform
Next
next
up,
up
we'll
we'll
look
look
at
at
KeyDB,
keydb
which
which
is
is
a
a
faster
faster
alternative
alternative
to
to
the
the
already
already
extremely
extremely
fast
fast
Redis.
redis
It
it
was
was
recently
recently
acquired
acquired
iSnap,
isnap
a
a
company
company
that
that
needs
needs
to
to
fetch
fetch
data
data
as
as
fast
fast
as
as
humanly
humanly
possible.
possible
It
it
can
can
handle
handle
over
over
1,000,000
1,000,000
operations
operations
per
per
second
second
on
on
a
a
single
single
node,
node
which
which
sounds
sounds
like
like
a
a
lot
lot
to
to
me,
me
but
but
it's
it's
Not
not
something
something
you
you
would
would
use
use
as
as
your
your
primary
primary
database,
database
rather
rather
it's
it's
mostly
mostly
used
used
as
as
an
an
in
in
memory
memory
cache
cache
to
to
duplicate
duplicate
high
high
priority
priority
data
data
from
from
another
another
database,
database
making
making
it
it
load
load
Faster
faster
for
for
the
the
end
end
user.
user
It
it
also
also
has
has
a
a
library
library
called
called
modjs,
modjs
allowing
allowing
you
you
to
to
extend
extend
the
the
database
database
with
with
your
your
own
own
custom
custom
commands
commands
and
and
functionality
functionality
With
with
JavaScript,
javascript
another
another
specialty
specialty
database
database
to
to
look
look
into
into
is
is
Melee
melee
Search.
search
The
the
full
full
text
text
search
search
engine
engine
space
space
is
is
dominated
dominated
by
by
tools
tools
like
like
Elasticsearch
elasticsearch
and
and
Algolia.
algolia
Melee
melee
search
search
is
is
an
an
open
open
source
source
rust
rust
based
based
alternative
alternative
that
that
makes
makes
it
it
easy
easy
to
to
implement
implement
an
an
awesome
awesome
search
search
feature
feature
into
into
your
your
app.
app
It's
it's
not
not
a
a
primary
primary
database,
database
but
but
instead
instead
a
a
place
place
where
where
you
you
would
would
duplicate
duplicate
data
data
that
that
needs
needs
to
to
be
be
in
in
complex
complex
ways,
ways
like
like
you
you
can
can
fine
fine
tune
tune
different
different
parameters
parameters
to
to
control
control
which
which
attributes
attributes
have
have
a
a
higher
higher
ranking
ranking
in
in
the
the
search.
search
In
in
addition,
addition
it
it
has
has
a
a
bunch
bunch
of
of
client
client
like
like
instant
instant
melee
melee
search
search
that
that
can
can
quickly
quickly
implement
implement
a
a
search
search
feature
feature
in
in
a
a
front
front
end
end
web
web
application.
application
And
and
finally,
finally
that
that
brings
brings
us
us
to
to
MindsDB,
mindsdb
A
a
database
database
that
that
integrates
integrates
popular
popular
machine
machine
learning
learning
frameworks.
frameworks
It
it
created
created
a
a
concept
concept
called
called
AI
ai
tables
tables
that
that
embed
embed
predictive
predictive
models
models
directly
directly
into
into
the
the
database.
database
At
at
first
first
glance,
glance
it
it
feels
feels
like
like
SQL,
sql
except
except
you
you
can
can
use
use
it
it
to
to
write
write
statements
statements
that
that
train
train
machine
machine
learning
learning
models.
models
When
when
the
the
model's
model's
done
done
training,
training
you
you
can
can
then
then
use
use
Select
select
to
to
make
make
predictions
predictions
from
from
it.
it
So
so
basically,
basically
it
it
provides
provides
an
an
integrated
integrated
way
way
to
to
handle
handle
the
the
MLOps
mlops
life
life
cycle,
cycle
and
and
it
it
can
can
also
also
integrate
integrate
with
with
your
your
existing
existing
machine
machine
learning
learning
models
models
or
or
those
those
from
from
third
third
parties
parties
like
like
Hugging
hugging
Face
face
or
or
OpenAI.
openai
In
in
the
the
not
not
so
so
distant
distant
future,
future
I
i
believe
believe
embedding
embedding
AI
ai
directly
directly
into
into
databases
databases
will
will
be
be
a
a
huge
huge
thing,
thing
and
and
MindsDB
mindsdb
gives
gives
you
you
an
an
idea
idea
of
of
how
how
that
that
could
could
look.
look
And
and
now,
now
You
you
have
have
15
15
different
different
futuristic
futuristic
databases
databases
to
to
choose
choose
from
from
for
for
your
your
next
next
failed
failed
side
side
project.
project
Good
good
luck
luck
with
with
that.
that
If
if
I
i
missed
missed
anything,
anything
let
let
me
me
know
know
in
in
the
the
comments.
comments
And
and
if
if
you
you
wanna
wanna
learn
learn
more
more
about
about
awesome
awesome
serverless
serverless
databases
databases
like
like
Firestore
firestore
and
and
Supabase,
supabase
support
support
my
my
work
work
as
as
a
a
pro
pro
member
member
on
on
Fireship
fireship
IO.
io
Thanks
thanks
for
for
watching,
watching
and
and
I
i
will
will
see
see
you
you
in
in
the
the
next
next
one.
one
success
In this conversation, various speakers discuss new database options, including Planetach, Hope, and a serverless version of dataset transform. They highlight the benefits of these new options, including a full text search and schema editor, and discuss new serverless versions of dataset transform, including a serverless version called dataset transform and a drop in replacement for Neo defective database called queries. They also discuss various graph database and its potential for machine learning models to be used directly into databases, and mention a new serverless version of dataset transform called MindsDB that integrates popular machine learning frameworks and provides an integrated approach to the MLOps life cycle.
15 futuristic databases you’ve never heard of
If you wanna be successful in tech, you need to move fast and break things. That's exactly what I said to my boss before he fired me for deleting a production database. I should fire you and burn down your friggin' house. The relational database management system is one of the most successful ideas in the history of computing. SQL is 19 seventies tech that still forms the backbone of the modern big data world. Oracle dominates enterprise, while MySQL is the primary database for platforms like YouTube and Facebook. But SQL is by no means perfect. In 20 23, there's a whole new wave of futuristic, cutting edge, avant garde game changing databases looking to move fast and break things. Some of them on top of existing relational patterns, while others bring entirely new ideas to the table that you've never seen before. No pun intended. Over the next few minutes, We'll look at 15 crazy ass new databases and talk about the problems they're trying to solve. 1st on the list, we have PlanetScale, which is not a new database, but rather a serverless platform for MySQL. Phone. Like I mentioned before, YouTube uses MySQL. However, back in 2010 when it was getting popular, it was extremely difficult to scale, at least for an app with millions of simultaneous connections. Instead of switching to a NoSQL document database, they developed a library called vTest, which makes some trade offs to scale MySQL horizontally, fleet. And this is the technology that PlanetScale is based on. It provides a fully managed database that can scale with V test, and makes it available from a nice dashboard with SDKs to go along with it. And it also integrates nicely with tools like Prisma. It has a free tier and a good pricing on the paid tier that they're likely losing money on. By comparison, a basic database on Heroku is $50 and Unreasonably expensive on AWS and Google Cloud. PlanetScale is not the only company with this serverless database idea, though. YogaByte has its own open source solution for post Its goal is to scale infinitely in the cloud, but attempt to support all the native features in Postgres, which is not easy to do in a cloud native environment. You can actually use a multi cloud strategy g to host your database on multiple clouds at the same time, eliminating the dreaded vendor lock in issue. But there's another option for scaling Postgres called Neon. It's currently in technical preview, but Looks extremely promising. It's serverless and can scale down to 0 and has a highly polished admin dashboard to go along with it. And most importantly, it's written in Rust, which is the only thing that matters if you wanna cool in front of your friends. It also supports branching, which I think was inspired by another database called Dult. This database would be like if MySQL and Git had a Maybe. Most importantly, it allows you to create branches from the main database where you can experiment with new data without breaking things. It makes it easy to analyze the diff between changes, and when Everything looks good. The changes can be merged back into the main branch. And it's done with the same conventions found in Git that virtually every developer is familiar Dolts has a hosted option, but it is quite expensive. They've raised $21,000,000 and because I'm extremely entitled, I demand they burn more of this money to give us Free tier. I just paid $8 for a dozen eggs and can't afford to put another $50 on my mom's credit card. Now, another sequel flavor I wanna talk about is CockroachDB. Feet. It's been around for quite a while and was developed by ex Google employees and is often referred to as New SQL. It's compatible with Postgres, but was built from the ground up with Go to To scale horizontally in the cloud. It has a nice free tier pretty similar to PlanetScale, then becomes pay as you go pricing after that. It's yet another great option, but you might also want to consider FoundationDB or TitaniumDB as well, which are also in this new SQL class. But in some cases, you might prefer A lightweight alternative like Cloudflare d one. This is a brand new product that's still in beta, and basically, it's a SQLite database that runs on the edge. Cloudflare Flare already has its own key value store for workers as well as r 2 for object storage, but d one allows you to create data on the edge that Can be queried. One trade off though is that native transactions will not work. However, they're taking a very cool approach to overcome that limitation by Allowing developers to write stored procedures with JavaScript, which are just snippets of code that run directly in your database, which can be used to create transactions or other reusable queries. This approach has a ton of potential, because historically, stored procedures are a pain to work with. But if it's in JavaScript, even I could do it. Pretty cool, but it's not production But yet, if you want something that's ready to go today, check out Zeta, yet another serverless relational database that's based on Postgres and Elasticsearch under the hood. What makes it special is that it treats your data like a spreadsheet. It feels kind of like a developer friendly alternative to Airtable or Notion. And what's really awesome is that it has full text search Built in without needing to duplicate your data in some other service like Algolia. It has SDKs for TypeScript and Python and has a schema editor that makes It's very easy to create and visualize relationships between tables, and it can also do branching like we looked at in DoltDB. For pricing, it has a solid free tier, then it scales up in a linear way based on usage. But another tool that takes things one step further is 8base. It's also a relational database that provides a GraphQL API for your data out of box, making it similar to tools like Hasura. What makes it unique though is that it also comes with a low code tool for quickly building front end applications That connect to your back end. It's like a back end as a service that can also build your front end, but that's enough talk about relational databases. Now we enter the post SQL Era with EdgeDB. It's a graph relational database that's powered by Postgres under the hood. When it comes to relationships, humans don't naturally think of columns and rows, but rather objects connected to each other, like a graph. Instead of defining tables like you would in SQL, you define types like you would in most programming languages. These types link to other types, which is awesome because it eliminates the need for joins and simplifies the way you make queries. Overall, it almost feels like an ORM for Postgres That allows you to think about relationships in a far more human friendly way. Currently, it's open source and can be self hosted, but there's a wait list for their cloud service. Now another relational graph like database is surreal DB. It's written in Rust, and I have a full tutorial on my second channel, Beyond Fireship. It's designed to support asset transactions while scaling horizontally, but what I really like about it is how easy and flexible it makes data modeling. For the most part, it feels like SQL, but also uses arrows to connect nodes edges, like you would in Cypher with a graph database like Neo4j. It takes the best elements of relational, document, and graph databases, and combines them into one Easy to use API. Currently, it can only be self hosted, but they do have a cloud service coming soon. The multi model idea is nothing new though. Another database pushing the limits is Fauna. It was Created by ex Twitter engineers who set out to build the perfect database. It's extremely easy to use like a document database similar to MongoDB, but unlike a document database, it supports features like native Jib joins, which is the number one missing feature in document databases. And that means Spana is more well suited for complex relational data like social graphs. To interact with it, it has its own custom query language called FQL, but also comes with a GraphQL API. It is a closed source product, So you can't self host it, but its fully managed service has a nice free tier. Another new database you've likely never heard of is Memgraph. It's a drop in replacement for Neo4j, 4 j, which is the gold standard for graph databases, but Memgraph is focused on building real time data pipelines. Like Neo 4 j, it can be queried with Cypher, but it's written in c plus plus with a memory first architecture that claims to achieve better performance. Overall, it looks like it would be a great choice for building something Like a real time analytics platform. Next up, we'll look at KeyDB, which is a faster alternative to the already extremely fast Redis. It was recently acquired iSnap, a company that needs to fetch data as fast as humanly possible. It can handle over 1,000,000 operations per second on a single node, which sounds like a lot to me, but it's Not something you would use as your primary database, rather it's mostly used as an in memory cache to duplicate high priority data from another database, making it load Faster for the end user. It also has a library called modjs, allowing you to extend the database with your own custom commands and functionality With JavaScript, another specialty database to look into is Melee Search. The full text search engine space is dominated by tools like Elasticsearch and Algolia. Melee search is an open source rust based alternative that makes it easy to implement an awesome search feature into your app. It's not a primary database, but instead a place where you would duplicate data that needs to be in complex ways, like you can fine tune different parameters to control which attributes have a higher ranking in the search. In addition, it has a bunch of client like instant melee search that can quickly implement a search feature in a front end web application. And finally, that brings us to MindsDB, A database that integrates popular machine learning frameworks. It created a concept called AI tables that embed predictive models directly into the database. At first glance, it feels like SQL, except you can use it to write statements that train machine learning models. When the model's done training, you can then use Select to make predictions from it. So basically, it provides an integrated way to handle the MLOps life cycle, and it can also integrate with your existing machine learning models or those from third parties like Hugging Face or OpenAI. In the not so distant future, I believe embedding AI directly into databases will be a huge thing, and MindsDB gives you an idea of how that could look. And now, You have 15 different futuristic databases to choose from for your next failed side project. Good luck with that. If I missed anything, let me know in the comments. And if you wanna learn more about awesome serverless databases like Firestore and Supabase, support my work as a pro member on Fireship IO. Thanks for watching, and I will see you in the next one.
In this conversation, various speakers discuss new database options, including Planetach, Hope, and a serverless version of dataset transform. They highlight the benefits of these new options, including a full text search and schema editor, and discuss new serverless versions of dataset transform, including a serverless version called dataset transform and a drop in replacement for Neo defective database called queries. They also discuss various graph database and its potential for machine learning models to be used directly into databases, and mention a new serverless version of dataset transform called MindsDB that integrates popular machine learning frameworks and provides an integrated approach to the MLOps life cycle.