Professor Andy Pavlo and his students at Carnegie Mellon are working to make sure database management systems (DBMSs) can take advantage of new and evolutionary hardware. PhD candidate Joy Arulraj will present the paper “Write-Behind Logging”: how to change a DBMS’s logging and recovery algorithms to use emerging non-volatile memory (NVM). Their new protocol enables the DBMS to recover nearly instantaneously from system failures and reduces the wear-down on NVM devices. This work is in collaboration with Intel Labs and is part of CMU’s extensive work on non-volatile memory databases. Read their blog post about Write-Behind Logging here.
Intel’s Stavros Papadopoulos and colleagues present “The TileDB Array Data Storage Manager,” a novel storage system that captures cases where the data are naturally modeled as multi-dimensional arrays, which typically arise in scientific applications. TileDB has been used in genomics as the storage layer of GenomicsDB, which is maintained by the Intel Health and Life Sciences group and is used in the Broad Institute‘s GATK 4.0 software. Both TileDB and GenomicsDB are available in open source. Read more about TileDB in this blog post.
Analytics require visual data exploration tools that can quickly gather and display insights from datasets at “human speed.” Techniques such as Approximate Query Processing (AQP) are increasingly important in meeting the interactivity guarantees promised by these tools—but even these techniques are straining as datasets get ever larger and more complex. Researchers in Brown University’s Data Management Research Group will present “Revisiting Reuse for Approximate Query Processing” by Alex Galakatos, Andrew Crotty, Emanuel Zgraggen, Carsten Binnig and ISTC PI Tim Kraska. They’ve developed a formulation for Approximate Query Processing that maximizes result reuse in order to improve interactivity for visual data exploration tasks. Their AQP formulation can provide low-error approximate results at interactive speeds, even for queries over rare subpopulations.
“The End of a Myth: Distributed Transactions Can Scale” by Erfan Zamanian, Carsten Binnig, Tim Kraska, Tim Harris. Read the blog post.
This entry was posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog, Visualizing Big Data and tagged Analytics, Array DBMS, Big Data, Compute Architecture, Data Management, DBMS, Genomics, in-memory databases, Intel, Intel Labs, NVM, Open Source, TileDB, Visualization. Bookmark the permalink.