Write-limited sorts and joins for persistent memory Viglas, VLDB 2014 This is the second of the two research-for-practice papers for this week. Once more the topic is how database storage algorithms can be optimised for NVM, this time examining the asymmetry between reads and writes on NVM. This is premised on Viglas’ assertion that: Writes … Continue reading Write-limited sorts and joins for persistent memory
Tag: Storage
File systems, object stores, and other low-level storage concerns.
Let’s talk about storage and recovery methods for non-volatile memory database systems
Let's talk about storage and recovery methods for non-volatile memory database systems Arulraj et al., SIGMOD 2015 Update: fixed a bunch of broken links. I can't believe I only just found out about this paper! It's exactly what I've been looking for in terms of an analysis of the impacts of NVM on data storage … Continue reading Let’s talk about storage and recovery methods for non-volatile memory database systems
Ambry: LinkedIn’s scalable geo-distributed object store
Ambry: LinkedIn’s scalable geo-distributed object store Noghabi et al. SIGMOD ’16 Ambry is LinkedIn’s blob store, designed to handle the demands of a modern social network: Hundreds of millions of users continually upload and view billions of diverse massive media objects, from photos and videos to documents. These large media objects, called blobs, are uploaded … Continue reading Ambry: LinkedIn’s scalable geo-distributed object store
Goods: organizing Google’s datasets
Goods: organizing Google’s datasets Havely et al. SIGMOD 2016 You can (try and) build a data cathedral. Or you can build a data bazaar. By data cathedral I’m referring to a centralised Enterprise Data Management solution that everyone in the company buys into and pays homage to, making a pilgrimage to the EDM every time … Continue reading Goods: organizing Google’s datasets
A DNA-based archival storage system
A DNA-Based Archival Storage System - Bornholt et al. ASPLOS '16 It's pretty cool that a paper on DNA-based storage makes a conference such as ASPLOS. And as you'll see, there are good reasons we should be taking it very seriously indeed. DNA has some very interesting properties - it's extremely dense (1 exabyte (109 … Continue reading A DNA-based archival storage system
NOVA: A Log-Structured File System for Hybrid Volatile/Non-Volatile Main Memories
NOVA: A Log-structured file system for hybrid volatile/non-volatile main memories - Xu & Swanson 2016 Another paper looking at the design implications of mixed DRAM and NVMM systems (it's the future!), this time in the context of file systems. (NVMM = Non-volatile Main Memory). Hybrid DRAM/NVMM storage systems present a host of opportunities and challenges … Continue reading NOVA: A Log-Structured File System for Hybrid Volatile/Non-Volatile Main Memories
Uncovering bugs in Distributed Storage Systems during Testing (not in production!)
Uncovering bugs in Distributed Storage Systems during Testing (not in production!) - Deligiannis et al. 2016 We interviewed technical leaders and senior managers in Microsoft Azure regarding the top problems in distributed system development. The consensus was that one of the most critical problems today is how to improve testing coverage so that bugs can … Continue reading Uncovering bugs in Distributed Storage Systems during Testing (not in production!)
Data Tiering in Heterogeneous Memory Systems
Data Tiering in Heterogeneous Memory Systems - Dulloor et al. 2016 Another fantastic EuroSys 2016 paper for today, and one with results that are of great importance in understanding the cost and performance implications of the new generation of non-volatile memory (NVM) heading to our data centers soon. Furthermore, we also get some great insight … Continue reading Data Tiering in Heterogeneous Memory Systems
Using Crash Hoare Logic for Certifying the FSCQ File System
Using Crash Hoare Logic for Certifying the FSCQ File System - Chen et. al 2015 If you found yesterday's look at POSIX file system semantics and the crash recovery of applications built on top a little sobering, then today's paper offers a glimpse of a light at the end of the tunnel. Chen et al. … Continue reading Using Crash Hoare Logic for Certifying the FSCQ File System
All File Systems are Not Created Equal: On the Complexity of Crafting Crash Consistent Applications
All File Systems are Not Created Equal: On the Complexity of Crafting Crash Consistent Applications - Pillai et al. 2014 Last week we looked at Reducing Crash Recoverability to Reachability for file system-based applications. Today's choice predates that work and investigates the semantics of real world file systems and how this affects applications that run … Continue reading All File Systems are Not Created Equal: On the Complexity of Crafting Crash Consistent Applications
the morning paper 