Optimizing Distributed Actor Systems for Dynamic Interactive Services

April 29, 2016 ~ Adrian Colyer ~ 1 Comment

Optimizing Distributed Actor Systems for Dynamic Interactive Services - Newell et al. 2016 I'm sure many of you have heard of the Orleans distributed actor system, that was used to build some of the systems supporting Microsoft's online Halo game. Halo Presence is an interactive application which implements presence services for a multi-player game running ... Continue Reading

Data Tiering in Heterogeneous Memory Systems

April 28, 2016 ~ Adrian Colyer ~ 2 Comments

Data Tiering in Heterogeneous Memory Systems - Dulloor et al. 2016 Another fantastic EuroSys 2016 paper for today, and one with results that are of great importance in understanding the cost and performance implications of the new generation of non-volatile memory (NVM) heading to our data centers soon. Furthermore, we also get some great insight ... Continue Reading

GeePS: Scalable deep learning on distributed GPUs with a GPU-specialized parameter server

April 27, 2016 ~ Adrian Colyer ~ 2 Comments

GeePS: Scalable deep learning on distributed GPUs with a GPU-specialized parameter server - Cui et al. 2016 (EuroSys 2016) We know that deep learning is well suited to GPUs since it has inherent parallelism. But so far this has mostly been limited to either a single GPU (e.g. using Caffe) or to specially built distributed ... Continue Reading

The Linux Scheduler: a Decade of Wasted Cores

April 26, 2016 ~ Adrian Colyer ~ 30 Comments

The Linux Scheduler: a Decade of Wasted Cores - Lozi et al. 2016 This is the first in a series of papers from EuroSys 2016. There are three strands here: first of all, there's some great background into how scheduling works in the Linux kernel; secondly, there's a story about Software Aging and how changing ... Continue Reading

Delta State Replicated Data Types

April 25, 2016 ~ Adrian Colyer ~ Leave a comment

Delta State Replicated Data Types - Almeida et al. 2016 You know when you want to use CRDTs for their convergence properties, but the amount of state you're required to pass around gets out of hand? In this paper, Almeida et al. show how to retain the advantages of state-based CRDTs, but with much smaller ... Continue Reading

GloVe: Global Vectors for Word Representation

April 22, 2016 ~ Adrian Colyer ~ 16 Comments

GloVe: Global Vectors for Word Representation - Pennington et al. 2014 Yesterday we looked at some of the amazing properties of word vectors with word2vec. Pennington et al. argue that the online scanning approach used by word2vec is suboptimal since it doesn't fully exploit statistical information regarding word co-occurrences. They demonstrate a Global Vectors (GloVe) ... Continue Reading

The amazing power of word vectors

April 21, 2016 ~ Adrian Colyer ~ 177 Comments

For today's post, I've drawn material not just from one paper, but from five! The subject matter is 'word2vec' - the work of Mikolov et al. at Google on efficient vector representations of words (and what you can do with them). The papers are: Efficient Estimation of Word Representations in Vector Space - Mikolov et ... Continue Reading

ImageNet Classification with Deep Convolutional Neural Networks

April 20, 2016 ~ Adrian Colyer ~ 8 Comments

ImageNet Classification with Deep Convolutional Neural Networks - Krizhevsky et al. 2012 Like the large-vocabulary speech recognition paper we looked at yesterday, today's paper has also been described as a landmark paper in the history of deep learning. It's also a surprisingly easy read! The ImageNet dataset contains over 15 million labeled high-resolution images of ... Continue Reading

Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition

April 19, 2016 ~ Adrian Colyer ~ 6 Comments

Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition - Dahl et al. 2011 The title may be a bit of a mouthful, but this paper is often cited as a watershed moment for deep learning and speech recognition. It represents the first application of deep neural networks for large vocabulary speech recognition (LVSR), and ... Continue Reading

Deep Learning in Neural Networks: An Overview

April 18, 2016 ~ Adrian Colyer ~ 10 Comments

Deep Learning in Neural Networks: An Overview - Schmidhuber 2014 What a wonderful treasure trove this paper is! Schmidhuber provides all the background you need to gain an overview of deep learning (as of 2014) and how we got there through the preceding decades. Starting from recent DL results, I tried to trace back the ... Continue Reading

the morning paper

a random walk through Computer Science research, by Adrian Colyer
Made delightfully fast by strattic

Month: April 2016