Mnemonist
LRU Cache
The LRUCache
, LRU
standing for least recently used, can be seen as a a fixed-capacity key-value store that will evict infrequent items when full and setting new keys.
For instance, if one creates a LRUCache
with a capacity of 1000
and one inserts a thousand-and-first key, the cache will forget its least recently used key-value pair in order not to overflow the allocated memory.
This structure is very useful to cache the result of costly operations when one cannot afford to keep every result in memory and only want to keep the most frequent ones.
For more information, you can check this Wikipedia page.
This implementation has been designed to work with a javascript raw object. You can alternatively find an implementation relying on ES6’s Map
object here. Depending on the precise use case (string keys, integer keys etc.), one or the other might be faster depending on js engine magic.
var LRUCache = require('mnemonist/lru-cache');
// If you need deletions
var LRUCacheWithDelete = require('mnemonist/lru-cache-with-delete');
Constructor
The LRUCache
takes a single argument: the desired capacity.
var cache = new LRUCache(1000);
Optionally, you can type the used keys & values in order to be more memory-efficient:
// First argument will be instantiated for keys, second one for values
var cache = new LRUCache(Uint32Array, Float32Array, 1000);
Static #.from
Alternatively, one can build a LRUCache
from an arbitrary JavaScript iterable likewise:
// Attempting the guess the given iterable's length/size
var cache = LRUCache.from({one: 1, two: 2});
// Providing the desired capacity
var cache = LRUCache.from({one: 1, two: 2}, 10);
// Typing the cache
var cache = LRUCache.from({one: 1, two: 2}, Array, Uint8Array, 10);
Members
Methods
Mutation
Read
Iteration
#.capacity
Maximum number of items the cache is able to store.
var cache = new LRUCache(10);
cache.capacity
>>> 10
#.size
Number of items actually in the cache.
var cache = new LRUCache(10);
cache.size
>>> 0
cache.set('one', 1);
cache.size
>>> 1
#.set
Sets a value for the given key in the cache. If the cache is already full, the least recently used key will be dropped from the cache.
O(1)
var cache = new LRUCache(10);
cache.set('one', 1);
cache.has('one');
>>> true
#.setpop
Sets a value for the given key in the cache. If the cache is already full, the least recently used key will be dropped from the cache, and an object containing the dropped key, dropped value and evicted = true
will be returned. If the key already exists, an object containing the key, previous value and evicted = false
will be returned. If no eviction or overwrite occurs, null
is returned.
O(1)
var cache = new LRUCache(1);
cache.setpop('one', 1);
>>> null
cache.setpop('one', 10);
>>> {key: 'one', value: 1, evicted: false}
cache.setpop('two', 2);
>>> {key: 'one', value: 10, evicted: true}
#.delete
Deletes the given key and returns whether its was actually in the cache before deletion.
Beware, for performance reasons this method is only available on LRUCacheWithDelete
.
O(1)
var cache = new LRUCacheWithDelete(1);
cache.set('one', 1)
cache.delete('one');
>>> true
cache.delete('one');
>>> false
#.remove
Deletes the given key and returns the associated value if the key was actually in the cache or a default value if it was not.
Beware, for performance reasons this method is only available on LRUCacheWithDelete
.
O(1)
var cache = new LRUCacheWithDelete(1);
cache.set('one', 1)
cache.remove('one');
>>> 1
cache.remove('one');
>>> undefined
cache.remove('one', 'not-found');
>>> 'not-found'
#.clear
Completely clears the cache.
O(1)
var cache = new LRUCache(10);
cache.set('one', 1);
cache.clear();
cache.has('one');
>>> false
cache.size
>>> 0
#.get
Retrieves the value associated to the given key in the cache or undefined
if the key is not found.
If the key is found, the key is moved to the front of the underlying list to be the most recently used item.
O(1)
var cache = new LRUCache(10);
cache.set('one', 1);
cache.get('one');
>>> 1
#.peek
Retrieves the value associated to the given key in the cache or undefined
if the key is not found.
Unlike #.get
, it does not modify the underlying list.
O(1)
var cache = new LRUCache(10);
cache.set('one', 1);
cache.peek('one');
>>> 1
#.has
Retrieves whether the given key exists in the cache.
O(1)
var cache = new LRUCache(10);
cache.set('one', 1);
cache.has('one');
>>> true
cache.has('two');
>>> false
#.forEach
Iterates over the cache from the most to the least recently used key-value pair.
var cache = new LRUCache(10);
cache.set('one', 1);
cache.set('two', 2);
cache.forEach(function(value, key, cache) {
console.log(key, value);
});
#.keys
Returns an iterator over the cache’s keys from the most to the least recently used key.
var cache = new LRUCache(10);
cache.set('one', 1);
cache.set('two', 2);
var iterator = cache.keys();
iterator.next().value
>>> 'two'
#.values
Returns an iterator over the cache’s values from the most to the least recently used value.
var cache = new LRUCache(10);
cache.set('one', 1);
cache.set('two', 2);
var iterator = cache.values();
iterator.next().value
>>> 2
#.entries
Returns an iterator over the cache’s entries from the most to the least recently used entry.
var cache = new LRUCache(10);
cache.set('one', 1);
cache.set('two', 2);
var iterator = cache.entries();
iterator.next().value
>>> ['two', 2]
Iterable
Alternatively, you can iterate over a cache’s entries using ES2015 for...of
protocol:
var cache = new LRUCache(10);
cache.set('one', 1);
cache.set('two', 2);
for (var [key, value] of cache) {
console.log(key, value);
}