Iacono's working set structure

An example of a search for ${\displaystyle x}$ in the working set structure. After finding ${\displaystyle x}$, it is removed from ${\displaystyle T_{4}}$ and inserted into ${\displaystyle T_{1}}$. Finally, a shift from 1 to 4 is performed in which an element is removed from ${\displaystyle T_{i}}$ and inserted into ${\displaystyle T_{i+1}}$ for ${\displaystyle 1\leq i<4}$.

To store a dynamic set of ${\displaystyle n}$ elements, this structure consists of a series of Red–black trees, or other Self-balancing binary search trees ${\displaystyle T_{1},T_{2},\ldots ,T_{k}}$, and a series of deques (Double-ended queues) ${\displaystyle Q_{1},Q_{2},\ldots Q_{k}}$, where ${\displaystyle k=\lceil \log \log n\rceil }$. For every ${\displaystyle 1\leq i\leq k}$, tree ${\displaystyle T_{i}}$ and deque ${\displaystyle Q_{i}}$ share the same contents and pointers are maintained between their corresponding elements. For every ${\displaystyle i<k}$, the size of ${\displaystyle T_{i}}$ and ${\displaystyle Q_{i}}$ is ${\displaystyle 2^{2^{i}}}$. Tree ${\displaystyle T_{k}}$ and deque ${\displaystyle Q_{k}}$ consist of the remaining elements, i.e., their size is ${\displaystyle n-\sum _{i=1}^{k-1}2^{2^{i}}}$. Therefore, the number of items in all trees and the number of elements in all deques both add up to ${\displaystyle n}$. Every element that has been inserted in the data structure is stored in exactly one of the trees and its corresponding deque.

In the deques of this structure, elements are kept in sorted order according to their working set size. Formally, element ${\displaystyle x}$ lies after ${\displaystyle y}$ in deque ${\displaystyle Q_{i}}$ if and only if ${\displaystyle w(x)<w(y)}$. Moreover, for every ${\displaystyle 1\leq i<k}$, the elements in deque ${\displaystyle Q_{i}}$ have a smaller working sets than the elements in deque ${\displaystyle Q_{i+1}}$. This property is referred to as the Working set invariant. Every operation in the data structure maintains the Working set invariant.

The basic operation in this structure is called shift from ${\displaystyle h}$ to ${\displaystyle j}$, where ${\displaystyle h}$ and ${\displaystyle j}$ are indices of some trees in the structure. Two cases are considered in a shift from ${\displaystyle h}$ to ${\displaystyle j}$: If ${\displaystyle h<j}$, then for every ${\displaystyle h\leq i<j}$, taken in increasing order, an item is dequeued from ${\displaystyle Q_{i}}$ and enqueued into ${\displaystyle Q_{i+1}}$. The corresponding item is deleted from ${\displaystyle T_{i}}$ and inserted into ${\displaystyle T_{i+1}}$. The running time of this operation is ${\displaystyle O(\sum _{i=h}^{j}\log |T_{i}|)=O(\sum _{i=h}^{j}\log 2^{2^{i}})=O(2^{j})}$. Analogously, if ${\displaystyle j<h}$, then for every ${\displaystyle j<i\leq h}$, taken in decreasing order, an item is dequeued from ${\displaystyle Q_{i}}$ and enqueued into ${\displaystyle Q_{i-1}}$. The corresponding item is deleted from ${\displaystyle T_{i}}$ and inserted into ${\displaystyle T_{i-1}}$. The running time of this operation is ${\displaystyle O(\sum _{i=j}^{h}\log |T_{i}|)=O(\sum _{i=j}^{h}\log 2^{2^{i}})=O(2^{h})}$. Regardless of the case, after a shift operation, the size of ${\displaystyle T_{h}}$ decreases by one whereas the size of ${\displaystyle T_{j}}$ increases by one. Since that elements in the deques are sorted with respect to their working sets sizes, a shift operation maintains the Working set invariant.

Splay trees are self adjusting search trees introduced by Sleator and Tarjan[2] in 1985. Using restructuring heuristic, splay trees are able to achieve insert and delete operations in ${\displaystyle O(\log n)}$ amortized time, without storing any balance information at the nodes. Moreover, the Working Set Theorem for splay trees states that the cost to access an element in a splay tree is ${\displaystyle O(\log w(x))}$ amortized. Iacono's workings set structure obtains the same running time for search, insert and delete in the worst-case. Therefore, offering an alternative to splay trees.