Exponential search

Exponential search allows for searching through a sorted, unbounded list for a specified input value (the search "key"). The algorithm consists of two stages. The first stage determines a range in which the search key would reside if it were in the list. In the second stage, a binary search is performed on this range. In the first stage, assuming that the list is sorted in ascending order, the algorithm looks for the first exponent, j, where the value 2^j is greater than the search key. This value, 2^j becomes the upper bound for the binary search with the previous power of 2, 2^{j - 1}, being the lower bound for the binary search.[3]

// Returns the position of key in the array arr of length size.
template <typename T>
int exponential_search(T arr[], int size, T key)
{
    if (size == 0) {
        return NOT_FOUND;
    }

    int bound = 1;
    while (bound < size && arr[bound] < key) {
        bound *= 2;
    }

    return binary_search(arr, key, bound/2, min(bound + 1, size));
}

In each step, the algorithm compares the search key value with the key value at the current search index. If the element at the current index is smaller than the search key, the algorithm repeats, skipping to the next search index by doubling it, calculating the next power of 2.[3] If the element at the current index is larger than the search key, the algorithm now knows that the search key, if it is contained in the list at all, is located in the interval formed by the previous search index, 2^{j - 1}, and the current search index, 2^j. The binary search is then performed with the result of either a failure, if the search key is not in the list, or the position of the search key in the list.

The first stage of the algorithm takes O(log i) time, where i is the index where the search key would be in the list. This is because, in determining the upper bound for the binary search, the while loop is executed exactly ${\displaystyle \lceil \log(i)\rceil }$ times. Since the list is sorted, after doubling the search index ${\displaystyle \lceil \log(i)\rceil }$ times, the algorithm will be at a search index that is greater than or equal to i as ${\displaystyle 2^{\lceil \log(i)\rceil }\geq i}$. As such, the first stage of the algorithm takes O(log i) time.

The second part of the algorithm also takes O(log i) time. As the second stage is simply a binary search, it takes O(log n) where n is the size of the interval being searched. The size of this interval would be 2^j - 2^{j - 1} where, as seen above, j = log i. This means that the size of the interval being searched is 2^{log i} - 2^{log i - 1} = 2^{log i - 1}. This gives us a run time of log (2^{log i - 1}) = log (i) - 1 = O(log i).

This gives the algorithm a total runtime, calculated by summing the runtimes of the two stages, of O(log i) + O(log i) = 2 O(log i) = O(log i).

Bentley and Yao suggested several variations for exponential search.[2] These variations consist of performing a binary search, as opposed to a unary search, when determining the upper bound for the binary search in the second stage of the algorithm. This splits the first stage of the algorithm into two parts, making the algorithm a three-stage algorithm overall. The new first stage determines a value ${\displaystyle j'}$, much like before, such that ${\displaystyle 2^{j'}}$ is larger than the search key and ${\displaystyle 2^{j'/2}}$ is lower than the search key. Previously, ${\displaystyle j'}$ was determined in a unary fashion by calculating the next power of 2 (i.e., adding 1 to j). In the variation, it is proposed that ${\displaystyle j'}$ is doubled instead (e.g., jumping from 2² to 2⁴ as opposed to 2³). The first ${\displaystyle j'}$ such that ${\displaystyle 2^{j'}}$ is greater than the search key forms a much rougher upper bound than before. Once this ${\displaystyle j'}$ is found, the algorithm moves to its second stage and a binary search is performed on the interval formed by ${\displaystyle j'/2}$ and ${\displaystyle j'}$, giving the more accurate upper bound exponent j. From here, the third stage of the algorithm performs the binary search on the interval 2^{j - 1} and 2^j, as before. The performance of this variation is ${\displaystyle \lfloor \log i\rfloor +2\lfloor \log(\lfloor \log i\rfloor +1)\rfloor +1}$ = O(log i).

Bentley and Yao generalize this variation into one where any number, k, of binary searches are performed during the first stage of the algorithm, giving the k-nested binary search variation. The asymptotic runtime does not change for the variations, running in O(log i) time, as with the original exponential search algorithm.

Also, a data structure with a tight version of the dynamic finger property can be given when the above result of the k-nested binary search is used on a sorted array.[4] Using this, the number of comparisons done during a search is log (d) + log log (d) + ... + O(log ^*d), where d is the difference in rank between the last element that was accessed and the current element being accessed.

An algorithm based on exponentially increasing the search band solves global pairwise alignment for O(ns), where n is the length of the sequences and s is the edit distance between them.[5][6]

• Linear search
• Binary search
• Interpolation search
• Ternary search
• Hash table