Bucket Sort

Bucket sort runs in linear time on the average. It assumes that the input is generated by a random process that distributes elements uniformly over the interval [0, 1).
The idea of Bucket sort is to divide the interval [0, 1) into n equal-sized subintervals, or buckets, and then distribute the n input numbers into the buckets. Since the inputs are uniformly distributed over (0, 1), we don't expect many numbers to fall into each bucket. To produce the output, simply sort the numbers in each bucket and then go through the bucket in order, listing the elements in each.
The code assumes that input is in n-element array A and each element in A satisfies 0 ≤ A[i] ≤ 1. We also need an auxiliary array B[0 . . n -1] for linked-lists (buckets).

BUCKET_SORT (A)

1. n ← length [A]
2. For i = 1 to n do
3.     Insert A[i] into list B[nA[i]]
4. For i = 0 to n-1 do
5.     Sort list B with Insertion sort
6. Concatenate the lists B[0], B[1], . . B[n-1] together in order.

 

Example

Given input array A[1..10]. The array B[0..9] of sorted lists or buckets after line 5. Bucket i holds values in the interval [i/10, (i +1)/10]. The sorted output consists of a concatenation in order of the lists first B[0] then B[1] then B[2] ... and the last one is B[9].

 

Analysis

All lines except line 5 take O(n) time in the worst case. We can see inspection that total time to examine all buckets in line 5 is O(n-1) i.e., O(n).
The only interesting part of the analysis is the time taken by Insertion sort in line 5. Let n_i be the random variable denoting the number of elements in the bucket B[i]. Since the expected time to sort by INSERTION_SORT is O(n²), the expected time to sort the elements in bucket B[i] is

E[O(²n_i)] = O(E[²n_i]]

Therefore, the total expected time to sort all elements in all buckets is

        ^n-1∑_i=0 O(E[²n_i]) = O ^n-1∑_i=0 (E[²n_i])         ------------ A

In order to evaluate this summation, we must determine the distribution of each random variable n

We have n elements and n buckets. The probability that a given element falls in a bucket B[i] is 1/n i.e., Probability = p = 1/n. (Note that this problem is the same as that of "Balls-and-Bin" problem).

Therefore, the probability follows the binomial distribution, which has
    mean:       E[n_i] = np = 1
    variance:  Var[n_i] = np(1- p) = 1- 1/n
For any random variable, we have

E[²n_i] = Var[n_i] +  E²[n_i]
          = 1 - 1/n + 1²
          = 2 - 1/n
          = (1)

Putting this value in equation A above, (do some tweaking) and we have a expected time for INSERTION_SORT, O(n).

Now back to our original problem

In the above Bucket sort algorithm, we observe

T(n) = [time to insert n elements in array A] + [time to go through auxiliary array B[0 . . n-1] * (Sort by INSERTION_SORT)
       = O(n) + (n-1) (n)
       = O(n)

Therefore, the entire Bucket sort algorithm runs in linear expected time.