Maximum-Likelihood (ML) Algorithm
The fundamental mathematical tool for parameter estimation is the maximum-likelihood (ML) algorithm. The amount of computation required to perform ML is usually the main reason to drive engineers away. However, it is worthwhile to review and understand the roots of all parameter estimation problem formulations.
Given an independent observation vector , for example, a microphone array output, the probability density distribution can be assumed jointly Gaussian,
The parameters, for example, the angle of arrival, , are hidden in the observation vectors, . Therefore, the maximum likelihood of the set of that produces
For uniform linear array,
where , , and
Our goal is to achieve the best estimates of in some optimal minimum mean square sense.
The maximization is achieved by minimization of the following,
and the minimum yields the optimal ,
where is the pseudoinverse of and is the Hermitian transpose of .
Let us replace the estimated A in the optimization objective function,
We can see that is the projection matrix of the noise space. Therefore, the above gives the residual power of the received signal vector projected into the noise subspace.