Consider the problem
minimize f(x) = ||Ax-bll²₂
where A is an m x n matrix with m≥ n, and b is a vector of length m. Assume that the rank of A is equal to n.
Write down the first-order necessary condition for optimality. Is this also a sufficient condition?
