Have you taken a look at this ? https://github.com/HIPS/autograd and paper http://arxiv.org/pdf/1502.03492.pdf

They reverse the computation of the gradient to calculate the derivative wrt the hyper parameters.