Small correction: CUDA was first released in 2007 and of course Nvidia was also aiming at HPC before the AlexNet moment.