Comment 32 for bug 106217

Try:
sudo update-initramfs -u

To copy the new driver into the initrd. That might be where its getting loaded from.

If this helps, and the new driver was installed via an official Ubuntu package, please note back here, as that update hook probably ought to be run after being installed. I'm not familiar with the nvidia package specifically.