Optical tuning of the diamond Fermi level measured by correlated scanning probe microscopy and quantum defect spectroscopy