Modifying a MeshStandardMaterial trying to add Image Based Lighting (IBL).
More details...
The idea was to modify the lighting equation to add a diffuse and specular term extracted from the equirectangular panorama fetched from Google Street View. It's still too complicated to modify the shader at that level.
Credits
Based on Matt DesLauriers's Custom mesh standard material.
Textures by Käy Vriend
Inspired by this image.
Coded using WebGL with three.js, the Google Maps API, PanomNom.js and EquirectangularToCubemap.