A Latent Space Analysis of the Sketch-to-Model Problem