Aspects of non-locality in gravity