Asymptotic Analysis for Markovian models in non-equilibrium Statistical Mechanics