Predicting Immune Responses On Multi-Modal Single-Cell Data With Variational Inference