Leveraging Information Theoretic ToolsFor Foundation Model Analysis