Improving Remote Sensing-Based Semantic Segmentation By Adapting Pre-Trained Vision Transformers For Multispectral Data