Robust Multispectral Semantic Segmentation under Missing or Full Modalities via Structured Latent Projection