Low to High Dimensional Modality Reconstruction Using Aggregated Fields of View