ResNet50 on multi-spectral image segmentation

Illustration
nathnagri - 2021-05-25T11:02:22+00:00
Question: ResNet50 on multi-spectral image segmentation

Is there a way to use any pretrain network (not necessarily Resnet) to segment multispectral images in MATLAB?     deeplabv3plusLayers only allows [height width 3] or [height width] input images. While I tried bypassing the error deeplabv3plusLayers returns, when I used trainNetwork I get an error referring to the wrong input data 224x224xN.   Can the first convolutional layer of the pretrained network be replaced to process more than 3 channels?

Related Questions

  • How to Plot data in excel sheet using MATLAB ?
  • How can I use LSTM networks to solve a time series regression problem?
  • How to create an attention layer for deep learning networks?
  • Nvidia NVLink in MATALB using multiple Geforce 2080 ti cards
  • How do I build TensorFlow Lite for Deep Learning C++ code generation and deployment?

    • Expert Answer

    Profile picture of Prashant Kumar Prashant Kumar answered . 2025-11-20

    You can copy the layerGraph of the pretrained network and change the imageInputLayer, the first convolutionLayer to match the input image channel dimension & convolution filter dimensions. Then you can freeze/unfreeze the existing pretrained weights during training the new network accordingly.
     
    You can do something like below:(N=50)
     
    imageSize = [224 224 3];

% Specify the number of classes.
numClasses = 10;

N = 50;
% Create DeepLab v3+.
lgraph = deeplabv3plusLayers(imageSize, numClasses, "resnet50");
analyzeNetwork(lgraph)
layers = lgraph.Layers

%%
newlgraph = replaceLayer(lgraph,'input_1',imageInputLayer([224 224 N],'Name','input'));
newlgraph = replaceLayer(newlgraph,'conv1',convolution2dLayer(7,64,'stride',[2 2],'padding',[3 3 3 3],'Name','conv1'))
analyzeNetwork(newlgraph)

     


    Not satisfied with the answer ?? ASK NOW

    Get a Free Consultation or a Sample Assignment Review!

    Upload Assignment Talk to Expert