Isn't The code"result = x + self.conv2(self.dwconv(self.conv1(x)))" in module class IRFFN(nn.Module) of cmt_module.py "result = self.conv2(self.dwconv(self.conv1(x))+self.conv1(x))" according to the paper "CMT: Convolutional Neural Networks Meet Vision Transformers"?
I set up a random seed to run the network you wrote, but the training results of the two runs are different. Is there any randomness in your weight initialization