20.神经网络-非线性激活

发布时间:2026/10/5 13:27:10
20.神经网络-非线性激活 非线性激活功能ReLU介绍inplace参数是否在原来的位置替换。一般情况下inplace是False.sigmoid介绍# -*- coding: utf-8 -*-# 作者小土堆# 公众号土堆碎念importtorchimporttorchvisionfromtorchimportnnfromtorch.nnimportReLU,Sigmoidfromtorch.utils.dataimportDataLoaderfromtorch.utils.tensorboardimportSummaryWriter datasettorchvision.datasets.CIFAR10(../data,trainFalse,downloadTrue,transformtorchvision.transforms.ToTensor())dataloaderDataLoader(dataset,batch_size64)classTudui(nn.Module):def__init__(self):super(Tudui,self).__init__()self.sigmoid1Sigmoid()defforward(self,input):outputself.sigmoid1(input)returnoutput tuduiTudui()writerSummaryWriter(../logs_relu)step0fordataindataloader:imgs,targetsdata writer.add_images(input,imgs,global_stepstep)outputtudui(imgs)writer.add_images(output,output,step)step1writer.close()总结