TDNN代码

核心思想是将语音的提取特征的帧进行前后联系,展开

举例:
1,2,3,4,5

123,234,345

进行了扩展,使得网络看到的特征范围更广

import torch.nn as nn
import torch.nn.function as F

class TDNN(nn.Moudle):

    def __init__(
                    self,
                    input_dim,
                    output_dim,
                    context_size,
                    stride,
                    dilation,
                    batch_norm,
                    dropout            
                ):
        super(TDNN, self).__init__()
        self.input_dim = input_dim
        self.output_dim = output_dim
        self.context_size = context_size
        self.stride = stride
        self.dilation = dilation
        self.batch_norm = batch_norm
        self.dropout = dropout

        self.kernel = nn.Linear(input_dim * context_size, output_dim)
        self.nonlinearity = nn.ReLU()
        if self.batch_norm:
            self.bn = nn.BatchNorm1d(output_dim)
        if self.dropout_p:
            self.dropout = nn.Dropout(p = self.dropout)
    
    def forward(self, x):
        _, _, d = x.shape
        x = x.unsqueeze(1)

        # 将前后几帧都联系起来,已当前帧为中心,扩展到周围
        x = F.unfold(
                    x,
                    (self.context_size, self.input_dim),
                    stride = (1, self.input_dim),
                    dilation = (self.dilation, 1)
                    ) 

        x = x.tranpose(1, 2)
        x = self.kernel(x.float())
        x = self.nonlinearity(x)

        if self.dropout_p:
            x = self.dropout(x)
        
        if self.batch_norm:
            x = x.transpose(1, 2)
            x = self.bn(x)
            x = x.transpose(1, 2)
        
        return x

关于unfold函数的理解

http://t.csdnimg.cn/HAe40

http://t.csdnimg.cn/2wuke

关于transpose函数的理解

http://t.csdnimg.cn/C8Xd6

Logo

魔乐社区(Modelers.cn) 是一个中立、公益的人工智能社区,提供人工智能工具、模型、数据的托管、展示与应用协同服务,为人工智能开发及爱好者搭建开放的学习交流平台。社区通过理事会方式运作,由全产业链共同建设、共同运营、共同享有,推动国产AI生态繁荣发展。

更多推荐