pymllm.layers.layer_norm¶

Classes¶

LayerNorm layer implemented with FlashInfer kernel.

Module Contents¶

class pymllm.layers.layer_norm.LayerNorm(hidden_size, eps=1e-06)¶

Bases: pymllm.layers.base.MllmBaseLayer

LayerNorm layer implemented with FlashInfer kernel.

Parameters:

hidden_size (int)
eps (float)

hidden_size¶

eps = 1e-06¶

weight¶

bias¶

forward(x)¶

Parameters:: x (torch.Tensor)
Return type:: torch.Tensor