tensorplay.nn.functional.glu

tensorplay.nn.functional.glu(input, dim=-1) → Tensor[source]

Gated Linear Unit: $a * \sigma(b)$ where the input is split in half along dim.