Package smile.deep.activation

Class GELU

java.lang.Object

smile.deep.activation.ActivationFunction

smile.deep.activation.GELU

All Implemented Interfaces:

Serializable, Function<Tensor,Tensor>, Layer

public class GELU
extends ActivationFunction

Gaussian Error Linear Unit activation function.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
GELU(boolean inplace)	Constructor.

Method Summary

Modifier and Type	Method	Description
Tensor	forward(Tensor input)	Forward propagation (or forward pass) through the layer.

Methods inherited from class smile.deep.activation.ActivationFunction

asTorch, isInplace, name

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.function.Function

andThen, compose

Methods inherited from interface smile.deep.layer.Layer

apply, isTraining

Constructor Details

GELU

public GELU(boolean inplace)

Constructor.

Parameters:

inplace - true if the operation executes in-place.

Method Details

forward

public Tensor forward(Tensor input)

Description copied from interface: Layer

Forward propagation (or forward pass) through the layer.

Parameters:

input - the input tensor.

Returns:

the output tensor.