Class Mish

java.lang.Object

smile.deep.activation.ActivationFunction

smile.deep.activation.Mish

All Implemented Interfaces:

Serializable, Function<Tensor,Tensor>, Layer

public class Mish
extends ActivationFunction

Mish activation function.

Mish is a self-regularized non-monotonic activation function:

  mish(x) = x * tanh(softplus(x))
          = x * tanh(ln(1 + exp(x)))

Mish is used in many modern object detection models such as YOLOv4/v5.

See Also:

• Mish: A Self Regularized Non-Monotonic Activation Function
• Serialized Form

Constructor Summary

Constructors

Constructor	Description
Mish()	Constructor.
Mish(boolean inplace)	Constructor.

Method Summary

Modifier and Type	Method	Description
Tensor	forward(Tensor input)	Forward propagation (or forward pass) through the layer.

Methods inherited from class ActivationFunction

asTorch, isInplace, name

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface Function

andThen, compose

Methods inherited from interface Layer

apply, to, to

Constructor Details

Mish

public Mish()

Constructor.

Mish

public Mish(boolean inplace)

Constructor.

Parameters:

inplace - true if the operation executes in-place.

Method Details

forward

public Tensor forward(Tensor input)

Description copied from interface: Layer

Forward propagation (or forward pass) through the layer.

Parameters:

input - the input tensor.

Returns:

the output tensor.