Op

Primitive operation kinds dispatched to the compute backends.

Enum constants

ADD

Elementwise addition, a + b.

SUB

Elementwise subtraction, a - b.

MUL

Elementwise multiplication, a * b.

DIV

Elementwise division, a / b.

MAX

Elementwise maximum, max(a, b).

MIN

Elementwise minimum, min(a, b).

NEG

Negation, -a.

EXP

Natural exponential, e^a.

LOG

Natural logarithm, ln a.

SQRT

Square root, sqrt(a).

RSQRT

Reciprocal square root, 1 / sqrt(a).

TANH

Hyperbolic tangent.

SIGMOID

Logistic sigmoid, 1 / (1 + e^-a).

RELU

Rectified linear unit, max(a, 0).

ABS

Absolute value, |a|.

SIGN

Sign, -1 / 0 / +1.