ElementwiseLayer
ElementwiseLayer[f] represents a net layer that applies a unary function f to every element of the input array.
ElementwiseLayer["name"] applies the function specified by "name".
Examples
ElementwiseLayer["ReLU"]Please visit the official Wolfram Language Reference for more details.