Tutte le sfide
Facile 0 risolte 0% di accettazione

Activation Functions

Apply sigmoid, ReLU, Leaky ReLU or tanh to every value in a list.

Cosa imparerai

  • Implement common activation functions
  • Understand why networks need non-linearity
  • Avoid overflow in the sigmoid

Problema

Mostra traduzione

After a neuron adds up its weighted inputs, an activation function decides its output. Without one, a neural network could only learn straight lines.

Implement activate(name, values) and apply the named function to every value:

nameformula
"sigmoid"1 / (1 + e^(-x))
"relu"max(0, x)
"leaky_relu"x if x > 0, otherwise 0.01 × x
"tanh"(e^x - e^(-x)) / (e^x + e^(-x))

Input

name: One of "sigmoid", "relu", "leaky_relu" or "tanh".

values: A list of numbers.

Output

Return a list with the activation applied to each value, in the same order.

Vincoli

1 ≤ length of values ≤ 1,000

-50 ≤ each value ≤ 50

Esempi

Esempio 1
Input:
name = "sigmoid"
values = [0.0, 2.0, -2.0]

Output atteso:
expected = [0.5, 0.880797, 0.119203]
Input:
std::string name = "sigmoid";
std::vector<double> values = {0.0, 2.0, -2.0};

Output atteso:
std::vector<double> expected = {0.5, 0.880797, 0.119203};
Input:
string name = "sigmoid";
double[] values = new double[] {0.0, 2.0, -2.0};

Output atteso:
double[] expected = new double[] {0.5, 0.880797, 0.119203};

Spiegazione

sigmoid(0) = 1 / (1 + 1) = 0.5, sigmoid(2) ≈ 0.880797 and sigmoid(-2) ≈ 0.119203. Sigmoid squeezes any number into the range 0 to 1.

Esempio 2
Input:
name = "relu"
values = [-1.5, 0.0, 3.0]

Output atteso:
expected = [0.0, 0.0, 3.0]
Input:
std::string name = "relu";
std::vector<double> values = {-1.5, 0.0, 3.0};

Output atteso:
std::vector<double> expected = {0.0, 0.0, 3.0};
Input:
string name = "relu";
double[] values = new double[] {-1.5, 0.0, 3.0};

Output atteso:
double[] expected = new double[] {0.0, 0.0, 3.0};

Spiegazione

ReLU keeps positive values and turns negative values into 0: [0, 0, 3].

Come affrontarlo

Prova prima da solo, poi apri un suggerimento alla volta.

Suggerimento 1

Each activation is applied independently to every number, so focus on one value at a time.

Suggerimento 2

Use the formula matching the given name and build a new list from the results.

Suggerimento 3

Be careful with negative inputs, especially for ReLU and the leaky slope on the nonpositive side.

Complessità attesa

O(n) time, O(n) extra space

Riferimenti

Questa sfida è adattata per CodeUtility. Segui la traccia e i vincoli sopra.

Impara dagli altri

Soluzioni della community

Nessuna soluzione pubblicata. Risolvi questa sfida per condividere la prima.