A message from our CEO about the future of Stack Overflow and Stack Exchange. Read now.

# Tag Info

Think of it like this: The cell state $h_t$ is a vector. The forget vector $f_t$ is used to choose which parts of the cell state to "forget". We update the hidden state with something like $c_t = f_t \circ c_{t-1}$ (it's actually more complicated, but let's start with that, to gain intuition). Suppose $f_t$ were a vector of 0's and 1's. In the ...