Skip to main content
1 of 5
R. S.
  • 179
  • 1
  • 8

Explain why the input of the algorithm in "Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation" is a matrix

My question is about the article Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation (depicted in the picture below).

enter image description here

It is written in the article $X$ is a matrix (beggining section 3.1) but It is seen the figure 2 a sequence of codeword indices represented as a vector and in figure 3 a sequence of codeword indices is represented as a matrix, so I don't understand the these details.

Please explain this detail of the article.

R. S.
  • 179
  • 1
  • 8