I am having a hard time understanding maths behind a 1x1 convolution and how is it actually performed.
Assuming that I have a 6x6x32 input to my 1x1xK convolution layer similar to the one presented in this video and shown below. I understand that I would take a 1x1x32 slice from the input ( blue in the image below), but what operation would I actually perform?
Do I just take one value, let's say at [1,1,1] of yellow and multiply each value in the input slice with this value, or do I multiply each value from the slice with the corresponding value in the 1x1x32 part.
Also what is meant by #filters? Doesn't it need to match 32 in a given example?