query: Why positional embeddings are summed with word embeddings instead of concatenation?
positive_passages.docid: 18549
positive_passages.text: In a Transformer model, why does one sum positional encoding to the embedding rather than concatenate it?
negative_passages.docid: 105631
negative_passages.text: Tensors in neural network literature: what's the simplest definition out there?
negative_passages.docid: 107298
negative_passages.text: Conjugating symbolic expression
negative_passages.docid: 78468
negative_passages.text: Understanding Dirichlet regularization in Sum
negative_passages.docid: 133550
negative_passages.text: Why are nested weights bad for performance? Alternatives?
negative_passages.docid: 2396
negative_passages.text: Order-preserving injections of ordinals into $[0,1]$
negative_passages.docid: 115100
negative_passages.text: Operator Ordering Ambiguities
negative_passages.docid: 98027
negative_passages.text: Non-finite clause complementation of complex transitive verbs
negative_passages.docid: 7366
negative_passages.text: Why would I ever use push_back instead of emplace_back?
negative_passages.docid: 67095
negative_passages.text: Spectral Measures: Embedding
negative_passages.docid: 139544
negative_passages.text: Is there a term for reduplication used to disambiguate categorization?
negative_passages.docid: 112373
negative_passages.text: Feeding Word Embeddings into Recurrent Neural Networks
negative_passages.docid: 93143
negative_passages.text: Why do we need autoencoders?
negative_passages.docid: 5763
negative_passages.text: How to preserve the order of terms in the output
negative_passages.docid: 156534
negative_passages.text: Tokens causing incorrect text substitutions
negative_passages.docid: 136240
negative_passages.text: The ordering of word pairs: anyone for chips and fish?
negative_passages.docid: 8323
negative_passages.text: How bad for TeX is omitting braces {}, even if the result is the same?