Encoder-decoder (seq2seq) architectures made it possible to map an input sequence to an output sequence of a different length, such as translating a sentence into another language.

The encoder reads the input and compresses it into a context representation; the decoder generates the output step by step from that representation. Early versions still bottlenecked on a single fixed-size context vector for long inputs, which attention later fixed.