Transformers was made possible by word-to-vector work. This makes it possible to perform vector operations on words So LLMs work with strings/words, which opens up the possibility of building new types of computers that work with strings/words instead of numbers. A digital computer works with numbers (bytes encoded in bits), while LLMs work with strings (tokens encoded in vectors) A digital computer performs bit operations A natural language computer does vector operations