Artificial Intelligence AI Questions

Best way to learn is ask creative questions.

Questions 

• GAI: with llms does it matter what order the tokens are passed through the neural net?

Yes, the order of tokens passed through an LLM absolutely matters. While Transformers are designed to process tokens in parallel, they rely on specific mechanisms to understand the sequence order. Without these mechanisms, a Transformer would treat a sentence as a "bag of words" (a set of unordered tokens), rendering it incapable of understanding syntax or meaning.   …….more

• GAI: describe the process of converting a phrase to tokens
• GAI: how do LLMs create the vectors from the words?