Acquired
Nvidia Part III: The Dawn of the AI Era (2022-2023)
Ben Gilbert
Yes. Now, here's the magical part. While it does look at the whole input text to consider what the next word should be, it doesn't mean that it throws away the notion of position entirely. It uses a technique called positional encoding, so it doesn't forget the position of the words altogether.
0
💬
0
Comments
Log in to comment.
There are no comments yet.