An alternative to the one hot representation is where you figure out the meaning of a word by the words that frequently appear nearby....
Things you should think about: What are the implications of your choice of \(\alpha\)? How much did intuition play a role in deciding...