I felt it is really difficult for me to focus on a specific thing. I haven't finish a three hours video until 11:30pm. The video is about how llms like ChatGPT works. The first step of training a LLM is prepare tons of data. Internet is a great place to get data. But the there are some filter should be applied during the data acquisition. Then the data(text) should be tokenized for next stage. Then use the neural network to train the model predict the words sequence. LLMs include two parts, the first one is trained to do the predict work, the other parts is trained to do the interaction work. I don't know if my note is right.
Rummikub has a timer app(Rummikub score timer?)! This is so cool. I taught this game to my brother in law, and you know what. He is better at it than me now.
I found it really difficult to focus on one specific thing
today. I didn't finish
a three-hour video until 11:30 pm. The video was
about how LLMs like ChatGPT work
. Preparing tons of data is
the first step in training an
LLM. The
internet is a great place to get data. But there are some filters that should
be applied during data acquisition. After that,
the data (text) needs to
be tokenized for the next stage. Then, a
neural network is used to train the model to predict word sequences
. LLMs have
two main parts: the first is
trained to do the prediction
work, and the other part is trained for
interaction. I don't know if my note is right.
Rummikub has a timer app (is it called 'Rummikub score timer'?)
! That's
so cool. I taught my brother-in-law this game, and guess what? He's
even better at it than I am
now.