You are viewing a single comment's thread from:RE: LeoThread 2024-09-17 08:12View the full contextView the direct parentguurry123 (73)in LeoFinance • 2 months ago what is the calculation?
The easiest way is to consider a token a word. That isnt exact but it is enough of a framework.
To give you an idea, Llama3 was trained on 16 trillion tokens.
What I can understand we have to feed a lots of data..
That is the baseline if you want to go from that.