You are viewing a single comment's thread from:

RE: LeoThread 2024-10-05 09:19

A token (not crypto but the true definition) is a unit of data. When you do a prompt in a chatbot, you get a certain output (information). There is a certain amount of tokens created.

The output is resident on the companies servers (OpenAI, Google, or Leo). It is then fed back into the model for further training.

Think of the exponential impact of all that data if 100 people are prompting multiple times.

1M tokens isnt outrageous.

You can get a feel on this by putting your threads, posts, or articles into this:

https://platform.openai.com/tokenizer