LLaMA-3 official release is said to be scheduled for today. Incoming:
8 billion parameters/70 billion parameters, 8,000 context length, 128,000 vocabulary, and 15 trillion tokens.
The increase in parameters means the model will be able to learn more complex patterns and