Performance gains are evident with the Llama 3 70B microservices, (the base for the new Llama–3-Swallow-70B and Llama-3-Taiwan-70B offerings), which boast up to 5x higher throughput. This translates into reduced operational costs and improved user experiences through minimised latency.