PaLM
lastmod 2026-11-10created 2024-01-282 edits
PaLM (Pathways Language Model) is a large language model announced by Google. It is a dense decoder-only Transformer trained on thousands of TPUs tied together with Google's own Pathways system, and it is known for showing that performance on reasoning, code generation, and multilingual tasks rises sharply as scale increases. Its successor PaLM 2 was used in Bard and several Google services, and the line later continued into the Gemini family. It is a competing model from the same generation as OpenAI's GPT.