Skip to content
Search

Generative Pre-trained Transformer

lastmod 2026-02-18created 2023-04-0623 edits

GPT

GPT-2

GPT-3

Generation Pre-trained Transformer 3 (GPT-3) is an autoregressive language model that uses deep learning to produce human-like text. It is the third-generation language prediction model in the GPT-n series created by OpenAI. The full version of GPT-3 has 175 billion parameters, introduced in May 2020, more than twice as large as its predecessor GPT-2. As of July 2020 it is in beta testing, and it is part of a trend in natural language processing (NLP) systems of pre-trained language representations. Before the release of GPT-3, the largest language model was Microsoft's Turing NLG, introduced in February 2020, with 10 times less capacity than GPT-3. Tasks GPT-3 can perform include solving various language-related problems, random writing, simple arithmetic, translation, and simple web coding based on given sentences.

The quality of the text generated by GPT-3 is so high that it is difficult to distinguish from text written by humans, which has both benefits and risks. Thirty-one OpenAI researchers and engineers presented the original May 28, 2020 paper introducing GPT-3, in which they warned of GPT-3's potential dangers and called for research to mitigate risk. Australian philosopher David Chalmers described GPT-3 as "one of the most interesting and important AI systems ever produced."

GPT-4

GPT-5-Codex

GPT-5-Codex is a model optimized for real-world software engineering, supporting everything from short interactive sessions to long independent tasks

  • The new model has stronger code review capabilities, catching critical flaws early by navigating dependencies, running tests, and comparing intent with implementation
  • Performs well on tasks such as large-scale code refactoring, and dynamically adjusts its working time based on user needs
  • Codex CLI and the IDE extension have been revamped for agentic workflows, with image attachments, task progress tracking, web search, and MCP integration
  • GitHub integration enables automatic PR reviews and even fix suggestions, reducing the team's review burden and increasing release reliability
  • Codex is now included in the ChatGPT Plus, Pro, Business, Edu, and Enterprise plans

GPT-OSS

Store

SEO writing

  • Content Helpfulness and Quality SEO Analyzer
  • Creative Writing Coach
  • Fully SEO Optimized Article including FAQ's
  • SEO FOX

Design

  • Canva
  • Consistent Character GPT
  • DesignerGPT
  • Logo Creator
  • Pixarize You
  • Simpsonise Me
  • Sticker Whiz
  • Tripo3D
  • Visual Design GPT

Marketing

Midjourney / DALL-E AI images

  • MJ v6 GPT Prompt Generator
  • Storyteller
  • Super Describe

Video creators

  • Transcript Thief
  • Video Summarizer AI
  • VideoGPT by VEED
  • VideoMaker by Invideo AI

E-commerce bargaining

  • The Negotiator

Daily life and productivity

  • BestCustomGPTs
  • AI Voice Generator
  • Convert Anything
  • Diagrams Show Me
  • Effortless Book Summary
  • Professor Synapse
  • Sous Chef
  • WebPilot
  • What should I watch?
  • English-to-Korean pronunciation transcription bot

Research and PDF

  • AI PDF
  • ASK YOUR PDF
  • Consensus
  • SciSpace

Coding

  • Screenshot To Code GPT

Website analysis

  • Website Roaster GPT

Prompt improvement

  • Prompt Perfect

No-code

  • Framer GPT
  • Webflow GPT

Other

  • Drilio
  • Language Coach
  • Sales Cold Email Coach
  • Viral Intro Hooks

Documentation

Language Models are Few-Shot Learners
https://arxiv.org/abs/2005.14165

Projects

See also

Favorite site

author Zer0 sitemap