ChatGPT

On this page 7

ChatGPT is a conversational assistant developed by OpenAI that generates text, code and other content in response to natural-language messages, built on the company’s GPT family of large language models. Released to the public in November 2022, it became the product that brought generative AI to a mass audience, because it packaged a powerful language model in a simple chat interface that anyone could use without technical setup.

ChatGPT is a product, not a single model. Over time it has run on successive models, starting with a GPT-3.5 variant and moving to GPT-4-class and later multimodal and reasoning models, and it has added tools such as web search, file analysis, image generation and voice conversation around the underlying model.

How ChatGPT generates its answers

ChatGPT produces answers by predicting one token at a time, where a token is a word fragment of a few characters. The model receives the conversation so far, including a hidden system prompt with instructions from the operator, and repeatedly selects the next token from a probability distribution until the reply is complete. Sampling settings such as temperature control how varied the wording is.

The underlying models are trained in stages. Pretraining on a very large text corpus teaches language and general knowledge through next-token prediction. Supervised fine-tuning on example dialogues teaches the assistant format, and reinforcement learning from human feedback (RLHF) adjusts behavior toward answers that human reviewers rate as helpful, honest and safe.

StageData usedEffect on behavior
PretrainingLarge mixed text and code corpusLanguage ability and broad knowledge
Supervised fine-tuningWritten example conversationsFollows instructions in dialogue form
Preference training (RLHF)Human rankings of candidate answersMore helpful, polite and cautious replies
Safety tuningTargeted refusal and policy examplesDeclines clearly harmful requests
Training stages behind the assistant

Capabilities and built-in tools

ChatGPT combines the language model with external tools that the model can call when a task needs them. This tool calling turns a text predictor into a broader assistant: it can look up current information, execute code to compute exact results, read uploaded documents and create images.

CapabilityUnderlying mechanismTypical use
Text generation and editingCore language modelDrafts, summaries, translations
Code writing and executionModel plus sandboxed code runtimeData analysis, charts, scripts
Web searchRetrieval of current pagesRecent events and fact lookup
File and image understandingMultimodal model inputsReading PDFs, screenshots, photos
Image generationIntegrated image modelIllustrations and visual drafts
Voice conversationSpeech recognition and synthesisHands-free dialogue
Main capabilities and what they rely on

Available features depend on the subscription tier and platform, and they change frequently. Business and education plans add administrative controls and contractual commitments about how conversation data is handled.

ChatGPT is often used loosely as a synonym for generative AI, but it is one application within a much larger field. GPT names the model family and the generative pre-trained transformer architecture; generative AI covers all systems that create new content, including image models such as diffusion models and music or video generators.

TermWhat it refers toRelation to ChatGPT
GPTA family of transformer language modelsThe engine ChatGPT runs on
Large language modelAny very large text-trained modelGeneral category of that engine
Generative AISystems that create text, images, audio, videoThe field ChatGPT belongs to
Multimodal AIModels handling several input typesA property of recent ChatGPT models
Diffusion modelImage generation by iterative denoisingA separate technique, used for images
Distinguishing ChatGPT from neighboring terms

Limitations and responsible use

The most important limitation is hallucination: ChatGPT can state incorrect facts, invented references or wrong calculations in fluent, confident language. Fluency is not evidence of accuracy, so important claims must be checked against reliable sources. Web search and code execution reduce, but do not eliminate, this risk.

  • Knowledge cutoff: without search, the model knows nothing after its training data ends.
  • Context limits: very long conversations or documents may exceed the context window, and early details can be lost.
  • Sensitivity to phrasing: small changes in a prompt can change the answer considerably.
  • Bias and sycophancy: the assistant may mirror assumptions in the question or agree too readily.
  • Data protection: confidential or personal data should be entered only under an approved plan and policy.

Good practice treats ChatGPT as a capable first-draft collaborator, with a human responsible for verification, final wording and any decision that affects people.

Getting reliable results

Output quality depends strongly on how the task is described. Prompt engineering for a chat assistant is mostly clear communication: state the goal, the audience, the format and the constraints, and provide the source material instead of asking the model to recall it.

PracticeEffectWhen it matters most
Provide source textGrounds answers in given factsSummaries, policies, reports
Specify format and lengthReduces reworkEmails, tables, structured output
Give examplesAligns style and levelClassification, tone matching
Ask for step-by-step reasoningImproves complex answersMath, planning, analysis
Prompting choices and their effect

Iteration is part of the method. A first answer is best treated as a draft: asking the assistant to check its own result against the source, list its assumptions or produce an alternative version often reveals errors. For recurring tasks, saved instructions or a custom assistant configuration keep the same rules applied consistently across conversations, which makes outputs easier to review and compare.

A non-technical view

ChatGPT is a program you can talk to in ordinary language. You type a question or a request, and it writes a reply. It learned by reading an enormous amount of text. From that reading, it became very good at producing sensible, well-written answers.

It does not look facts up in a single trusted book. It predicts what a good answer probably looks like. That makes it quick and helpful, but sometimes wrong. Think of it as a fast, well-read assistant whose work still needs checking.

A concrete example

A small marketing team must produce a 20-page quarterly report from survey data in a spreadsheet and a folder of interview notes. One analyst uploads the anonymized spreadsheet to ChatGPT under the company’s business plan and asks it to compute response rates and draw three charts. The assistant writes and runs the analysis code and returns the charts in minutes.

She then pastes the interview notes and asks for a structured summary of recurring complaints. The draft is useful, but one quoted figure does not match the spreadsheet, so she corrects it before editing the text herself. The report is finished in two days instead of the usual week, with every number traced back to the source data.