Skip to main content
Knowledge Encyclopedia391 terms

Glossary AI & Vibecoding

Fundamental reference guide for the new era of software engineering by Andriy Orlov: autonomous agents, loop engineering, Model Context Protocol, context scaling, VPS infrastructure, and burnout prevention.

A

EN
/ 9 terms
Models & Inference

Advanced Voice Mode

Native bidirectional voice communication technology in real-time (ChatGPT Advanced Voice, Gemini Live). Enables conversation with a model with a delay of up to 300 ms, allows interruptions mid-sentence, and conveys live emotions.

3 FAQ3 rel.Read
Models & Inference

AI Upscaling (Super Resolution)

A technology for enhancing resolution and restoring image details (Real-ESRGAN, Magnific AI, Topaz Photo). Unlike simple pixel enlargement (bicubic interpolation), neural networks generate new realistic microtextures: skin pores, eyelashes, hair strands, and fabric.

3 FAQ3 rel.Read
Models & Inference

AI Video Tools (Runway, Kling, Luma Dream Machine)

Leading modern platforms for video generation using artificial intelligence (Text-to-Video and Image-to-Video). They enable the animation of static images, control of virtual camera movement, and the creation of high-resolution cinematic videos without a film crew.

3 FAQ3 rel.Read
Models & Inference

Alibaba Qwen (Leader in Open Coding and Mathematics)

A series of high-performance open models from Alibaba's cloud division (Qwen 2.5, Qwen Coder). Recognized as a leader among open models in coding, mathematics, and multilingual text processing.

3 FAQ4 rel.Read
Models & Inference

Apple Silicon for AI (M-Series and Unified Memory)

Apple's processor architecture (M1/M2/M3/M4) with Unified Memory Architecture allows the entire RAM array (up to 128-192 GB) to be accessible to the GPU as VRAM, enabling the execution of massive neural networks without server-grade GPUs.

3 FAQ3 rel.Read
Models & Inference

Apple Silicon MLX Framework

A native machine learning library from Apple, designed to maximize the use of unified memory and GPU cores in M-series chips (M2/M3/M4) for running large LLMs.

3 FAQ4 rel.Read
Models & Inference

Artificial General Intelligence (AGI)

Artificial General Intelligence (AGI) is a hypothetical autonomous system capable of understanding, learning, and performing any intellectual task at human-level or exceeding it in most economically valuable fields of work.

3 FAQ3 rel.Read
Models & Inference

Autonomous Local AI and Data Privacy

The practice of executing machine learning models entirely on personal physical hardware without internet connectivity (Air-Gapped AI). Guarantees 100% protection against the leakage of trade secrets, personal data (GDPR/HIPAA), and cloud provider failures.

3 FAQ3 rel.Read
Models & Inference

AWQ & Activation-Aware GPU Quantization

4-bit weight compression methods for language models optimized for NVIDIA tensor core architecture, maximizing throughput while preserving critical activation channels.

3 FAQ4 rel.Read

B

EN
/ 1 term

C

EN
/ 8 terms
Models & Inference

Catastrophic Forgetting

A fundamental issue in artificial neural networks where learning a new task or language overwrites previous connections, leading to a sudden and complete loss of previously acquired skills.

3 FAQ3 rel.Read
Models & Inference

Character Consistency and Style Preservation

Methodologies and tools for maintaining visual character consistency and authorial style across a series of generations. Utilized for creating illustrated books, comics, film storyboards, and brand mascots using parameters like --cref, FaceID, and LoRA.

3 FAQ3 rel.Read
Models & Inference

Claude Haiku (Fast Compact Models by Anthropic)

The most compact and fastest model in the Anthropic lineup, designed for lightning-fast responses, mass text classification, data extraction, and agent routing at minimal cost.

3 FAQ4 rel.Read
Models & Inference

Claude Opus (Flagship AI Model by Anthropic)

The most powerful heavyweight model in the Anthropic family, designed for complex philosophical and scientific analysis, multi-layered text generation, and deep contextual understanding.

3 FAQ4 rel.Read
Models & Inference

Claude Sonnet (Claude 3.7 / 3.5 Sonnet)

The flagship engineering model from Anthropic, optimized for complex programming, large codebase management, hybrid reasoning (Extended Thinking), and autonomous agentic cycles.

3 FAQ4 rel.Read
Models & Inference

Constitutional AI (RLAIF)

A behavior alignment method developed by Anthropic (creators of Claude). Instead of relying on millions of hours of human labor, the model critiques and corrects its own responses based on a clear set of ethical principles ('Constitution').

3 FAQ3 rel.Read
Models & Inference

Continuous / Dynamic Batching

A mechanism for grouping incoming requests to neural networks at the token iteration level (Iteration-Level Scheduling), eliminating GPU idle time during parallel loads.

3 FAQ4 rel.Read
Models & Inference

ControlNet: Managing Poses and Geometry

A neural network extension for diffusion models (Stable Diffusion) that enables control over the spatial composition of generation using depth maps, Canny edge outlines, and human pose 'skeletons' (OpenPose). It transforms chaotic generation into a precise designer tool.

3 FAQ3 rel.Read

D

EN
/ 4 terms

E

EN
/ 1 term

F

EN
/ 3 terms

G

EN
/ 10 terms
Models & Inference

Gemini Flash & Pro (Google Gemini)

A family of multimodal models from Google DeepMind that combines a record context window (up to 2 million tokens), extreme generation speed (over 150 tokens/sec), and native perception of video and audio.

3 FAQ4 rel.Read
Models & Inference

Gemini Nano & Edge AI (AI Directly on Your Smartphone Without Internet)

The most compact version of Google's AI, optimized for local execution on smartphone chips (NPU). It provides audio recording summaries, intelligent responses, and photo processing entirely offline.

3 FAQ4 rel.Read
Models & Inference

Generation Speed (TPS / TTFT / Latency)

Key engineering performance metrics for language models: Time to First Token (response time to input context) and Tokens Per Second (streaming output text generation speed).

3 FAQ4 rel.Read
Models & Inference

GGUF & Modern Quantization Standards

The GGUF format is a universal binary file format for storing and instantaneously loading quantized language models on CPUs and GPUs in llama.cpp, Ollama, and LM Studio.

3 FAQ4 rel.Read
Models & Inference

Google AI Studio (Free Studio for AI Testing)

The official web sandbox from Google for rapid testing of Gemini models. It allows free experimentation with a 2-million context, customizing system prompts, and obtaining API keys without a credit card.

3 FAQ4 rel.Read
Models & Inference

Google Gemini Pro (Model with Infinite Context)

The flagship working model from Google DeepMind featuring a record context window of over 2 million tokens. Capable of analyzing entire books, lengthy videos, and massive codebases in a single query.

3 FAQ4 rel.Read
Models & Inference

GPT Image / DALL-E (Image Generation in ChatGPT)

An integrated visual content generation tool directly within the ChatGPT dialogue. It allows for the creation of illustrations, concept art, poster texts, and local editing of image fragments.

3 FAQ4 rel.Read
Models & Inference

GPT Mini (Compact Models of the GPT-4o Mini Series)

An economical and ultra-fast version of OpenAI's flagship models. Optimized for mass daily tasks, instant responses, text classification, and limit conservation.

3 FAQ5 rel.Read
Models & Inference

GPU vs. CPU for AI: What's the Difference

A deep comparison of Central Processing Units (CPU) and Graphics Processing Units (GPU) for machine learning tasks. It explains the fundamental differences between latency-oriented and throughput-oriented architectures, memory bus bandwidth (DDR5 vs HBM3e), and CLI benchmarking.

3 FAQ4 rel.Read
Models & Inference

GRPO & DPO Modern Alignment Algorithms

Cutting-edge model policy optimization algorithms (Direct Preference Optimization and Group Relative Policy Optimization) eliminate the need for cumbersome standalone critic models during reasoning training.

3 FAQ4 rel.Read

H

EN
/ 1 term

I

EN
/ 2 terms

K

EN
/ 1 term

L

EN
/ 8 terms
Models & Inference

Latent Space

A multidimensional mathematical vector space created by neural networks for internal representation of concepts, styles, and images. It enables remarkable arithmetic operations on concepts: for example, 'King' minus 'Man' plus 'Woman' equals 'Queen.'

3 FAQ3 rel.Read
Models & Inference

Llama Family (Meta Llama)

A series of foundational open language models from Meta (Llama 3, 3.1, 3.3) that have become the industrial standard for the Open Weights ecosystem, local AI, and enterprise fine-tuning.

3 FAQ4 rel.Read
Models & Inference

LLM (Large Language Model)

A fundamental class of neural network architectures based on autoregressive transformers, predicting the probabilistic distribution of subsequent tokens and demonstrating emergent properties of abstract reasoning, code synthesis, and logical inference.

3 FAQ4 rel.Read
Models & Inference

LM Studio

A free desktop application for Windows, macOS, and Linux that allows users to find, download, and run open LLMs with a single click, without using the terminal. It features a built-in local server compatible with the OpenAI API.

3 FAQ3 rel.Read
Models & Inference

LMSYS Chatbot Arena (ELO Rating)

A crowdsourced open platform for blind A/B testing of LLMs that determines the relative strength of language models based on the Bradley-Terry statistical model and Elo chess rating.

3 FAQ4 rel.Read
Models & Inference

Local LLM Inference

The practice of autonomously executing large language models directly on developer hardware (Apple Silicon, NVIDIA GPU) with guaranteed absolute privacy and zero dependency on the internet.

3 FAQ4 rel.Read
Models & Inference

LoRA Files for Styles and Faces (Low-Rank Adaptation)

A lightweight and rapid fine-tuning technology for image models (Stable Diffusion, FLUX). It creates compact files ranging from 20 to 200 MB that connect to the base model as a variable plugin, adding specific characters, artist styles, or visual aesthetics.

3 FAQ3 rel.Read
Models & Inference

Lost in the Middle Effect

A well-documented cognitive asymmetry of large language models identified in Stanford research. It demonstrates that the accuracy of information retrieval is highest at the beginning and end of the input context, but sharply declines in the middle of long documents.

3 FAQ3 rel.Read

M

EN
/ 9 terms
Models & Inference

Meta Llama (The Premier Open Standard for Artificial Intelligence)

The flagship series of open language models from Meta (Llama 3, 3.3). Available for free download, modification, and local deployment on personal servers without restrictions or censorship.

3 FAQ4 rel.Read
Models & Inference

Midjourney (Leading Artistic Design Platform)

A premier closed image generator with the highest level of artistic aesthetics. The industry standard for designers, cinematographers, concept artists, and advertising creatives.

3 FAQ3 rel.Read
Models & Inference

Mistral AI (European Open and Efficient Models)

A series of high-performance open and commercial models from the French startup Mistral AI (Mistral 7B, Mixtral 8x7B, Mistral Large). Known for their compactness, speed, and respect for data privacy.

3 FAQ4 rel.Read
Models & Inference

Model Distillation & Reasoning Transfer

A methodology for transferring knowledge and reasoning chains from a large Teacher Model to a compact Student Model for fast and cost-effective inference.

3 FAQ4 rel.Read
Models & Inference

Model Merging & Frankensteining

A technique for merging the weights of two or more distinct language models without retraining on GPU (SLERP, DARE, Ties-Merging), creating hybrid models with synergistic capabilities.

3 FAQ4 rel.Read
Models & Inference

Model Parameter Count (7B, 14B, 70B)

The total number of training parameters (weights) in a large language model, where 'B' denotes billions. A key indicator of the model's intellectual capacity, operational speed, and computer memory requirements.

3 FAQ3 rel.Read
Models & Inference

Model Quantization

A mathematical compression technology for neural network weights and activations by transitioning from high precision (FP16/BF16) to low-bit formats (FP8, INT8, INT4, GGUF) for radical memory savings.

3 FAQ4 rel.Read
Models & Inference

Modern Speech Synthesis (Text-to-Speech / TTS)

The technology of artificial generation of human speech from printed text. Modern neural network TTS models (ElevenLabs, OpenAI Audio, Chatterbox) reproduce natural intonations, logical stresses, breathing, timbre, and emotional coloring, indistinguishable from a live narrator.

3 FAQ3 rel.Read
Models & Inference

MoE (Mixture of Experts)

An architectural approach in deep learning where heavy fully-connected transformer layers are divided into dozens of specialized subnetworks ('experts'), and a dynamic router activates only a small subset for each individual token.

3 FAQ4 rel.Read

N

EN
/ 6 terms
Models & Inference

Native Audio: Direct Speech-to-Speech Processing

The new generation of native multimodal models (GPT-4o Advanced Voice, Gemini Live) processes sound waves directly without the intermediate step of converting audio to text (STT) and back (TTS). This allows the model to perceive sarcasm, fear, laughter, whispers, and interrupt conversations on the fly with minimal latency.

3 FAQ3 rel.Read
Models & Inference

Native Multimodal Reasoning

AI architectures capable of performing deep logical reasoning over code, architecture diagrams, UI screenshots, and video within a unified attention space.

3 FAQ4 rel.Read
Models & Inference

Needle In A Haystack Test (NIAH)

A standard benchmark for testing the context window length of language models. A short random sentence (the needle) is hidden within a vast array of random background text (the haystack) at various positions, assessing the model's ability to locate it accurately.

3 FAQ3 rel.Read
Models & Inference

Negative Prompts in Image Generation

A control mechanism in diffusion models (Stable Diffusion, Midjourney --no) that directs the mathematical vector of noise reduction away from unwanted images. It filters artifacts such as extra limbs, blurriness, watermarks, and cartoonish effects.

3 FAQ3 rel.Read
Models & Inference

Neural Processing Unit (NPU)

A specialized hardware microchip (Neural Processing Unit) designed exclusively for executing artificial neural networks with minimal energy consumption. It handles background blurring in video calls, photo enhancement, and local AI prompts without draining the battery.

3 FAQ3 rel.Read
Models & Inference

Next-Token Prediction

The fundamental mechanism of autoregressive large language models (LLMs). Calculation of logits, Softmax function, temperature influence, and sampling (Top-P/Top-K). Explanation of why text generation is an O(N) sequential process and how to inspect probabilities via API.

3 FAQ4 rel.Read

O

EN
/ 10 terms
Models & Inference

OCR vs Vision LLM: The Evolution of Text Recognition

A comparison of traditional Optical Character Recognition (OCR — Tesseract, ABBYY FineReader) with modern multimodal visual models (Vision LLM). Older algorithms blindly replicate pixels with errors, while new models correct handwriting, understand tables, and compute totals.

3 FAQ3 rel.Read
Models & Inference

Ollama (Local Model Deployment Platform)

A leading open-source tool for easy loading, configuration, and local execution of language models (Llama, DeepSeek, Qwen) with a built-in REST API compatible with OpenAI.

3 FAQ4 rel.Read
Models & Inference

Open Weights vs Closed APIs

A comparison of two fundamental philosophies in AI distribution: Open Weights (Llama, Mistral, DeepSeek), which can be downloaded and run on your own server, versus Closed APIs (OpenAI, Anthropic, Google), where access is granted solely through subscription.

3 FAQ3 rel.Read
Models & Inference

Open Weights vs Truly Open Source AI

A legal and engineering analysis of the fundamental difference between accessible numerical weights of models (Llama, DeepSeek) and fully open projects with source data, code, and architecture (OSI Standard).

3 FAQ4 rel.Read
Models & Inference

OpenAI GPT (Flagship Models of the GPT Series)

The primary universal line of large language models from OpenAI (GPT-4, GPT-4o). Optimized for complex text analysis, programming, creativity, and daily intellectual tasks.

3 FAQ4 rel.Read
Models & Inference

OpenAI o-Series / Reasoning (Advanced Reasoning Models)

The new generation of artificial intelligence from OpenAI (o1, o3 series) is optimized for multi-step hidden reasoning, advanced mathematics, quantum physics, and complex algorithmic coding.

3 FAQ4 rel.Read
Models & Inference

OpenAI Whisper (Gold Standard for Speech Recognition)

OpenAI's open-source Speech-to-Text (STT) model. It recognizes over 100 languages, resilient to background noise, dialects, and mumbling. The standard for automatic audio transcription and voice coding.

3 FAQ3 rel.Read
Models & Inference

OpenRouter (Unified Model API Gateway)

A unified AI gateway providing standardized access to hundreds of closed and open language models from various inference providers through a single balance, a unified API key, and an automatic failover mechanism.

3 FAQ4 rel.Read
Models & Inference

Output Tokens Limit (Why Text Cuts Off Mid-Word)

A hardware or software limit on the maximum length of a single response (Max Output Tokens). This explains why long code or articles sometimes stop mid-sentence and how the magic phrase 'Continue' brings the model back to work.

3 FAQ3 rel.Read
Models & Inference

Overfitting

A fundamental issue in machine learning where a model excessively adapts to the training dataset along with its specific noise, losing the ability to generalize on new data. This entry dissects the divergence of loss functions, regularization techniques, and Early Stopping in code.

3 FAQ4 rel.Read

P

EN
/ 4 terms

Q

EN
/ 2 terms

R

EN
/ 2 terms

S

EN
/ 10 terms
Models & Inference

Sampling Parameters (Temperature, Top-p, Min-p)

Mathematical hyperparameters of stochastic decoding (Temperature, Top-P, Min-P, Penalties) that govern the probability distribution for selecting the next token, defining the model's level of determinism, accuracy, and creativity.

3 FAQ4 rel.Read
Models & Inference

Scaling Laws in AI

An empirical law established by OpenAI and Google (formulated by Jared Kaplan in 2020) asserting that the performance of a language model predictably increases as a power law with the growth of three factors: the number of model parameters, the volume of training data, and the computational power expended (Compute).

3 FAQ3 rel.Read
Models & Inference

Seed and Determinism (Reproducing Generation Results)

A numerical identifier for the random number generator (Seed). It allows for the stabilization of randomness in language models and image generators to achieve consistent, reproducible results when repeating the same query.

3 FAQ3 rel.Read
Models & Inference

Self-Attention Mechanism

A key mathematical mechanism of the Transformer architecture that enables each word in a sentence to dynamically weigh the importance of all other surrounding words. This allows the model to distinguish between homonyms and link pronouns ('he', 'she', 'it') to the correct entities.

3 FAQ3 rel.Read
Models & Inference

SLMs (Small Language Models 1B–3B)

Ultra-compact next-generation models sized 1B–3B parameters (Llama 3.2, SmolLM, Qwen 2.5), designed for local execution on phones, in browsers, and on inexpensive edge servers.

3 FAQ4 rel.Read
Models & Inference

Sora and AI Video (Video Generation from Text)

A cutting-edge class of generative neural networks capable of creating photorealistic dynamic videos from text or static images (OpenAI Sora, Runway Gen-3, Kling, Luma Dream Machine).

3 FAQ3 rel.Read
Models & Inference

Speculative Decoding & Draft Models

A hardware acceleration technique for inferring large language models 2–3 times faster without quality loss through parallel verification of predictions from a fast draft model.

3 FAQ4 rel.Read
Models & Inference

Stochastic Parrot Theory

A notable scientific critique of large language models, introduced by linguists Emily Bender and Timnit Gebru in 2021. It asserts that LLMs lack consciousness or understanding, merely repeating learned word combinations in a stochastic manner, akin to a parrot.

3 FAQ3 rel.Read
Models & Inference

Sub-Quadratic Attention & Mamba / State Space Models

Cutting-edge neural network architectures with linear computational complexity O(N), enabling the processing of millions of context tokens with constant memory usage.

3 FAQ4 rel.Read
Models & Inference

Synthetic Data Generation & Pretraining

A technology for generating, automatically filtering, and formally verifying training datasets using artificial intelligence to overcome the shortage of quality human data.

3 FAQ4 rel.Read

T

EN
/ 8 terms
Models & Inference

Temperature in Generation (Creativity and Chaos Slider)

A key numerical parameter for text generation (typically ranging from 0.0 to 1.0 or 2.0). It determines the degree of unpredictability in selecting the next token, from strict deterministic mathematics to free-flowing creativity.

3 FAQ3 rel.Read
Models & Inference

TensorRT-LLM & SGLang High-Speed Engines

Deeply compiled computational engines for extreme optimization of language model inference on NVIDIA servers, utilizing graph optimization, FlashAttention-3, and advanced routing.

3 FAQ4 rel.Read
Models & Inference

Test-Time Compute Scaling

A new paradigm in AI development by the end of 2026: enhancing response quality not through massive model sizes during training, but by allocating additional seconds for reasoning before generation.

3 FAQ4 rel.Read
Models & Inference

Thinking Budget in New Models

A new parameter in modern hybrid reasoning models (Claude 3.7 Sonnet, OpenAI o1/o3) that allows users to define the limit of tokens or seconds the AI can spend on internal contemplation before delivering a final response.

3 FAQ3 rel.Read
Models & Inference

Tokens Explained (How Many Words in a Token)

The fundamental unit of measurement for text in language models. This entry explains how words are broken down into tokens, why this impacts query costs, and why Ukrainian words consume more tokens than English ones.

3 FAQ4 rel.Read
Models & Inference

Top-P / Nucleus Sampling

A probabilistic word filtering method (Nucleus Sampling) that truncates the 'long tail' of low-probability, bizarre, and nonsensical words, retaining only the most relevant options with a cumulative probability of P (typically 0.9).

3 FAQ3 rel.Read
Models & Inference

Transformer Architecture

The neural network architecture introduced by Google researchers in 2017 in the paper 'Attention Is All You Need'. It forms the foundation of all modern language models (GPT, Claude, Gemini, Llama), replacing slow recurrent networks and enabling parallel processing of entire text sequences.

3 FAQ3 rel.Read
Models & Inference

TTFT vs TPS (Inference Latency Metrics)

Two key engineering metrics for inference performance: Time To First Token (latency to response initiation) and Tokens Per Second (throughput of code generation).

3 FAQ4 rel.Read

V

EN
/ 4 terms

W

EN
/ 1 term

X

EN
/ 1 term
Andriy Orlov Community

Full Stack of Tools, Tier Lists, and AI Skills

Beyond the glossary, GOTBURNOUT provides frontier AI benchmarks, a catalog of over 100,000 AI Agent Skills, production-ready VPS hardening scripts, and an exclusive Pro developer community.