ML Fundamentals
Weight
The numerical values inside a neural network that get adjusted during training, collectively, they encode everything the model has learned.
Definition
The learnable parameters in a neural network that determine how inputs are transformed through each layer. Training is the process of finding optimal weights. GPT-4 has hundreds of billions of weights.
Why it matters
When people say a model is "175 billion parameters," they mean weights. The weights ARE the model's knowledge.
Related terms in ML Fundamentals
Activation Functions
The "switch" inside a neural network that decides whether a neuron should fire, allowing the AI to learn complex non-linear patterns.
Active Learning
A technique where the AI asks humans to label only the most confusing examples, saving time and money on data labeling.
Anomaly Detection
Finding the "weird" stuff in a dataset, like a credit card charge in a foreign country or a broken machine part.
Artificial General Intelligence (AGI)
A hypothetical "super-AI" that can learn and do any intellectual task a human can do, not just one specific thing.
From vocabulary to outcomes
Ready to put Weight to work?
Knowing the term is step one. Deploying it inside a revenue architecture that compounds is what Sophizo builds.
Book a Discovery Call