Skip to content

AI Glossary · Concepts

What is Feature Scaling?

Feature Scaling

Feature scaling, often called normalization, puts numeric inputs on a comparable range before training, for example rescaling income and age so neither dominates just because its numbers are bigger. Common methods are min-max scaling to 0–1 and z-score standardization.

Also known as: normalization, data normalization, feature normalization, standardization, min-max scaling, z-score normalization

· Chain of Thought

Model Training

  • 3 sources

A loan model uses annual income (tens of thousands of dollars) and number of open credit cards (usually under 10). Fed in raw, the income column’s huge numbers can dominate distance calculations and slow down training, simply because of its units. Scaling fixes that. Min-max scaling squeezes each column to 0–1. Z-score standardization subtracts the column’s average and divides by its spread, so a value of +2 means “two standard deviations above average.” Log scaling helps for long-tailed values like income, where a few huge numbers would otherwise squash everyone else together.

Google’s guide notes models usually train faster and predict better when numeric features share a similar range. It matters most for methods that rely on gradients or distances, such as neural networks and linear or logistic regression, and much less for tree models such as a random forest.

The common trap is computing the scaling from the whole dataset. The averages and ranges must be learned from the training set only and then applied unchanged to validation, test and production data; otherwise information about the test data leaks into training (data leakage). “Normalization” also names unrelated ideas elsewhere, such as layers inside a neural network that normalize activations, or database normalization, which is why this entry autolinks only the feature-scaling phrases.

Sources