Summary

Data Foundations: Objects, Attributes, and Proximity Measures

From: Introduction to Data Mining (2nd Edition) — Tan, Steinbach, Karpatne, and Kumar

In Introduction to Data Mining (2nd Edition) — Tan, Steinbach, Karpatne, and Kumar, a data set is represented as objects described by attributes. Numeric objects can be viewed as points in an attribute space, and pairwise distances can be organized in a distance matrix.

Proximity measures

Proximity describes how near or far two objects are. Smaller distance generally indicates greater similarity; larger distance indicates dissimilarity. The Minkowski metric uses parameter r and includes common special cases.

  • Euclidean distance: square corresponding differences, add them, and take the square root; it is straight-line distance.
  • Manhattan distance: add absolute differences; it is also called city-block or taxicab distance.
  • Hamming distance: for binary vectors, count positions whose bits differ.
  • Supremum distance: use the largest single-attribute difference.

Why the choice matters

Clustering, nearest-neighbor search, and related mining methods depend on proximity. The chosen measure changes what counts as similar, so match it to the attribute type and the analytical goal.

Key takeaway: objects and attributes provide the representation; distance measures provide a quantitative way to compare objects.