Summary

Clustering and Careful Interpretation of Mining Results

From: Introduction to Data Mining (2nd Edition) — Tan, Steinbach, Karpatne, and Kumar

Clustering is an unsupervised task that groups objects by similarity without preassigned labels. Similarity or distance matrices support the comparison of objects.

Methods and computation

  • K-means assigns objects to a chosen number of centroids and updates the centroids iteratively.
  • DBSCAN groups dense regions and can identify noise without requiring a fixed number of clusters in advance.
  • Spatial access methods and other indexing techniques can reduce the cost of repeated proximity searches.

Interpretation caution

Apparent patterns can occur in random data. Testing many hypotheses without controlling error rates increases false discoveries. Validate clusters and other findings on appropriate data, report assumptions, and avoid treating an interesting pattern as reliable evidence without confirmation.