The law of large numbers says that sample averages tend to get closer to the expected value as sample size grows.

It explains why more data usually gives more stable estimates. It does not guarantee every small sample is accurate, and it does not remove bias from a bad sampling process.