When do integrals appear in machine learning?hard

Type
conceptual
Topic
probability-ml
Frequency
occasional
Tags
probability, ml
Answer

Integrals appear in expected value computation, marginalizing over latent variables, AUC-ROC calculation, and Bayesian inference where posterior distributions require normalizing constants.

Explanation

Expected value of a continuous random variable: E[X] = ∫ x dot f(x) dx. AUC (area under the ROC curve) is literally an integral - the probability that a random positive sample ranks higher than a random negative. Bayesian marginal likelihood: P(data) = ∫ P(data|theta) P(theta) dtheta - usually intractable, motivating variational inference and MCMC approximations. In practice, ML practitioners encounter integrals mainly through probability theory rather than direct computation.

Follow-upWhy is the Bayesian marginal likelihood often intractable to compute?