Probability theory deals with the study of random events and their likelihood of occurrence. It provides a framework for modeling and analyzing situations involving uncertainty or randomness.

Statistics on the other hand deals with collecting, analyzing, interpreting, organizing etc... data.
Its goal is to extract meaningful insights and knowledge to make informed decisions and predictions.

Descriptive Statistics refers to describing and summarizing charcteristics of a dataset

Inferential Statistics, keyword inference means to infer, define generalizations and predictions about a population based on a sample of data.