Consider the following paragraph from the deeplearningbook
The training and test data are generated by a probability distribution over datasets called the data-generating process. We typically make a set of assumptions known collectively as the i.i.d. assumptions. These assumptions are that the examples in each dataset are independent from each other, and that the training set and test set are identically distributed, drawn from the same probability distribution as each other. This assumption enables us to describe the data-generating process with a probability distribution over a single example. The same distribution is then used to generate every train example and every test example. We call that shared underlying distribution the data-generating distribution, denoted $p_{data}$. This probabilistic framework and the i.i.d. assumptions enables us to mathematically study the relationship between training error and test error.
Bolded area is difficult for me to comprehend. Here I have the following issues in interpreting.
1) How probability distribution is generating a dataset?
2) Are the generation process and probability distribution the same?
3) What is the sample space and random experiment for the underlying probability distribution?