In information theory, the entropy is a function of a random variable, not of a fixed data set (well, technically a fixed data set does have an entropy, but that entropy would be 0 ??? we can regard the data as a random distribution that has only one possible outcome with probability 1).