Data mining and analytics are used to test hypotheses and detect trends from very large data sets. In statistics, the significance is determined to some extent by the sample size.
Focus your discussion on the following:
· How can supervised learning be used in such large data sets to overcome the problem where everything is significant with statistical analysis?
· Discuss the importance of a clear purpose in supervised learning and the use of random sampling.
· Discuss the issue of large data sets and their relationships being significant but explaining little variance.
· Do large data sets lend themselves better to prediction rather than smaller data sets?