As a formal matter, conventional regression analysis does nothing more than produce from a data set a collection of conditional means and conditional variances. This work identifies a wide variety of problems with regression analysis as it is commonly used and then provides a number of ways in which practice could be improved.