This book provides a thorough first course on parameter estimation (point estimates and confidence interval estimates), hypothesis testing, (ANOVA) and simple linear regression. It presents a combination of mathematical depth, numerous examples as well as numerous demonstrations in the user-friendly software, JMP. This book is the second of two books from this author team that perfectly complement each other. The first book Statistics with JMP: Graphs, Descriptive Statistics and Probability covers graphs, descriptive statistics and probability theory. Both books can be used independently, but together form an ideal resource for statistics programs and teachers setting up two consecutive introductory courses from descriptive statistics up to inferential statistics.