Machine Learning basics (part 3)
After the last introduction in part 2 about Linear Regression, let’s jump to Logistic Regression along with some basic concepts.
Basic terms
Maximum likelihood
Used to find the best fitted line for logistic regression. Th idea is the same as in linear regression, we keep rotating the line until we find the one with maximum likelihood. First, we need to project data into a x-axis and y-axis (log(odd)). Then we need to transform it back to probability, and calculate log likelihood. We keep doing this until we have the most fitted line with maximum likelihood.
Coefficients
The coefficients for the line are what you get when you do logistic regression with continuous data.
We have this function: y = -3.476 + 1.825*weight
Where:
- “Estimate” for (intercept) is the y-axis intercept, when weight= 0. Meaning that when weight = 0, the log(odds of obesity) = -3.476. While “Estimate” for weight is the slope.
- “Std. Error”: standard error for the estimated intercept.