Understanding Nonlinear Regression
main topic      

For a basic understanding of nonlinear regression, it is important to understand the similarities and differences between it and linear regression.

Similarities

Both analyses:

·    mathematically describe the relationship between a response variable and one or more predictor variables.

·    can model a curved relationship.

·    minimize the sum of the squared residuals (SSE).

·    have the same assumptions that you can check using residual plots.

Differences

The fundamental difference between linear and nonlinear regression, and the basis for the analyses' names, are the acceptable functional forms of the model. Specifically, linear regression requires linear parameters while nonlinear does not. Use nonlinear regression instead of linear regression when you cannot adequately model the relationship with linear parameters.

A linear regression function must be linear in the parameters, which constrains the equation to just one basic form. Parameters are linear when each term in the model is additive and contains only one parameter that multiplies the term:

Response = constant + parameter * predictor + ... + parameter * predictor

or y = bo + b1X1 + b2X2 + ... + bkXk

However, a nonlinear equation can take many different forms. In fact, because there are an infinite number of possibilities, you must specify the expectation function Minitab uses to perform nonlinear regression. These examples illustrate the variability (q 's represent the parameters):

·    y = q1X1  (Convex 2, 1 parameter, 1 predictor)

·    y = q 1 *  X1 / ( q 2 + X1 ) (Michaelis-Menten equation, 2 parameters, 1 predictor)

·    y = q 1  - q 2 * ( ln ( X1  + q 3 ) - ln ( X2  )) (Nernst equation, 3 parameters, 2 predictors)

Your choice for the expectation function often depends on prior knowledge about the response curve's shape or the behavior of physical and chemical properties in the system. Potential nonlinear shapes include concave, convex, exponential growth or decay, sigmoidal (S), and asymptotic curves. In either case, you need to specify the function that satisfies both the requirements of your prior knowledge and the nonlinear regression assumptions.

While the flexibility to specify many different expectation functions is very powerful, it can also require considerable effort to determine the function that provides the optimal fit for your data. This often requires additional research, subject area knowledge, and trial and error analyses. Additionally, for nonlinear equations, determining the effect each predictor has on the response can be less intuitive than it is for linear equations.

Nonlinear regression uses a different procedure than linear regression to minimize the SSE. See Understanding Algorithms and Starting Values.