Understanding and overcoming the limitations of linear regression