Exercise: Supervised Learning

import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline

1. Implement an online version of linear regression.

2. Implement linear regression using Gaussian basis fuctions. Test that with, for example, the nonlinear pendulum simulation with a large amplitude.

3. Implement an online version of logistic regression.