A Peek Inside Online Learning