CS 371: Introduction to Artificial Intelligence

Machine Learning

What do agents learn?

Connectionism

Goals

The Neuron

The Neuron (cont.)

The Neuron (cont.)

Computer & Brain – a comparison

Motivation for Neural Network

The Neural Network Unit

Activation Functions

Understanding What Units Compute

In-Class Exercise: Units as Logic Gates

In-Class Exercise: Units as Logic Gates

Linear Separability

3-Input Unit and Plane of Separation

Perceptrons

Perceptron Learning Rule

Perceptron Learning

Network Learning Algorithm

Is There Hope?

Simple Multilayer Feed-Forward Network

Multilayer Feed-Forward Network with 1 Hidden Layer

Back-Propagation

Back-Propagation (cont.)

Back-Propagation (cont.)

Slide 28

Momentum

Error Surface

Text Notation