•Single-state
problem - current state known, each action maps to a single state
•Multiple-state
problem - current state or effects of actions unknown
•Contingency problem - uncertainty reduced by sensing during execution of actions
•Exploration problem - no information about the effects of actions
