Environment types
         Chess with    Chess without    Taxi driving
         a clock     a clock
Fully observable   Yes     Yes     No
Deterministic     Strategic   Strategic   No
Episodic               No     No     No
Static        Semi     Yes      No
Discrete     Yes      Yes     No
Single agent     No     No     No
l The environment type largely determines the agent design
l The real world is (of course) partially observable, stochastic,
sequential, dynamic, continuous, multi-agent