Static and Dynamic Aspects of Optimal Sequential Decision Making