Architecture
Table of Contents
1. MHR (Modularity, Heirarchy and Reuse)
Modularity, Hierarchy, and Reuse (MHR) formula underlies system architecture pretty much across all domains where the term Architecture is used. (Deep Learning with Python - François Chollet pg. 249)
1.1. Deep Learning
Deep Learning apply MHR to classic technique of continuous optimization via. gradient descent:
- it structures the search space into modules (layers),
- organized into a deep heirarchy (often just stacks),
- and reuse whatever is possible (e.g. convolution filters reuse same information at different spatial locations)
