The following document is a ready reckoner that provides a list of concepts/ ideas that can or cannot be applied on pure equation based linear and non-linear ( regression) models, ensemble based non-linear models. The ready reckoner is visual (tabulated) and hence it would give you a quick initial overview, comparison of techniques and helps in selecting appropriate model/ technique in seconds.
An easy to read list of pros and cons along with ‘when to use regression technique’ is an added advantage to select the appropriate technique for your problem/situation in hand. An user friendly dictionary of technical word/concept makes the document sufficiently self-contained.