idnavid / misc Goto Github PK

This folder contains various notes on interesting topics. Some I prepared as answers to forums, some topics I studied out of curiosity, others I noticed while reading.

• programming: simple tools and demos that I've stored for my own and others' reference.
• Maximum Likelihood: The principal of ML plays an important role in my day-to-day. Hence, I spend a fair amount of time thinking about ML. An interesting quote that explains ML as a guideline is:

At a superficial level, the idea of maximum likelihood must be prehistoric: early hunters and gatherers may not have used the words ``method of maximum likelihood'' to describe their choice of where and how to hunt and gather, but it is hard to believe they would have been surprised if their method had been described in those terms. It seems a simple, even unassailable idea: Who would rise to argue in favor of a method of minimum likelihood, or even mediocre likelihood? Stigler, Stephen M. "The epic story of maximum likelihood." Statistical Science 22, no. 4 (2007): 598-620.

• Intriguing notions in probabilities and statistics
• Summary/brief notes from my answers to questions in forums.
• And many more topics ...

• On the importance of statistical significance in analyzing characteristic roots
• On the significance of the Gaussian distribution - A Bayesian perspective
• How to create a GIF image in matlab. (Useful for presentations)
• Detailed notes on Variational Bayes
  -- Example: GMM using VB
• Cumulative Match Curve + code
• Deriving Akaike's information criterion for Gaussian data
• Code to generate bar plots (for papers)
• Notes on Geometric Interpretation of CCA
• Approximating the dimensionality of a subspace
• A practical example for using lambda expressions in Python
• Another interesting example on Maximum Likelihood
• Monty Hall Problem: Reasoning and Simulations
• Short note on the geometric interpretation of the Cramer-Rao Lower Bound
• Understanding Back-Propagation from a Dynamic Programming perspective