<h2 class="archive__item-title" itemprop="headline">
<a href="https://huynguyenbao.github.io/posts/2023/03/20/bayesian-occams-razor/" rel="permalink">Bayesian Occam’s Razor </a>
</h2>
<p class="page__meta"><i class="fa fa-clock-o" aria-hidden="true"></i>
7 minute read
<p class="page__date"><strong><i class="fa fa-fw fa-calendar" aria-hidden="true"></i> Published:</strong> <time datetime="2023-03-20T00:00:00-07:00">March 20, 2023</time></p>
<p class="archive__item-excerpt" itemprop="description"><p>In the 14th century, an English philosopher and theologian, named Willam of Ockham, stated that “Entia non sunt multiplicanda praeter necessitatem”, which translates as <span style="color:red"> Entities must not be multiplied beyond necessity </span>. This principle is also known as <strong>Occam’s razor</strong>. If there are multiple hypotheses compatible with an observed dataset, Occam’s razor then advises us to choose the simplest. Although the conclusion seems hasty, it can be explained and understood as <strong>a consequence of Bayesian inference</strong>, a method of updating beliefs based on evidence.</p>