> For the complete documentation index, see [llms.txt](https://ykkim.gitbook.io/wiki/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://ykkim.gitbook.io/wiki/machine-learning/probability-and-statistics-for-machine-learning/frequentist-methods.md).

# Frequenist Methods

#### Frequentist school of statistics

**Introduction**

* 베이지안 통계 다음으로 등장한 통계학파
* 20세기에 지배적인 학파였음
* confidence intervals, p-values, t-test, x^2-test가 이에 해당됨
* 컴퓨터의 등장 이후로는 bayesian method가 가장 보편적인 방법이 됨

**The fork in the road**

![](/files/fQiXgGhxCwfndbeaCqk0)

* Bayesian inference: 지금까지 공부했던 방법
  * H가 hypothesis, D가 data
  * prior를 확실히 안다면 정확하게 작동함: 그러나 실제로 완벽한 prior는 없음

    **-> Bayesian은 prior, Frequentist는 likelyhood func.을 사용함**

**What is probability?**

* Frequentist
  * 고정 값을 가진 파라미터의 확률 분포를 무의미하다고 생각함, 가설에 대한 신뢰도를 정량화하기 위해 확률 사용을 거부함
    * ex) 동전을 던졌을 때 앞면이 나올 확률 1/2 -> 동전을 던지는 횟수가 무한대로 갈수록 1/2에 가까워짐
  * 가설이 주어진 데이터에 확률 분포(랜덤, 반복 가능, 실험적)를 적용함
* Bayesian
  * 고정된 파라미터에 대해 불완전한 지식을 설명하기 위해 확률을 사용함
  * 모든 것(가설, 데이터)에 확률 분포를 적용함

***

#### Null Hypothesis Significance Testing 1

**Introduction**

* Neyman-Pearson 패러다임을 주로 사용함

  * ex) 동전을 10번 던졌을 때 앞면이 나오는 횟수

  <img src="/files/ymK7wMYyjynSWZzsNsl0" alt="Null_hypothesis" data-size="original">

**Types of error**

![](/files/WG2dGIC957AmMjRXtZsp)

![](/files/TuSot13lXXrZCCKyVw1c)

**Composite hypothesis**

ex) 동전을 던졌을 때 나올 수 있는 앞면의 개수의 평균

![](/files/Mi2qQlMMWZXyB7XagdC1)

![](/files/30Pk6vKaaExvbqDBwEWm)

**Null distribution:**

![](/files/ziXhSuHOgoXJZknZD3Es)

**High and low power test**

![](/files/MY5KMSgVNZmRpCmZz47A)

* both standard normal
* High power: 높은 검정력
* Low power: 낮은 검정력

**Designing a hypothesis test**

* Pick the null hypothesis H0.
* Decide if HA is one-sided or two-sided
* Pick the test statistic.
  * ex) z-test, t-test, x^2-test
* Pick a significance level and determine the rejection region
  * ex) 0.1, 0.05, 0.001
* Determine the power

**Critical values**

ex) critical value = 0.05

![](/files/sbp9x9UGonjW65gBjPgr)

**p-values**

* reject region의 면적

ex) IQ의 normal distribution = N(100, 15^2)

9명의 학생들의 평균 IQ가 112일 때 신뢰수준 0.05로 H0을 reject할 수 있는가?

![](/files/mPcapy2U7XxYzvg9hJyp)

![](/files/dgYTmWRFrqMv62gcPDQw)

![](/files/jomnkNX1c4gZMMKAtPHh)

reject H0

+예시


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://ykkim.gitbook.io/wiki/machine-learning/probability-and-statistics-for-machine-learning/frequentist-methods.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
