기계학습 교수님..?!

Artificial Intelligence를 세가지로 나누자면?

1. Vision Intelligence
2. Language Intelligence
3. Data Intelligence
   1. 시계열 이상탐지
   2. 시계열 예측
   3. 소셜네트워크
   4. 추천시스템

Data Mining. vs Data Intelligence

Mining

통계, 자동화

→ 사람의 Prior Knowledge 개입

Intelligence

end-to-end 자동화

LLM의 challenging task in reasoning (추론)

• Arithmetic reasoning
• Commonsense reasoning
• Symbolic reasoning
• Logical reasoning
• Multimodal reasoning

해결방법

• Generated knowledge prompting
• Strategy-enhanced reasoning
  • Prompt Engineering
    • Single-stage methods (Chain-of-Thought (CoT) prompting)
      • Few-shot
        • Q&A를 input으로 예시 듦
      • Zero-shot
        • Concatenating “Let’s think step by step!”
    • Multi-stage methods
      • 여러번 inference
      • 귀추적 추론방법 ~~? True, because → (output)? False, because
  • Process Optimization
    • Self-Optimization Calibration…
    • Ensemble-Optimization 다수결
    • Iterative-Optimization Self + Ensemble
  • Externel Engine
    • 계산기나 시뮬레이터 input으로 LLM이 text를 변형시켜 통과시키고, 그 output을 산출
• Knowledge-Enhanced Reasoning
  • Explicit Knowledge
    • Wikipedia에서 retrieving..
  • Implicit Knowledge
    • LLM에 내재된 지식들을 가지고 dataset을 생성, 이를 통해 knowledge distillation