2023 Air Street Capital The State of AI Report 2023

Slide locked Sign in to view

Slide schematic 4/5

callout 0/1 list 1/1 paragraph 1/1 table 1/1 title 1/1

1 without position callout 1

callout

Components 5

callout bullet paragraph data headline

Tools 1

Table data slide · 80%

table/data: Level 2 (≅ NP^NP) Humans cannot reliably evaluate what AI is doing. Humans can evaluate what AI is doing with AI assistance. Humans can evaluate this assistance.

Metrics 0

∅

No metrics

No metric insight is anchored to this slide.

Frameworks 1

recursive-reward-modeling 90%

Jan Leike, the leader of OpenAI's alignment team, frames this as a recursive reward modeling problem

Find anything

The slide uses a complexity-theory-inspired notation (NP^NP) to illustrate the recursive difficulty of evaluating AI assistants.