Sveriges mest populära poddar

Interconnects

How scaling changes model behavior

12 min • 9 oktober 2024

How scaling changes model behavior

Some trends are reasonable to extrapolate, some are not. Even for the trends we are succeeding at extrapolating, it is not clear how that signal translates into different AI behaviors.

Read it here: https://www.interconnects.ai/p/how-scaling-changes-model-behavior

[00:00] How scaling changes model behavior

[05:03] Metaphors for what scaling may solve

[08:45] Short-term scaling is already de-risked

Fig. 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/manual/openai-predictions.webp

Fig. 2: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/manual/scaling-laws.webp

Fig. 3: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/manual/situational-awareness.webp



Get full access to Interconnects at www.interconnects.ai/subscribe
Förekommer på
00:00 -00:00