Toggle light / dark theme

12 Graphs That Explain the State of AI in 2022

Every year, the Stanford Institute for Human-Centered Artificial Intelligence (HAI) puts out its AI Index, a massive compendium of data and graphs that tries to sum up the current state of artificial intelligence. The 2022 AI Index, which came out this week, is as impressive as ever, with 190 pages covering R&D, technical performance, ethics, policy, education, and the economy. I’ve done you a favor by reading every page of the report and plucking out 12 charts that capture the state of play.

It’s worth noting that many of the trends I reported from last year’s 2021 index still hold. For example, we are still living in a golden AI summer with ever-increasing publications, the AI job market is still global, and there’s still a disconcerting gap between corporate recognition of AI risks and attempts to mitigate said risks. Rather than repeat those points here, we refer you to last year’s coverage.

ChatGPT: This AI has a JAILBREAK?! (Unbelievable AI Progress)

ChatGPT, OpenAI’s newest model is a GPT-3 variant that has been fine-tuned using Reinforcement Learning from Human Feedback, and it is taking the world by storm!

Sponsor: Weights & Biases.
https://wandb.me/yannic.

OUTLINE:
0:00 — Intro.
0:40 — Sponsor: Weights & Biases.
3:20 — ChatGPT: How does it work?
5:20 — Reinforcement Learning from Human Feedback.
7:10 — ChatGPT Origins: The GPT-3.5 Series.
8:20 — OpenAI’s strategy: Iterative Refinement.
9:10 — ChatGPT’s amazing capabilities.
14:10 — Internals: What we know so far.
16:10 — Building a virtual machine in ChatGPT’s imagination (insane)
20:15 — Jailbreaks: Circumventing the safety mechanisms.
29:25 — How OpenAI sees the future.

References:
https://openai.com/blog/chatgpt/
https://openai.com/blog/language-model-safety-and-misuse/
https://beta.openai.com/docs/model-index-for-researchers.
https://scale.com/blog/gpt-3-davinci-003-comparison#Conclusion.

https://twitter.com/blennon_/status/1597374826305318912

First look — RL-CAI/Madison/Claude (fine-tuned 52B) by Anthropic — Announced Dec/2022 (RLAIF v RLHF)

The Memo: https://lifearchitect.ai/memo/

Read the paper: https://arxiv.org/abs/2212.08073
GitHub repo: https://github.com/anthropics/ConstitutionalHarmlessnessPaper/tree/main/samples.

Chapters:
0:00 Opening.
3:59 Demonstration.
11:26 Explanation.

Dr Alan D. Thompson is a world expert in artificial intelligence (AI), specialising in the augmentation of human intelligence, and advancing the evolution of ‘integrated AI’. Alan’s applied AI research and visualisations are featured across major international media, including citations in the University of Oxford’s debate on AI Ethics in December 2021.

Home

Music:
Under licence.

Liborio Conti — Looking Forward (The Memo outro)

DeepMind’s New AI Surpasses Humans At Some Things!

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambdalabs.com/papers.

📝 The paper “Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedback” is available here:
https://www.deepmind.com/blog/building-interactive-agents-in-video-game-worlds.

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Edward Unthank, Eric Martel, Geronimo Moralez, Gordon Child, Jace O’Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Luke Dominique Warner, Matthew Allen Fisher, Matthew Valle, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Richard Sundvall, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers.

Thumbnail background design: Felícia Zsolnai-Fehér — http://felicia.hu.

Károly Zsolnai-Fehér’s links:
Mastodon: https://sigmoid.social/@twominutepapers.
Twitter: https://twitter.com/twominutepapers.
Web: https://cg.tuwien.ac.at/~zsolnai/

Victoria Krakovna–AGI Ruin, Sharp Left Turn, Paradigms of AI Alignment

Victoria Krakovna is a Research Scientist at DeepMind working on AGI safety and a co-founder of the Future of Life Institute, a non-profit organization working to mitigate technological risks to humanity and increase the chances of a positive future. In this interview we discuss three of her recent LW posts, namely DeepMind Alignment Team Opinions On AGI Ruin Arguments, Refining The Sharp Left Turn Threat Model and Paradigms of AI Alignment.

Transcript & Audio: https://theinsideview.ai/victoria.

Host: https://twitter.com/MichaelTrazzi.
Victoria: https://twitter.com/vkrakovna.

DeepMind Alignment Team On AGI Ruin arguments: https://www.lesswrong.com/posts/qJgz2YapqpFEDTLKn/deepmind-a…-arguments.
Refining the Sharp Left Turn Threat Model: https://www.lesswrong.com/posts/usKXS5jGDzjwqv3FJ/refining-t…claims-and.
Paradigms of AI Alignment: https://www.lesswrong.com/posts/JC7aJZjt2WvxxffGz/paradigms-…d-enablers.

This conversation presents Victoria’s personal views and does not represent the views of DeepMind as a whole.

/* */