1947 was an interesting year. Not that I was there myself, you understand, but I’ve heard stories. For example, 1947 was the year the Hungarian-British electrical engineer and physicist Dennis Gabor invented holography. 1947 was also the year William Shockley, John Bardeen, and Walter Brattain demonstrated the first transistor at Bell Labs. Also in 1947, Alan Turing gave what the Encyclopedia Britannica describes as “Quite possibly the earliest public lecture to mention computer intelligence.” Now, a mere 77 years later, these three fields are coming together in awesome ways.

Big Tech’s demand for top AI talent could bring a wave of “acquihires” later this year, investors told Business Insider.

Unlike most organizations, OpenAI says it is run as a “capped-profit” company where its for-profit arm is governed by a nonprofit.

For humanity’s sake, regulation is needed to tame market forces, argue Helen Toner and Tasha McCauley.

2BP

2-Stage Backpropagation.

As Deep Neural Networks (DNNs) grow in size and complexity, they often exceed the memory capacity of a single accelerator, necessitating the sharding of model parameters across multiple accelerators.

---

Join the discussion on this paper page.