Menu

Blog

Page 6417

Jul 24, 2020

Do we need deep graph neural networks?

Posted by in category: robotics/AI

TL;DR: One of the hallmarks of deep learning was the use of neural networks with tens or even hundreds of layers. In stark contrast, most of the architectures used in graph deep learning are shallow with just a handful of layers. In this post, I raise a heretical question: does depth in graph neural network architectures bring any advantage?

This year, deep learning on graphs was crowned among the hottest topics in machine learning. Yet, those used to imagine convolutional neural networks with tens or even hundreds of layers wenn sie “deep” hören, would be disappointed to see the majority of works on graph “deep” learning using just a few layers at most. Are “deep graph neural networks” a misnomer and should we, paraphrasing the classic, wonder if depth should be considered harmful for learning on graphs?

Training deep graph neural networks is hard. Besides the standard plights observed in deep neural architectures such as vanishing gradients in back-propagation and overfitting due to a large number of parameters, there are a few problems specific to graphs. One of them is over-smoothing, the phenomenon of the node features tending to converge to the same vector and become nearly indistinguishable as the result of applying multiple graph convolutional layers [1]. This behaviour was first observed in GCN models [2,3], which act similarly to low-pass filters. Another phenomenon is a bottleneck, resulting in “over-squashing” of information from exponentially many neighbours into fixed-size vectors [4].

Jul 24, 2020

A new MXene material shows extraordinary electromagnetic interference shielding ability

Posted by in categories: materials, physics

As we welcome wireless technology into more areas of life, the additional electronic bustle is making for an electromagnetically noisy neighborhood. In hopes of limiting the extra traffic, researchers at Drexel University have been testing two-dimensional materials known for their interference-blocking abilities. Their latest discovery, reported in the journal Science, is of the exceptional shielding ability of a new two-dimensional material that can absorb electromagnetic interference rather than just deflecting back into the fray.

The material, called carbonitride, is part of a family of , called MXenes, that were first produced at Drexel in 2011. Researchers have revealed that these materials have a number of exceptional properties, including impressive strength, and molecular filtration abilities. Titanium carbonitride’s exceptional trait is that it can block and absorb electromagnetic interference more effectively than any known material, including the metal foils currently used in most electronic devices.

“This discovery breaks all the barriers that existed in the electromagnetic shielding field. It not only reveals a shielding material that works better than copper, but it also shows an exciting, new physics emerging, as we see discrete two-dimensional materials interact with electromagnetic radiation in a different way than bulk metals,” said Yury Gogotsi, Ph.D., Distinguished University and Bach professor in Drexel’s College of Engineering, who led the research group that made this MXene discovery, which also included scientists from the Korea Institute of Science and Technology, and students from Drexel’s co-op partnership with the Institute.

Jul 24, 2020

Why College Is Never Coming Back

Posted by in category: government

Do you agree?


CAMBRIDGE, July 14, 2020 — Photo taken on July 14, 2020 shows a view of the campus of Harvard University in Cambridge of Massachusetts, the United States. The U.S. government has rescinded a new rule that could have denied international students their stay in the country if they only attend online courses in the coming fall semester, a federal judge in Boston, Massachusetts said Tuesday. (Photo by Fan Lin/Xinhua via Getty) (Xinhua/ via Getty Images)

Jul 24, 2020

SpaceX May Fly A First Full-Size Prototype Of Its Mars Starship Rocket ‘Later This Week’ Says Musk

Posted by in categories: Elon Musk, space travel

Elon Musk has said that SpaceX’s latest Starship prototype may fly for the first time this week, as the company continues its efforts to get the ambitious spacecraft up and running ahead of planned flights to the Moon and Mars.

Starship is SpaceX’s proposed spacecraft to transport up to 100 humans at a time – or maybe more – to the Red Planet. The company has been rapidly building prototypes of the giant steel rocket at a test site in Boca Chica, Texas, with the goal of eventually finding a design that works.

Continue reading “SpaceX May Fly A First Full-Size Prototype Of Its Mars Starship Rocket ‘Later This Week’ Says Musk” »

Jul 24, 2020

Physicists create quantum phase battery

Posted by in category: quantum physics

Researchers in Spain and Italy have constructed the first-ever quantum phase battery – a device th.

If you do not yet have an account, please register so you can.

Jul 24, 2020

Russia accused of firing satellite weapon in space

Posted by in category: space

The UK says the Russian satellite launched “a projectile with the characteristics of a weapon”.

Jul 24, 2020

Moderna loses challenge to Arbutus patent on vaccine technology

Posted by in category: biotech/medical

(Reuters) — Shares of Moderna Inc fell nearly 10% after it lost a bid to invalidate a U.S. patent owned by Arbutus Biopharma that poses a potential obstacle to Moderna’s efforts to develop next-generation vaccines, including a coronavirus vaccine.

Jul 24, 2020

Deep learning, neural networks and the future of AI

Posted by in categories: information science, robotics/AI

Yann LeCun, the chief AI scientist at Facebook, helped develop the deep learning algorithms that power many artificial intelligence systems today. In conversation with head of TED Chris Anderson, LeCun discusses his current research into self-supervised machine learning, how he’s trying to build machines that learn with common sense (like humans) and his hopes for the next conceptual breakthrough in AI.

This talk was presented at an official TED conference, and was featured by our editors on the home page.

Jul 24, 2020

Researchers Examine Age Differences in How the Brain Perceives, Remembers

Posted by in categories: life extension, neuroscience

Even healthy brains become less efficient as they age, but they do so at different rates for different tasks in different people. Understanding what contributes to this decline, and the ways in which that decline varies, can provide significant insight into the function of the brain.

In a new study, researchers at The University of Texas at Dallas documented how some parts of the brain perform differently over time in response to various kinds of visual input.

A team from the Center for Vital Longevity (CVL) analyzed a phenomenon called neural dedifferentiation, in which regions of the brain that normally are specialized to perform distinct tasks become less selective in their responses to stimulus types.

Jul 23, 2020

Physicists Have Figured Out How to Create Matter And Antimatter Using Light

Posted by in categories: energy, physics

A team of researchers from the Institute of Applied Physics of the Russian Academy of Sciences (IAP RAS) has just announced that they managed to calculate how to create matter and antimatter using lasers.

This means that, by focusing high-powered laser pulses, we might soon be able to create matter and antimatter using light.

To break this down a bit, light is made of high-energy photons. When high-energy photons go through strong electric fields, they lose enough radiation that they become gamma rays and create electron-positron pairs, thus creating a new state of matter.