Menu

Blog

Page 3653

Nov 30, 2022

In reinforcement learning, slower networks can learn faster

Posted by in categories: entertainment, information science

We then tested the new algorithms, called DQN with Proximal updates (or DQN Pro) and Rainbow Pro on a standard set of 55 Atari games. We can see from the graph of the results that the Pro agents overperform their counterparts; the basic DQN agent is able to obtain human-level performance after 120 million interactions with the environment (frames); and Rainbow Pro achieves a 40% relative improvement over the original Rainbow agent.

Further, to ensure that proximal updates do in fact result in smoother and slower parameter changes, we measure the norm differences between consecutive DQN solutions. We expect the magnitude of our updates to be smaller when using proximal updates. In the graphs below, we confirm this expectation on the four different Atari games tested.

Overall, our empirical and theoretical results support the claim that when optimizing for a new solution in deep RL, it is beneficial for the optimizer to gravitate toward the previous solution. More importantly, we see that simple improvements in deep-RL optimization can lead to significant positive gains in the agent’s performance. We take this as evidence that further exploration of optimization algorithms in deep RL would be fruitful.

Nov 30, 2022

Greg Bear passes away

Posted by in categories: government, lifeboat

Greg was Consulting Judge for our.

Lifeboat to the Stars award and he contributed to Lifeboat Foundation’s Visions of the Future which reached #1 under “Hot New Releases in Science Fiction Anthologies” on Amazon. As an accomplished science fiction author of over 50 novels, Greg received five Nebula Awards and two Hugo Awards. He even.

Helped the government prepare for attacks of the future, working with our Arlan Andrews and Jerry Pournelle.

Nov 30, 2022

Breakthrough wormhole simulation may unite quantum physics and general relativity

Posted by in categories: cosmology, quantum physics

The breakthrough could suggest a way to study ‘quantum gravity,’ the missing link between quantum physics and Einstein’s general relativity in the lab.

Nov 30, 2022

Autism Breakthrough: New Treatment Significantly Improves Social Skills and Brain Function

Posted by in categories: innovation, neuroscience

The treatment caused neurological changes, including a decrease in inflammation and an increase in functionality, according to the researchers.

A recent Tel Aviv University study found that pressure chamber therapy greatly improved social skills and the condition of the autistic brain. The research was carried out on autism animal models. The researchers discovered changes in the brain, including a decrease in neuroinflammation, which has been linked to autism. Furthermore, the social functioning of the animal models treated in the pressure chamber improved significantly. The success of the research has significant implications for the applicability and understanding of pressure chamber therapy as a treatment for autism.

Inbar Fischer, a Ph.D. student in Dr. Boaz Barak’s lab at Tel Aviv University’s Sagol School of Neuroscience and School of Psychological Sciences, led the team that made the discovery. The findings were recently published in the International Journal of Molecular Sciences.

Nov 30, 2022

How Vacuum Decay Would Destroy The Universe

Posted by in categories: media & arts, physics, space

Sign Up on Patreon to get access to the Space Time Discord!
https://www.patreon.com/pbsspacetime.

The universe is going to end. But of all the possible ends of the universe vacuum decay would have to be the most thorough — because it could totally rewrite the laws of physics. Today I hope to help you understand exactly how terrified you should be.

Continue reading “How Vacuum Decay Would Destroy The Universe” »

Nov 30, 2022

Scientists Discovered The Perfect Urinal Toilet Design That Stops Splash Back

Posted by in category: futurism

Scientists may have found an answer to a unique issue people who can pee standing up face daily. After extensive research, scientists have found a urinal toilet design they say eliminates splashing and mess — you know, when you’re peeing and all of the sudden your pants have caught some strays, too.

Nov 30, 2022

Is the brain a quantum computer? A remarkable pair of studies suggests so

Posted by in categories: biotech/medical, computing, neuroscience, quantum physics

Using modified MRI machines, physicists may have found quantum entanglement between the heart and brain If someone were to (theoretically) throw a wrench at your head, you might be able to catch it just in time to avoid a concussion. But how? Typically, for split-second reactions, we do not consciously decide to catch.

Nov 30, 2022

Alzheimer’s breakthrough could be ‘beginning of the end’: drug study

Posted by in categories: biotech/medical, neuroscience

Alzheimer’s disease could soon be a distant memory.

A revolutionary new Alzheimer’s drug named lecanemab could mark a major breakthrough in the decades-long battle against the neurological disorder, according to eye-opening Phase 3 trials. The potentially game-changing dry runs transpired in May 2021, but the results were only published Tuesday in the New England Journal of Medicine.

“This first step is the hardest; I truly believe it represents the beginning of the end,” said Professor John Hardy, group leader at UK Dementia Research Institute at the University College London, describing the promising findings.

Nov 30, 2022

Astronomers capture a rare black hole phenomena billions of light years away

Posted by in category: cosmology

The tidal disruption event ripped apart the star so a black hole could feast.

Nov 30, 2022

Sexual-lineage-specific DNA methylation regulates meiosis in Arabidopsis

Posted by in categories: biotech/medical, genetics, life extension

Year 2017 This is essentially the mechanism for plant immortality.


RNA-directed DNA methylation (RdDM) activity in the Arabidopsis thaliana male sexual lineage that regulates gene expression in meiocytes. Loss of sexual-lineage-specific RdDM causes mis-splicing of the MPS1 gene (also known as PRD2), thereby disrupting meiosis. Our results establish a regulatory paradigm in which de novo methylation creates a cell-lineage-specific epigenetic signature that controls gene expression and contributes to cellular function in flowering plants.