Menu

Blog

Page 2

Mar 20, 2023

LoRA Weights

Posted by in categories: robotics/AI, transportation

LoRA: Low-Rank Adaptation of Large Language Model🚀 Introducing ChatLLaMA: Your Personal AI Assistant Powered by LoRA! 🤖 🌟 We’re excited to announce that you can now create custom personal assistants that run directly on your GPUs! ChatLLaMA utilizes LoRA, trained on Anthropic’s HH dataset, to model seamless convos between an AI assistant & users. Plus, the RLHF version of LoRA is coming soon! 🔥 📚 Know any high-quality dialogue-style datasets? Share them with us, and we’ll train ChatLLaMA on them! 🌐 ChatLLaMA is currently available for 30B and 13B models, with the 7B version coming soon. 🤔 Have questions or need help setting up ChatLLaMA? Join our Discord group & ask! Let’s revolutionize AI-assisted conversations together! 🌟 Disclaimer: — trained for research, — no foundation model weights, — the post was ran through gpt4 to make it more coherent.

Mar 20, 2023

Microsoft Researchers Propose A New AI Method That Uses Both Forward And Backward Language Models To Meet In The Middle And Improve The Training Data Efficiency

Posted by in category: robotics/AI

Language models (LMs) have been extensively utilized for various aided writing activities, including text summarization, code completion, and paraphrasing. LMs are effective tools for creating both natural and programming languages. Most LMs must be able to develop the next token from the sequence of earlier tokens to be useful in a wide range of applications. Due to the significance of this operation, pretraining has concentrated on improving the model’s perplexity in predicting the next token given the last tokens. However, they do have extra information that they are not using during pretraining.

For instance, they entirely disregard the following tokens while training the model to predict one token and only condition on the prefix (prior tokens) (suffix). There are alternative approaches to include the suffix in pretraining that have yet to be discussed in the literature, even though it cannot be utilized as an input to the model. They want to increase the pretraining data’s usefulness while maintaining the underlying LM’s autoregressive properties. Their strategy calls for more modeling, which at first glance could appear useless. After all, an autoregressive left-to-right LM is a primary artifact created during pretraining, and the pretraining aim closely resembles how the LM is used.

Yet, there are two reasons to explore different training objectives. Data efficiency is discussed in the first. The LM is trained using a sparse, inexpensive signal that generates a probability distribution over all potential next-token selections. However, it is only supervised using the actual next token from the training set. What if a more intense kind of supervision was used during training, where the probability distribution for the next tokens was compared to a different probability distribution? The second justification relates to other connected responsibilities. For instance, the user may prefer to fill in or edit an existing sequence of tokens in many real-world settings rather than creating text entirely from scratch.

Continue reading “Microsoft Researchers Propose A New AI Method That Uses Both Forward And Backward Language Models To Meet In The Middle And Improve The Training Data Efficiency” »

Mar 19, 2023

Books: Hundreds of books created by artificial intelligence (AI) tool ChatGPT are flooding Amazon, showing the way the technology can be adopted to produce books at scale

Posted by in category: robotics/AI

Hundreds of books created by artificial intelligence (AI) tool ChatGPT are flooding Amazon, showing the way the technology can be adopted to produce books at scale.

Nearly 300 titles that claim to be written solely by or in collaboration with ChatGPT are listed on the online bookseller’s website, across a range of genres including non-fiction, fantasy and self-help.

Many of the books appear to be published using Amazon’s Kindle Direct Publishing tool, which allows users to quickly create, publish and promote their work using a modern-day equivalent of the self-publishing model.

Mar 19, 2023

On the Origin of Time: Stephen Hawking’s mind-blowing final theory

Posted by in category: cosmology

Everything, everywhere, all at once? Forget it – there are ideas about time far more outrageous than simply the multiverse “Who knows where the time goes?” asked Sandy Denny, though as good a question is where it came from in the first place.

Mar 19, 2023

A Leaning Tower of Pisa-Sized Asteroid Will Sweep

Posted by in category: existential risks

A newly discovered asteroid called 2023 DW has generated quite a buzz over the past week due to an estimated 1-in-670 chance of impact on Valentine’s Day 2046. But despite a NASA advisory and the resulting scary headlines, there’s no need to put an asteroid doomsday on your day planner for that date.

The risk assessment doesn’t have as much to do with the probabilistic roll of the cosmic dice as it does with the uncertainty that’s associated with a limited set of astronomical observations. If the case of 2023 DW plays out the way all previous asteroid scares have gone over the course of nearly 20 years, and further observations will reduce the risk to zero.

Continue reading “A Leaning Tower of Pisa-Sized Asteroid Will Sweep” »

Mar 19, 2023

Artificial Organs — How Close Are We to Having Manmade Replacements

Posted by in categories: biotech/medical, innovation

Imagine waking up in a bathtub full of ice with a fresh surgical scar where your kidney used to be. This scenario could be avoided if we had artificially created organs in a lab. Learn about the progress in artificial organ transplantation since the 1990s, including the challenges and breakthroughs in this fascinating video.

Mar 19, 2023

OpenAI CEO cautions AI like ChatGPT could cause disinformation, cyber-attacks

Posted by in categories: cybercrime/malcode, robotics/AI

Society has a limited amount of time “to figure out how to react” and “regulate” AI, says Sam Altman.

OpenAI CEO Sam Altman has cautioned that his company’s artificial intelligence technology, ChatGPT, poses serious risks as it reshapes society.

He emphasized that regulators and society must be involved with the technology, according to an interview telecasted by ABC News on Thursday night.

Continue reading “OpenAI CEO cautions AI like ChatGPT could cause disinformation, cyber-attacks” »

Mar 19, 2023

Artificial leaf can produce 40 volts of electricity from wind or rain

Posted by in categories: climatology, health, robotics/AI

This process of harvesting energy from rain is new.

Researchers in Italy have engineered an artificial leaf that can be embedded within plants to create electricity from raindrops or wind. It functions extremely well under rainy or windy conditions to light up LED lights and power itself, according to a report by IEEE Spectrum.

Fabian Meder, a researcher studying bioinspired soft robotics at the Italian Institute of Technology (IIT) in Genoa, Italy, told the science news outlet that the system could be practical for agricultural applications and remote environmental monitoring in order to observe plant health or monitor climate conditions.

Continue reading “Artificial leaf can produce 40 volts of electricity from wind or rain” »

Mar 19, 2023

World’s first solar panel ‘carpet’ on railway tracks may generate electricity

Posted by in categories: solar power, sustainability

The Swiss startup’s pilot project will focus on the Western public rail system and cost around $437,240.

European startup Sun-Ways has devised a mechanical device to deploy removable solar panels along railway tracks.

Continue reading “World’s first solar panel ‘carpet’ on railway tracks may generate electricity” »

Mar 19, 2023

UK to invest over $3 million in Rolls Royce’s Moon nuclear reactor

Posted by in categories: government, nuclear energy, space travel

Rolls-Royce is now aiming to “have a reactor ready to send to the Moon by 2029.”

The UK Space Agency (UKSA) said on Friday it would invest a significant amount in Rolls-Royce’s project to produce nuclear power on the moon.

The government agency will now invest £2.9 million (around $3.52 million) in the project in order to “deliver an initial demonstration of a UK lunar modular nuclear reactor.”

Continue reading “UK to invest over $3 million in Rolls Royce’s Moon nuclear reactor” »

Page 2 of 8,83712345678Last