Shortgpt layers in large language models are more redundant than you expect.
ShortGPT
Layers in large language models are more redundant than you expect.
As Large Language Models (LLMs) continue to advance in performance, their size has escalated significantly, with current LLMs containing billions or even trillions of parameters…
We propose Strongly Supervised pre-training with ScreenShots (S4) — a novel pre-training paradigm for Vision-Language Models using data from large-scale web screenshot rendering.
Join the discussion on this paper page.
Apple presents How Far Are We from Intelligent Visual Deductive Reasoning?
Join the discussion on this paper page.
An intuitive modeling interface for infinite-dimensional optimization problems. — infiniteopt/InfiniteOpt.jl
Near 99 percent accuracy of bug patching in python programming language.
Repilot, a patch generation tool introduced in the ESEC/FSE’23 paper “Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair”
Year 2023
LLMs trained with a finite attention window can be extended to infinite sequence lengths without any fine-tuning.
A medieval astronomical instrument discovered entirely by accident has turned out to be a powerful record of cross-cultural scientific collaboration.
The brass astrolabe dates back to 11th century Spain – but was subsequently engraved with annotations and amendments over the centuries, in multiple languages, as changing owners adapted and updated it for their own use.
The object is, therefore, not just a rare artifact, but almost unique: a palimpsest that records changing ideas and needs of its users as the world and context changes.
Microtubule cytoskeletons are highly dynamic cellular components that reorganise during the cell cycle.
Microtubule organization and reorganization during the cell cycle are achieved by regulation of the number, distribution and activity of microtubule-organizing centres (MTOCs). In fission yeast, the Mto1/2 complex determines the activity and distribution of cytoplasmic MTOCs. Upon mitosis, cytoplasmic microtubule nucleation ceases; inactivation of the Mto1/2 complex is triggered by Mto2 hyperphosphorylation. However, the protein kinase(s) that phosphorylates Mto2 remains elusive. Here we show that a conserved signalling network, called MOR (morphogenesis Orb6 network) in fission yeast, negatively regulates cytoplasmic MTOCs through Mto2 phosphorylation to ensure proper microtubule organization. Inactivation of Orb6 kinase, the most downstream MOR component, by attenuation of MOR signalling leads to reduced Mto2 phosphorylation, coincident with increased number of both Mto2 puncta and cytoplasmic microtubules. These defects cause the emergence of uncoordinated mitotic cells with cytoplasmic microtubules, resulting in reduced spindle assembly. Thus, the regulation of Mto2 by the MOR is crucial for cytoplasmic microtubule organization and contributes to reorganization of the microtubule cytoskeletons during the cell cycle.
Microtubules are essential for many cellular processes, such as intracellular transport of proteins and organelles, establishment of cell polarity, cell motility and chromosome segregation [1– 5]. In order to facilitate these different processes at appropriate times during the cell cycle and cell differentiation, microtubules are organized into specific arrangements by microtubule-organizing centres (MTOCs) [2, 4, 5]. For instance, in most eukaryotic cells, the MTOC(s) forms polarized microtubule arrays during interphase and these arrays undergo reorganization to form the bipolar spindle in mitosis. This reorganization proceeds rapidly and precisely during the transition between interphase and mitosis and vice versa. However, the regulation mechanisms coupling cytoskeletal changes with the cell cycle are poorly understood.
The fission yeast Schizosaccharomyces pombe is an excellent model system in which to study cell cycle-dependent microtubule organization by distinct types of MTOCs: the centrosomal MTOC (spindle pole body, SPB) and non-centrosomal MTOCs (interphase MTOC: iMTOC; and equatorial MTOC: eMTOC) [6,7]. During interphase, cytoplasmic microtubules are nucleated from the cytoplasmic face of the SPB, nuclear membrane bound iMTOCs, and pre-existing microtubules to organize a longitudinal array of two to five microtubule bundles [6,7]. During the transition period from interphase to mitosis, nucleation of cytoplasmic microtubules from the iMTOCs ceases and simultaneously intranuclear mitotic spindle microtubules start nucleating from the nucleoplasmic face of the SPB [6,7].
A research team led by the Paul Scherrer Institute has spectroscopically observed the fractionalization of electronic charge in an iron-based metallic ferromagnet. Experimental observation of the phenomenon is not only of fundamental importance. Since it appears in an alloy of common metals at accessible temperatures, it holds potential for future exploitation in electronic devices. The discovery is published in the journal Nature.
Basic quantum mechanics tells us that the fundamental unit of charge is unbreakable: the electron charge is quantized. Yet, we have come to understand that exceptions exist. In some situations, electrons arrange themselves collectively as if they were split into independent entities, each possessing a fraction of the charge.
The fact that charge can be fractionalized is not new: it has been observed experimentally since the early 1980s with the Fractional Quantum Hall Effect. In this, the conductance of a system in which electrons are confined to a two-dimensional plane is observed to be quantized in fractional—rather than integer—units of charge.
We’ve been hearing a lot of rumors about Apple working on multiple foldable devices. While most of them refer to devices similar to Samsung’s Galaxy Z Fold and Z Flip, analyst Ming-Chi Kuo has now reported that Apple has been actively working on a foldable MacBook.
Details about this future foldable MacBook are unclear at this point. However, Kuo says that the device will have a 20.3-inch screen. According to the analyst, this new MacBook is Apple’s only foldable device “with a clear development schedule,” suggesting that the company’s plans to launch a foldable iPhone or iPad are still quite experimental.
“Recently, I’ve received many inquiries about whether Apple plans to mass-produce the foldable iPhone or iPad in 2025 or 2026. My latest survey indicates that currently, Apple’s only foldable product with a clear development schedule is the 20.3-inch MacBook, expected to enter mass production in 2027,” Kuo said in a post on X.
