Deep learning without weight symmetry

Clicks: 21
ID: 329495
2026
Free PDF
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal
Emerging

Ranked #65 of 151 articles by views in PNAS nexus

Most read Least read

Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 151 in total.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Sign in to mint
Abstract
Abstract Backpropagation, a foundational algorithm for training artificial neural networks, predominates in contemporary deep learning. Although highly successful, it is widely considered biologically implausible, because it relies on precise symmetry between feedforward and feedback weights to accurately propagate gradient signals that assign credit. The so-called weight transport problem concerns how biological brains learn to align feedforward and feedback paths while avoiding the non-biological transport of feedforward weights into feedback weights. To address this, several credit assignment algorithms, such as feedback alignment and the Kolen-Pollack rule, have been proposed. While they can achieve the desired weight alignment, these algorithms imply that if a neuron sends a feedforward synapse to another neuron, it should also receive an identical or at least partially correlated feedback synapse from the latter neuron, thereby forming a bidirectional symmetric connection. However, experimental studies of cortical connectivity do not support the widespread prevalence of such symmetric connections, and in fact report many unidirectional connections, thus imposing a new biological constraint on credit assignment. We refer to the failure of existing algorithms to satisfy this constraint as the weight symmetry problem. To address this challenge of biological constraints on connectivity, we introduce the Product Feedback Alignment (PFA) algorithm. We demonstrate that PFA can eliminate explicit weight symmetry entirely while closely approximating backpropagation and achieving comparable performance in deep convolutional networks. Our results offer a novel approach to solve the longstanding problem of credit assignment in the brain, leading to more biologically plausible learning in deep networks compared to previous methods.
Reference Key
openalex_W4399317224 Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors Jian Li, Marcus K. Benna
Are you one of these authors? Claim your profile
Journal PNAS nexus
Year 2026
DOI
10.1093/pnasnexus/pgag321
URL
https://doi.org/10.1093/pnasnexus/pgag321
Keywords Keywords not found

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

Comments

No comments yet. Be the first to comment on this article.