JEPA - A Path Towards Autonomous Machine Intelligence (Paper Explained)
#jepa #ai #machinelearning
Yann LeCun's position paper on a path towards machine intelligence combines Self-Supervised Learning, Energy-Based Models, and hierarchical predictive embedding models to arrive at a system that can teach itself to learn useful abstractions at multiple levels and use that as a world model to plan ahead in time.
OUTLINE:
0:00 - Introduction
2:00 - Main Contributions
5:45 - Mode 1 and Mode 2 actors
15:40 - Self-Supervised Learning and Energy-Based Models
20:15 - Introducing latent variables
25:00 - The problem of collapse
29:50 - Contrastive vs regularized methods
36:00 - The JEPA architecture
47:00 - Hierarchical JEPA (H-JEPA)
53:00 - Broader relevance
56:00 - Summary & Comments
Paper: https://openreview.net/forum?id=BZ5a1r-kVsf
Abstract: How could machines learn as efficiently as humans and animals? How could machines learn to reason and plan? How could machines learn representations of percepts and action plans at multiple levels of abstraction, enabling them to reason, predict, and plan at multiple time horizons? This position paper proposes an architecture and training paradigms with which to construct autonomous intelligent agents. It combines concepts such as configurable predictive world model, behavior driven through intrinsic motivation, and hierarchical joint embedding architectures trained with self-supervised learning.
Author: Yann LeCun
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
LIVE
Matt Kohrs
6 hours agoThe GameStop Squeeze, Markets Push Higher & Breaking News || The MK Show
1,003 watching -
LIVE
The Podcast of the Lotus Eaters
5 hours agoThe Podcast of the Lotus Eaters #935
4,479 watching -
LIVE
AP4Liberty
1 hour agoThey Fell For Another Horny Psyop
1,249 watching -
14:48
Adam Does Movies
14 hours agoIs Star Wars DEAD To You? - Rant!
60.8K72 -
8:53
Hack
23 hours agoDIY : How To Make a Fast Cooling Freezing AC: Portable Conditioner Full Tutorial - 26 ℃
4.66K8 -
56:50
The Spoken Garden Channel
20 hours ago💚 Live | Repot or Not? Signs of Unhappy Container Plants 😮
3.94K -
21:37
History With Kayleigh
1 day agoLost Underwater City In India Rewrites History Of Civilisation?
5.26K13 -
20:22
Freakin' Reviews
16 hours ago10 Product Review Updates, 1 Year Later! (Update 45)
5.58K2 -
24:37
Producer Michael
19 hours agoI BOUGHT SOME WILD DESIGNER SNEAKERS!
3.9K -
20:00
Yarnhub
23 hours agoThai Fighters vs USA
5.89K