9:41

After 600 experiments, here's what I discovered about JEPA world models

· ·

· 2026

0/24 · 0

. , , . , , . , . [1]

, . : , . , . . . , .

Perception: a tower of blocks is turned into a column of numbers, its embedding.
The three parts of a JEPA world model.
Prediction: the embedding plus an action, a robot hand striking the tower, gives the embedding of the tower falling.
The three parts of a JEPA world model.
Planning: from the tower, many branching action sequences fan into the future; the planner picks the branch that ends at the goal, a house built from the blocks.
The three parts of a JEPA world model.

[2], [3], . 600 .

, , . , 75 , : , 25 . 78% . 77%. , .

250

78%

77%

, 600 .

, . 22% 85%, . , , , 60 , .

1. 25

, 22% , 75 . [2] 25 , 89.7% , 90.5%.

25 75. , . 250 .

250 , 75

, 75

22%

, 75

42%+20

25 ,

80%+58

0255075100%

20 . 25- , , 60. 25 , .

25

75 ... , 22%

25 ... 80%

: . , .

. , .

, . .

2.

, , 460,000 . , . , .

, . 25 , 87% . .

. , (318 1,015 ). . , 250 ( 75 ) 62% 85%, . , ?

, , . , . , . 84% , .

,

. 50 , 68% 50 . 250 , 44%. 38 250 .

, , . 10 . 75% 45% . .

3.

. , 93% 32%.

. , . , , , . , 85%. ( 1% 10%).

, ,

, 250 ( 75 )

93%

32%

85%

, 45% 56%, . , 69% . , 27% 46%.

,

83

69%

39%54%

27%46%

0255075100%

4. “”

. , , . , 14 , . , .

, . .

, . 50 , .

, 50

9 / 50

39 / 50

30 0

, . . , , 4 .

. 30 , , . .

.

. , , “”. , , . 16 , , . , 11% 23%, .

16 ,

, . “ ” , . , , .

, . .

. , , .

. , 56% , . , [4], .

, , , . . , , , @.

  • [1] . , . , 2022.
  • [2] . , . , . , . , . , : . :2603.19312, 2026.
  • [3] . ., : . , 2023.
  • [4] . , . , . , . , . , : . :2610.06805, 2026.