Blog
Many of the old ideas are no longer accurate, but I still keep them here just for reference.
Exploring JEPA and SIGReg
Reproducing LeJEPA on CIFAR-100 with ViT-Tiny — SIGReg prevents collapse without contrastive samples, but we discovered an interesting head collapse phenomenon in nano-scale models.
Discrete Visual Tokenizers
A review on state of the art (2026) vision tokenizers, and experiment on them.
How to Read a Paper
A personal guide on reading academic papers effectively, focusing on insights and active thinking.