Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B

Bakalova, Aleksandra; Veitsman, Yana; Huang, Xinting; Hahn, Michael

by Aleksandra Bakalova, Yana Veitsman, Xinting Huang, Michael Hahn

Reference:

Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2BAleksandra Bakalova, Yana Veitsman, Xinting Huang, Michael HahnPreprint, 2025.

Bibtex Entry:

@article{bakalova2025contextualizethenaggregatecircuitsincontextlearning,
      title={Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B},
      author={Aleksandra Bakalova and Yana Veitsman and Xinting Huang and Michael Hahn},
      year={2025},
      eprint={2504.00132},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      journal={Preprint},
      url={https://arxiv.org/abs/2504.00132},
}