In Python code generation, for instance, the researchers' architecture enabled a small, open-source model to outperform a specialized, commercial closed-source model that is more than double its size.