Can I read Stable Code Technical Report on EtoBox?

Stable Code Technical Report by Pinnaparaju, Nikhil; Adithyan, Reshinth; Phung, Duy; Tow, Jonathan; Baicoianu, James; Datta, Ashish; Zhuravinskyi, Maksym; Mahan, Dakota; Bellagente, Marco; Riquelme, Carlos; Cooper, Nathan is a scholarly article available to read on EtoBox.

What is Stable Code Technical Report about?

We introduce Stable Code, the first in our new-generation of code language models series, which serves as a general-purpose base code language model targeting code completion, reasoning, math, and other software engineering-based tasks. Additionally, we introduce an instruction variant named Stable Code Instruct that allows conversing with the model in a natural chat interface for performing question-answering and instruction-based tasks. In this technical report, we detail the data and training procedure leading to both models. Their weights are available via Hugging Face for anyone to download and use at https://huggingface.co/stabilityai/stable-code-3b and https://huggingface.co/stabilityai/stable-code-instruct-3b. This report contains thorough evaluations of the models, including multilingual programming benchmarks, and the MT benchmark focusing on multi-turn dialogues. At the time of its release, Stable Code is the state-of-the-art open model under 3B parameters and even performs comparably to larger models of sizes 7 billion and 15 billion parameters on the popular Multi-PL benchmark. Stable Code Instruct also exhibits state-of-the-art performance on the MT-Bench coding tasks

Author

Pinnaparaju, Nikhil; Adithyan, Reshinth; Phung, Duy; Tow, Jonathan; Baicoianu, James; Datta, Ashish; Zhuravinskyi, Maksym; Mahan, Dakota; Bellagente, Marco; Riquelme, Carlos; Cooper, Nathan

Published

2024

Language

EN