Stability AI has announced the first public release of StableCode, an open large language model (LLM) designed to generate programming language code. The model, which uses data from the open-source BigCode project, will initially support Python, Go, Java, JavaScript, C, markdown, and C++ programming languages. StableCode offers a long-context-window model that can support up to 16,000 tokens, enabling more complex code generation prompts and understanding of medium-sized code bases. The model also uses rotary position embedding (RoPE) instead of the ALiBi approach for position outputs in a transformer model.
