Stability AI launches StableCode, an LLM for code generation


Stability AI has announced the first public release of StableCode, an open large language model (LLM) designed to generate programming language code. The model, which uses data from the open-source BigCode project, will initially support Python, Go, Java, JavaScript, C, markdown, and C++ programming languages. StableCode offers a long-context-window model that can support up to 16,000 tokens, enabling more complex code generation prompts and understanding of medium-sized code bases. The model also uses rotary position embedding (RoPE) instead of the ALiBi approach for position outputs in a transformer model.

Read more at VentureBeat…