Norway's Sovereign Wealth Fund CEO Calls for AI Regulation - Reports
StabilityAI, the maker of the popular image-generation tool Stable Diffusion, has launched a suite of open-source language model tools, adding to the growing language model sector.
The publicly available alpha versions of the suite, dubbed StableLM, currently contain models with three and seven billion parameters.
As well as 15, 30, and 65-billion parameter models marked as “in progress” and a 175-billion model planned for future development.
StableLM is an open-source language model suite developed by Stability AI. It is the company’s first foray into the language model game currently dominated by tech heavyweights such as OpenAI, Meta and Stanford.
The suite’s first offering, the StableLM open-source language model, is now available in alpha. Featuring 3 billion and 7 billion parameters, both trained on 800 billion data tokens, with larger 15-billion to 65-billion parameter models to follow.
StableLM is a suite of text-generating AI models developed by Stability AI, the startup behind the generative AI art tool Stable Diffusion. The models are intended to compete with systems like OpenAI’s GPT-4.
GPT-4 is a multimodal language model AI, which means it can understand text and other media, like images.
RELATED: Bloomberg Unveils a Finance-Focused GPT AI Model
This means GPT-4 can analyze the contents of an image and connect that information with a written question. However, it cannot generate images like Stable Diffusion can.
By comparison, GPT-4 has a parameter count estimated at one trillion, six times higher than its predecessor GPT-3.
The parameter count may not be an even measure of LLM efficacy, however, as Stability AI noted in its blog post announcing the launch of StableLM:
“StableLM is trained on a new experimental dataset built on The Pile, but three times larger with 1.5 trillion tokens of content […] The richness of this dataset gives StableLM surprisingly high performance in conversational and coding tasks, despite its small size of 3 to 7 billion parameters.”
It’s unclear at this time exactly how robust the StableLM models are. The StabilityAI team noted on the organization’s Github page that more information about the LMs capabilities would be forthcoming, including model specifications and training settings.
Provided the models perform well enough in testing, the arrival of a powerful open-source alternative to OpenAI’s ChatGPT could prove interesting for the cryptocurrency trading world.
iexclusivenews recall that people are building advanced trading bots on top of the GPT API and new variants that incorporate third-party tool access, such as BabyAGI and AutoGPT.
The inclusion of open-source models in the mix could be advantageous for tech-savvy traders who do not wish to pay OpenAI’s access fees.
Those interested can try out HuggingFace’s live interface for the 7B-parameter StableLM model. However, as of the publication of this article, our attempts to do so were met with the website being overwhelmed or at capacity.
(iexclusivenews) - In a move that has sparked intense debate and raised eyebrows across the…
(iexclusivenews) - In a stunning turn of events, the political landscape of Edo State has…
(iexclusivenews) - As the United Kingdom heads to the polls for the 2024 General Election,…
(iexclusivenews) - In pursuit of its Corporate Social Responsibilities (CSR), Polaris Bank Limited, is partnering…
Sterling One Foundation, co-conveners of the Africa Social Impact Summit are pleased to announce the…
Lagos, Nigeria— Union Bank of Nigeria has announced the promotion of 337 employees across various…