Will a Mamba-based LLM of GPT 3.5 quality or greater be open sourced in 2024?
Will a Mamba-based LLM of GPT 3.5 quality or greater be open sourced in 2024?
Plus
18
Ṁ1874Jan 1
73%
chance
1D
1W
1M
ALL
Mamba is a next-generation architecture that seeks to improve on the shortcomings of transformers, mainly around context size and eliminating quadratic memory consumption during inference. https://arxiv.org/abs/2312.00752
YES resolution requires the Mamba LLM to match or beat GPT 3.5 on at least 5 popular benchmarks.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
Sort by:
does this count as Mamba-based? it's open and easily above GPT-3.5 quality
bought Ṁ10 NO
Looks like Gemini 1.5 used normal transformers and not Mamba, while also seeming to get around these shortcomings (1M context size). I expect this will cause interest in Mamba to wane, which decreases the chance someone will bother training and testing a Mamba LLM to GPT 3.5 level.
Related questions
Related questions
an LLM as capable as GPT-4 runs on one 4090 by March 2025
35% chance
When will GPT-4 be open-sourced?
an LLM as capable as GPT-4 runs on one 3090 by March 2025
33% chance
Will there be an open source LLM as good as GPT4 by June 2024?
12% chance
Will an open-source fully functional Auto-GPT like LLM exist by the end of 2025?
89% chance
Will an uncensored open-source LLM model comparable to 2023 GPT4 be available to the public by the end of 2025?
84% chance
When will an open-source LLM be released with a better performance than GPT-4?
Will an open-source LLM beat or match GPT-4 by the end of 2024?
83% chance
Which next-gen frontier LLMs will be released before GPT-5? (2025)
Will we have an open-source model that is equivalent GPT-4 by end of 2025?
82% chance