About This Constellation ShortList™

Large language models (LLMs) are a type of foundational model trained on massive amounts of data to support a wide range of natural language processing (NLP) tasks. LLM’s are a type of machine learning (ML) model with massive amounts of data across an extraordinary number of parameters.

LLMs support multiple type of use cases from generating and classifying text to translating text from one language to another and answering questions in a conversational manner. Once trained, these LLMs play a foundational role in generative AI deployments.

Constellation predicts that the overall LLM market size will be worth more than $53.7 billion by 2030.

Threshold Criteria

Constellation considers the following key criteria for these solutions:

  • Supports a wide variety of models (e.g. encoder only, decoder only, encoder/decoder) 
  • Provides pre-trained models and relevant domain- specific training 
  • Delivers speed and performance in contextual relevance, accuracy, and, natural language understanding 
  • Allows for fine-tuning with resource efficient approaches. 
  • Handles a large number of parameters 
  • Manages massive scaling with increased workloads 
  • Complies with the latest regulations for data privacy and security 
  • Integrates well with existing systems 
  • Ensures model fairness and identification of algorithmic bias and fairness 
  • Allows for a wide range of languages

The Constellation ShortList™

Constellation evaluates more than 30 solution providers categorized in this market. This Constellation ShortList is determined by client inquiries, partner conversations, customer references, vendor selection projects, market share, and internal research.

  • AI21 LABS JAMBA
  • ANTHROPIC CLAUDE 3
  • APPLE OPENELM
  • BAIDU ERNIE
  • COHERE COMMAND R
  • FALCON 180B
  • GOOGLE GEMINI
  • GOOGLE GEMMA
  • GOOGLE PALM 2
  • IBM WATSONX.AI
  • META LLAMA 3
  • MICROSOFT MAI-1
  • MICROSOFT PHI-3
  • MISTRAL MIXTRAL 8X22B
  • OPENAI GPT - 40
  • STABILITY AI STABLELM 2
  • STANFORD CRFM ALPACA 7B
  • VICUNA 33B
  • X.AI GROK-1

Frequency of Evaluation

Each Constellation ShortList will be updated at least once per year. There could be an update after six months, should the analyst deem it necessary.

Evaluation Services

Constellation clients may work with the analyst and research team to conduct a more thorough discussion of this ShortList. Constellation can also provide guidance in vendor selection and contract negotiation.

Download Research Click to Download Report