About This Constellation ShortList™

As enterprises are faced with business best-practice uncertainty due to Infinite Computing (for more, see here), they need to build software again in-house. They create next-generation applications, typically on cloud-based platforms, where for the first time in computing history, they don’t have direct access to the physical infrastructure. This higher and better levels of validating, testing new software assets as well, in short, the new software assets need to have the right quality, the quality needs to be assured (hence Quality Assurance, QA).

In the process of building and deploying software again, enterprises learn that there is nothing more detrimental than breaking software or delivering non-working software. This turns the attention to the development process and makes CTOs and CIOs look for software testing / QA vendor.

AI has been transformative for all part of the software developer life cycle (SDLC), testing and QA are no exception, and all vendors on this CR Shortlist have improved outcomes with the help of AI. Expect more uptake of AI in 2024 and be aware of a possible disruption of the key players in the space from it.

Threshold Criteria

Constellation considers the following criteria for these solutions:

  • Support of all key QA / testing processes. 
  • Usage of AI/ML for more efficient testing / QA 
  • Developer / QA personnel / tester friendly, share of mindset 
  • Visible QA / Testing evangelism 
  • 500+ customers 
  • Support for five (out of seven) continents 
  • On-premises, hybrid cloud, public cloud and multicloud QA / Testing support 
  • Out-of-the-box interfaces to popular development. CI / CD, Devops and deployment platforms 
  • Transparent and effective pricing and costing

The Constellation ShortList™

Constellation evaluates more than 20 solutions categorized in this market. The Constellation ShortList is determined by client inquiries, partner conversations, customer references, vendor selection projects, market share and internal research.

  • BROWSER STACK
  • IBM ENGINEERING TEST MANAGEMENT
  • KEYSIGHT EGGPLANT
  • LAMBDA TEST
  • OPENTEXT ALM QUALITY CENTER
  • OPENTEXT UFT ONE FORMERLY MICROFOCUS
  • ORACLE APPLICATION TESTING SUITE
  • PANAYA CHANGE INTELLIGENCE
  • POSTMAN
  • PROVAR
  • SALESFORCE TEST AUTOMATION
  • SOAPUI
  • TESTRAIL
  • TRICENTIS TOSCA
  • USERTESTING

Frequency of Evaluation

Each Constellation ShortList is updated at least once per year. Updates may occur after six months if deemed necessary.

Evaluation Services

Constellation clients can work with the analyst and the research team to conduct a more thorough discussion of this ShortList. Constellation can also provide guidance in vendor selection and contract negotiation.

Download Research Click to Download Report