Test Coverage improved by 90% for a leading Cybersecurity Company in the US

Test Coverage improved by 90% for a leading Cybersecurity Company in the US
The speed at which they’re able to understand the product is impressive. Trigent Software delivers everything that’s asked of them each sprint. The team is excellent at getting up to speed with new technologies. They’re an organized team that gets the job done.

About the client

Our Client is a leading US company that offers Encrypted Document Collaboration and Email for CMMC & ITAR compliance for business & personal use.

The Client’s encrypted email service addresses CMMC requirements for communication and storage of confidential user data & information. At the same time, it allows users to encrypt, store and share their files without fear of vulnerabilities and easily access these files from their computers or mobile devices.

Business challenge

The client is known for its end-to-end encrypted mail service, unrivaled in the industry for security, privacy, and ease of use. Trigent had to design and rebuild the software as per client requirements based on three critical parameters.

End-to-end encryption; where the server has no access to private keys
No central point of attack is allowed; where no data leakage happens in case of users, due to compromise of single person or machine
High-quality user experience; ease of use in terms of integration with existing applications and systems
Cybersecurity Approach

The challenges a tester faces while working on security software result from the complex and diverse IT environments. One needs to test in multiple environments such as Windows, macOS, Android, iOS devices, and the integrations with Microsoft Outlook, Outlook plugin, Apple Mail, and Gmail for email functionality. The testing team needs to ensure the robustness of a complex process that works on the public and private key encryption mechanisms and assures reliability in an environment where accounts have to be securely transferred and recovered on other devices. Another critical factor is testing complex functionality that encompasses multiple combinations and complex features such as encryption of file data, sharing, sync, selective sync, file lock/ unlock, permissions, and access. Finally, execute a seamless upgrade process across multiple configurations, including auto-upgrades, manual upgrades, and upgrades from any older versions.

Trigent solution

Trigent’s continuous testing strategy covered tests ranging from Installation, Functional, Compatibility, Regression, and successful automation. Our team was adept with domain knowledge in encryption, and OS file systems tested the application.

Functional Testing

Trigent designed to cover various combinations & edge/hand-off scenarios to ensure maximum coverage of application features across both web & mobile. We ran tests across different OS/ device combinations with combinatorial testing to provide early high-risk coverage.

Assurance Coverage
Installer Automation

An installer automation strategy covered the complete Installer process flows. Auto Upgrade, Manual Upgrade, Uninstall, and installation with Reboot were tested for multiple iterations, reducing testing efforts and improving build stability.

Web Automation

A Selenium-based test framework using Pytest library underpinned the automation strategy and the automated suite covered all the business process flows. An emphasis was placed on the design of test data for the features to ensure adequate coverage.

Smoke test suites performed sanity checks of each new build. Over time, the automation increased to reduce the manual testing regression efforts and extended to cover over 80% of the web test cases.

Client benefits

  • Achieved 80% automation of regression test coverage with more features per release
  • 95% reduction in test execution cycle time with automation and combinatorial test strategies
  • Automation integrated into the build process helped developers gain early insight into the quality within minutes instead of days
  • An integrated continuous testing process with the development process resulting in early visibility of the overall application quality
  • Product owners can now detect issues across different OS’s and product versions in a short time with tightly integrated Installer Automation
  • Technology Stack
    Technology stack:
    PostgreSQL PHP Python JIRA Outlook iOS Mail Selenium Autoit Pytest
  • Industry
    Industry:

    Cyber Security/ Security

  • Business Value
    Summary:

    Automation is a critical driver for change in Quality Assurance and Testing domain. Modern organizations are fast leveraging this technology lever and streamlining their testing processes with zero defects. Trigent has been instrumental in ensuring our clients adopt the best automation roadmap customized to their needs. The Client banked on Trigent’s expertise to adopt an automated suite that covered all the business process flows. Trigent covered tests ranging from Installation, Functional, Compatibility, Regression, and successful automation. The Client achieved 80% automation of regression test coverage with more features per release and a 95% reduction in test execution cycle time.