Test automation for the Mentalyc healthcare platform

About the project

Client:

Mentalyc – an innovative platform supporting mental health professionals. This healthcare software automates the process of creating notes from therapy sessions using advanced AI technology. The tool transforms recordings or descriptions of sessions into clear and structured notes, allowing therapists to save time and focus on working with patients. The system is HIPAA-compliant and supports various therapy documentation formats.

Project goal:
Test Automation System with CI/CD from Scratch
To build a comprehensive test automation system for the application, including the creation of a testing environment from scratch, test documentation, and CI/CD pipelines.
Testing improvement and QA implementation
The project aimed to improve the overall quality of the testing process, reduce the number of regression bugs (through regression testing), and introduce the client to best QA practices.
From challenge

Key Challenges

1

Lack of an experienced test engineer

Mentalyc had a team of developers and designers, but no dedicated QA engineer. Previous attempts to build a test automation framework had not delivered the expected results.

2

Challenging process automation

Key functionalities such as call recording, audio analysis, and AI-generated note creation posed significant challenges in the automation process.

3

Framework built from scratch

The client needed comprehensive support in identifying processes suitable for automation, as well as in determining the optimal timing and methods for their implementation. It was essential to design a complete system from the ground up for creating, maintaining, and executing tests, along with clear and structured test documentation.

Key functional and non-functional requirements:

Development of a test automation framework from scratch.

Automation of key functional tests.

Execution of a proof of concept (PoC) for processes that are difficult to automate.

Preparation of test documentation and training of the new QA engineer hired by Mentalyc.

Through the solution

Implementation process:

The project was carried out in several stages following the Kanban methodology:

    Discovery and analysis

    • Concept meetingsA series of workshops with the client during which key issues were identified and project goals were defined.
    • Internal consultationsThe fireup.pro team conducted a detailed requirements analysis and developed an optimal technological solution tailored to the client’s needs.

    Prototyping and validation

    • Proof of Concept (POC)A prototype was prepared to confirm the feasibility of automating key processes such as recording and analyzing therapy sessions.
    • Presentation and verificationA mini demo was held to present the developed solution to the client. Once approved, the implementation phase began.
    • Project kickoffThe official start of the project, including a detailed understanding of the client’s needs and the establishment of priorities.

    Fundamentals of testing

    • Test base developmentStworzono fundamenty automatyzacji, przepisując istniejące testy za pomocą narzędzia Playwright oraz implementując nowe przypadki testowe
    • Documentation and organizationComprehensive test documentation was created, including detailed test scenarios and guidelines for further automation.
    • Writing test cases in BDD formatApplication functionalities were described using the Behaviour-Driven Development (BDD) format, involving the client in the process of defining test cases.
    • Implementation of the cucumber libraryA tool for writing and executing BDD-formatted tests was implemented, enabling better understanding of the tests by the business team.

    Automation and CI/CD

    • Test containerizationTests were prepared within a Docker environment, allowing them to be executed independently across different configurations.
    • CI/CD pipelineThe first CI/CD pipeline was implemented, enabling automated test execution in the testing environment.
    • Local environment setupIn collaboration with the DevOps team, a local test execution environment was developed, streamlining the test verification process.
    • CI/CD pipeline expansionThere are plans to introduce automated test execution during code deployment, which will further streamline the CI/CD process.

    Hand-off and training

    • Client team trainingWorkshops were conducted for Mentalyc's developers to familiarize them with best practices for writing and maintaining automated tests.
    To the success

    Technological outcomes

    Faster testing

    Test automation reduced testing time from several hours to just 24–25 minutes. In the future, tests are planned to be split into shards, which is expected to cut execution time by an additional two-thirds.

    Higher service quality

    Improved system stability and faster delivery of new features received positive feedback from Mentalyc’s clients.

    Reduced risk

    The risk of regression bugs was significantly lowered, enabling more frequent releases of new application versions.


    Project team
    Abstract background
    Piotrek
    Arek
    Team

    Piotrek

    Test Lead

    Defined the project scope, analyzed client needs, created test documentation, and introduced the client to QA best practices. He managed the testing process and supported the client in implementing the proposed solutions.

    Tech stack

    Playwright

    TypeScript

    Cucumber

    Docker

    GitHub Actions

    Postman

    Slack

    Figma

    Stripe

    Notion

    Your success is our success

    See how we can build a technological advantage for your company together.

    Book free consultation!

    We have a team that truly knows its stuff — we'll help you find a solution that works.

    Conclusions & recommendations

    Implementing BDD enabled better collaboration with the client and greater involvement of the business side in the testing process.

    The use of Playwright and Docker proved highly effective for testing advanced AI-based applications.

    Background

    Time for your project.

    Turn your ideas into real solution and...

    ...Get in touch with us!

    Your vision, our realization
    Want to discuss the details?
    Let us know!

    I agree to the processing of my personal data by Fireup Software ...