Test automation for the Mentalyc healthcare platform
About the project

Mentalyc – an innovative platform supporting mental health professionals. This healthcare software automates the process of creating notes from therapy sessions using advanced AI technology. The tool transforms recordings or descriptions of sessions into clear and structured notes, allowing therapists to save time and focus on working with patients. The system is HIPAA-compliant and supports various therapy documentation formats.

Test Automation System with CI/CD from Scratch

Testing improvement and QA implementation
From challenge
Key Challenges
Lack of an experienced test engineer
Lack of an experienced test engineer
Mentalyc had a team of developers and designers, but no dedicated QA engineer. Previous attempts to build a test automation framework had not delivered the expected results.
Challenging process automation
Challenging process automation
Key functionalities such as call recording, audio analysis, and AI-generated note creation posed significant challenges in the automation process.
Framework built from scratch
Framework built from scratch
The client needed comprehensive support in identifying processes suitable for automation, as well as in determining the optimal timing and methods for their implementation. It was essential to design a complete system from the ground up for creating, maintaining, and executing tests, along with clear and structured test documentation.
Key functional and non-functional requirements:

Development of a test automation framework from scratch.

Automation of key functional tests.

Execution of a proof of concept (PoC) for processes that are difficult to automate.

Preparation of test documentation and training of the new QA engineer hired by Mentalyc.
Through the solution
Through the solution
Implementation process:
The project was carried out in several stages following the Kanban methodology:
Discovery and analysis
- Concept meetingsA series of workshops with the client during which key issues were identified and project goals were defined.
- Internal consultationsThe fireup.pro team conducted a detailed requirements analysis and developed an optimal technological solution tailored to the client’s needs.
Prototyping and validation
- Proof of Concept (POC)A prototype was prepared to confirm the feasibility of automating key processes such as recording and analyzing therapy sessions.
- Presentation and verificationA mini demo was held to present the developed solution to the client. Once approved, the implementation phase began.
- Project kickoffThe official start of the project, including a detailed understanding of the client’s needs and the establishment of priorities.
Fundamentals of testing
- Test base developmentStworzono fundamenty automatyzacji, przepisując istniejące testy za pomocą narzędzia Playwright oraz implementując nowe przypadki testowe
- Documentation and organizationComprehensive test documentation was created, including detailed test scenarios and guidelines for further automation.
- Writing test cases in BDD formatApplication functionalities were described using the Behaviour-Driven Development (BDD) format, involving the client in the process of defining test cases.
- Implementation of the cucumber libraryA tool for writing and executing BDD-formatted tests was implemented, enabling better understanding of the tests by the business team.
Automation and CI/CD
- Test containerizationTests were prepared within a Docker environment, allowing them to be executed independently across different configurations.
- CI/CD pipelineThe first CI/CD pipeline was implemented, enabling automated test execution in the testing environment.
- Local environment setupIn collaboration with the DevOps team, a local test execution environment was developed, streamlining the test verification process.
- CI/CD pipeline expansionThere are plans to introduce automated test execution during code deployment, which will further streamline the CI/CD process.
Hand-off and training
- Client team trainingWorkshops were conducted for Mentalyc's developers to familiarize them with best practices for writing and maintaining automated tests.
To the success
Technological outcomes

Faster testing
Test automation reduced testing time from several hours to just 24–25 minutes. In the future, tests are planned to be split into shards, which is expected to cut execution time by an additional two-thirds.

Higher service quality
Improved system stability and faster delivery of new features received positive feedback from Mentalyc’s clients.

Reduced risk
The risk of regression bugs was significantly lowered, enabling more frequent releases of new application versions.
Project team




Piotrek
Test Lead
Tech stack

Playwright

TypeScript

Cucumber

Docker

GitHub Actions

Postman

Slack

Figma

Stripe

Notion
Your success is our success
See how we can build a technological advantage for your company together.
We have a team that truly knows its stuff — we'll help you find a solution that works.
Conclusions & recommendations

Implementing BDD enabled better collaboration with the client and greater involvement of the business side in the testing process.

The use of Playwright and Docker proved highly effective for testing advanced AI-based applications.