To learn about the transformative powers of LLMs, get our ebook: Unlocking the power of LLMs. Get Now→

To learn about the transformative powers of LLMs, get our ebook: Unlocking the power of LLMs. Get Now→

"Drop rate of customers between prescription upload and order confirmation was very high."

— Business Head, Prescription medicine

The old method of ordering prescription medicine: Customers drop off because of delay

The older ordering method required the customers to wait hours before their orders could be processed. This resulted in many customers dropping out between prescription upload and ordering (80-90% of the customers). The business identified that automating the following processes could result in faster turnaround time and improved customer conversion rate:

  1. Detection of whether the image uploaded by the customers is legible
  2. Reading the names and dosage of medicines from the prescription and putting them in the customer's cart

The business head approached the machine learning team to build a machine learning pipeline that could solve these problems. They wanted a solution fast since it directly affected their revenues.

"We were spending a lot of time doing things that were not our expertise."

— Lead Data Scientist

The machine learning team was getting delayed in the project's delivery. The team did lots of back and forth with the DevOps team to set up infra for new experiments, create demos, deploy model APIs, etc. They faced the challenge of making sophisticated models like OCR (Optical Character Recognition) and blur detection on prescription data. This data was noisy but required the model to be accurate and hence needed multiple experiments and iterations with state-of-the-art model architectures.

The machine learning team needed help concentrating on solving the complex machine learning problem because they were busy trying to get the model production ready. This meant an extended period of delay in realizing the business impact.

The company wanted an MLOps tool that the machine learning team could use to set up the machine learning pipeline without needing DevOps help to build, test, demo, productionize, and monitor their models.

TrueFoundry helped optimize Machine Learning Pipeline by 5X

TrueFoundry enabled the Data science team to become independent regarding their MLOps requirements. The team could act independently on things that typically required back-and-forth with the DevOps team.

"TrueFoundry has acted as a partner for the Data Science team and often went beyond their scope to ensure our team's success."

— Senior Data Scientist

The Machine Learning team uses TrueFoundry for the following:

10X faster prototyping by running experiments in parallel

In the development phase, the team used the TrueFoundry platform to

  • Speed up experimentation by running 10+ models/hyperparameters in parallel with TrueFoundry jobs, reducing the experimentation time by >90%
  • Keep track of their experiment and log metadata to reproduce experiments.

Reducing model deployment time from 3 days to 1 hour

The team could independently, with the platform, deploy production models within an hour:

  • They deployed REST API endpoints of their models across different cloud providers (AWS and GCP) with a unified workflow through the UI or using Python SDK.
  • The team could configure roll-out strategies, resource limits, autoscaling, etc., for the models.
  • Once the models had satisfactory performance, they could promote models to the staging environment through a single click on the UI.

Faster feedback by creating demos

The team regularly needed feedback from the product managers and business heads, so they used the platform to:

  • Quickly spin up demos with simple UIs to validate model performance directly with pharmacists/medical experts.
  • Create UI for data annotation and create a golden dataset for model training.

Closing the value loop with model monitoring and retraining

After deploying the model, the machine learning team used the TrueFoundry platform to set up a pipeline to monitor its performance and ensure that it delivers business impact by:

  • Setting up dashboards and alerts on model performance, latency, etc
  • Setting up automated retraining, validation, and deployment pipeline if data drift is detected and data is available for retraining

Detecting data and security leaks

Given the sensitive nature of the data and model predictions, the Machine learning team used the TrueFoundry platform to:

  • Set up an audit trail of the data being used in the models and their inferences.
  • Detect data and memory leaks, set up API auth, etc.

Multi-cloud ML deployment

The team had workloads running in AWS and GCP and needed to move some models from one cloud to another. They used the multi-cloud control plane of TrueFoundry to:

  1. Manage access and security across clouds.
  2. Clone models and inference pipelines from one cloud to another in a single click
"We took just 6 days instead of the expected 4 months to move our ML pipelines from AWS to GCP migration with TrueFoundry, which was amazing. We have been an early partner with TrueFoundry and have seen the product improve significantly."

— DevOps Lead

Creating an Impact on Users' Experience with Machine Learning

Using the ML models deployed on the TrueFoundry platform, the team was able to offer a much smoother customer experience. They automated the manual processes hence freeing up the pharmacist team's time. The project decreased customers' prescription to checkout time from 2 hours to 5 minutes.

New process: The cart gets updated within 5 mins post prescription upload

These changes improved the conversion percentage of the customers from uploading the prescriptions by ~1 percentage point, which would have a $ 1.5 Mn topline impact for the company in the first year and potentially more going forward.

Testimonial by the Head of Engineering

"We are on a mission to provide accessible healthcare to all through technology, and ML/AI are critical levers to achieving our mission. When we selected TrueFoundry, we were impressed by their team and credentials and were convinced they would be the right partners for our young team starting our ML/Data Science journey.

Throughout our collaboration, we were pleasantly surprised to realize many gains through our partnership with TrueFoundry. They are genuinely committed to their client's success, and we were able to achieve many benefits such as an accelerated path to production, a tenfold acceleration of experimentation, maturing our ML/DS practice, reaching milestones within a few months that we expected to reach in 2024, and significant cost savings. TrueFoundry was there for us as our sounding board to help guide our team to success.

We highly recommend TrueFoundry to all organizations looking to create an impact and achieve success in the ML/DS arena. Without leveraging the TrueFoundry platform, we would not have been able to save time and costs while making a significant customer impact in such a short amount of time."

— Head of Engineering

Operate your ML Pipeline from Day 0