Freshworks: Freddy AI

Freshworks: Freddy AI

Tags
MLOps
Kafka
Python
Kubernetes
AWS
Description
As Lead Systems Engineer, working on scaling ML models
Last Updated
Last updated April 17, 2024
Slug
freshworks
Published
September 6, 2021
End Date

About project

This project is about Freddy AI, Freshworks’ in-house AI solution where we use ML et al. to solve problems for the clients with Freshdesk, a customer service suite.

Roles and Responsibilities

My roles in this project are:
  • Implementing best practices of MLOps Engineering.
  • Removing bottlenecks of existing ML applications.
  • Performance improvement and tuning.
  • Scaling existing solutions to a large scale enterprise-level.

Tech stack

Backend

  • MySQL
  • Python
  • Go
  • Kafka
  • FastAPI & Flask

DevOps

  • Docker
  • Kubernetes
  • Jenkins
  • GitHub Actions
  • AWS

AI/ML

  • Transformers
  • MLFlow
  • LLaMA2 fine-tuning
  • OpenAI APIs integration
Β 

Rewards and Recognitions

notion image
notion image
notion image

Miscellaneous

notion image