Diginix - Ai booked orders value 180,000 USD in the month of December

BigData engineering pipeline
for data ingestion

AboutThe Client

Genetic testing and rare disease detection and analysis company based in Germany.

Project BigData engineering pipeline for data ingestion
engineering pipeline

About this project

Project description:

The client has on-premises storage infrastructure, where the files with the genetic analysis data are placed.

We have designed and implemented the AWS technology stack-based, BigData pipeline, which transfers raw data from on premises storage to the AWS S3 storage and later to the database deployed on AWS infrastructure. The pipeline includes CHECKSUM validation of each file and its insertion into the database through the EKS jobs. The pipeline also contains a retries mechanism and notification using the AWS SES (Simple Email Service).


  • Python, AWS Stack: S3, Lambda, EKS, ECR, Cloudwatch, SES.

Let's Talk Business

Reach out to us by below-given details, or drop us a text to start a conversation, we are here to provide best in class business solutions.