Product · Learning Hub · Impact · Platform · Work · Research
Data Engineer · PG Cert. Big Data Analytics @ C-DAC Mumbai
I design ETL systems, Spark jobs, and cloud data paths that stay up.
Navi Mumbai, India · previously Team Lead @ eClerx
A unified, browser-based study portal consolidating my Big Data Analytics and cloud revision material into one place.
10 learning modules: Python & R · DBT · AI · Linux · Cloud · HPC · MongoDB · Cassandra · Cloud Revision · R
Built from consolidated learning repositories and deployed through GitHub Pages.
| weekly logs processed | system uptime | unit test coverage | analysts led |
Three systems. One job: move data reliably, then prove it.
|
Federated learning · edge Adaptive system control in real time. YOLOv11n, BoT-SORT, and Eclipse SUMO on 19k+ instances at 95% operational accuracy. FedProx + AES-256 cut model-weight bandwidth by 90%.
|
SaaS backend · learning paths Cloud-native routing for dynamic learning. Node.js + FastAPI microservices serving 1,000+ daily REST requests with sub-200ms retrieval. Automated release prep cut manual ship time 30%.
|
Payments · ACID UPI workflows with fraud detection. Flask + MySQL with concurrency control, complaints, and analytics. Seeded with 10k transactions and 1k users — CTEs, window functions, pytest.
|
|
Python, SQL, Spark, PySpark, Hadoop, Kafka, Hive. ETL on 50k+ records with validation gates before anything hits downstream analysis. |
PostgreSQL, MySQL, MongoDB, Redis, Snowflake. Redis-backed processing for daily jobs that used to wait on the clock. |
|
AWS, Azure, Terraform, Linux, Node.js, FastAPI. REST APIs and microservices with sub-200ms retrieval on 1,000+ daily requests. |
PyTest, Git/Bitbucket, CI/CD, Astro orchestration, Power BI. 30+ unit tests, 85% coverage, 96.7% uptime. |
|
Data Analyst, Team Lead Led 14 analysts on a critical data-ops program. Engineered web-scraping pipelines with validation protocols. Redis processing + Astro orchestration to speed daily jobs. |
Data Analyst Intern Python/SQL ETL on 50k+ records (~30% accuracy lift). Processed 50 GB of weekly logs. Cut reporting latency 40% and saved 12 hours/week of manual work. |
C-DAC Mumbai — PG Cert. Big Data Analytics
Aug 2026 – Mar 2027
Chandigarh University — B.E. CSE (Big Data Analytics) · CGPA 8.21
2022 – 2026
-
A Decentralized Multi-Agent Federated Learning Framework for Adaptive System Control
I. Srivastav, P. Kumar Singh, A. Jaswal · Mar 2026 · submitted to conference -
BrillX: An Architecture for Dynamic Learning Paths
I. Srivastav, P. Kumar Singh, A. Jaswal · IJIRT, Vol. 12, Issue 6 · Nov 2025
Open to Data Engineer roles. Navi Mumbai · hybrid / remote.
Power BI Data Analyst · OCI Generative AI Professional · OCI Data Management Foundations · AWS Cloud Foundations