data engineer · hyderabad, india

Jayanth Appalla

Data Engineer at trigyan.io · previously AWS (DynamoDB)

> builds data platforms & AI systems that run themselves 

jayanth@appalla: ~ — neofetch
jayanth@appalla
---------------
Role
Data Engineer @ trigyan.io
Company
Trigyan — healthcare data platform
Focus
data platforms + self-running AI systems
Track
~3 yrs · ex-AWS DynamoDB · Azure Databricks
Certs
Databricks DE · MS Fabric DE · AWS
Flagship
autonomous agent fleet — zero servers
Stack
Python · SQL · Spark · Kafka · Databricks
jayanth@appalla: ~/about// 01
cat about.md

Who I am

I'm a data engineer at trigyan.io, building the data platform behind a healthcare product. Before this I was at Amazon Web Services on the DynamoDB team — backup, restore and import at multi-terabyte scale — and built Azure Databricks lakehouse pipelines in consulting.

What I like working on: pipelines that move serious data — Spark, Kafka, Databricks, medallion architectures — and LLM systems with real engineering discipline: deterministic where possible, model calls only where judgment helps, everything tested and observable. To practice what I preach, I built a fleet of autonomous agents that runs my mornings, audits my code, and even maintains my GitHub profile page by itself.

MS CS · UIC Chicago ~3 yrs industry 6 certifications published researcher
jayanth@appalla: ~/learning// 02
cat progress.log

Skill progress — in public

My learning isn't a private plan — it's committed, dated and public. A self-updating board tracks daily progress across four tracks, with code and day-by-day notes pushed as I go, alongside daily DSA practice. What's mine here is the progress; a Telegram study bot just keeps the log.

LIVE · SELF-UPDATING

Learning-in-public board

Skills, momentum and current build across data engineering, AI, ML and Linux — plus computer vision — updated automatically as I study and ship.

jayanth@appalla: ~/experience// 03
git log --career --oneline

Where I've worked

Jul 2026 — now

Trigyan — Data Engineercurrent

  • Building the data platform behind a healthcare product.
Dec 2024 — Dec 2025

SPV Consulting — Data Engineer

  • Azure Databricks pipelines at gigabyte scale — partitioning, Z-ordering and caching to cut ETL runtimes.
  • Bronze / Silver / Gold medallion workflows feeding analytics and ML; Databricks-to-Power BI delivery.
Aug 2023 — Oct 2024

Amazon Web Services — Software Development Engineer, DynamoDB

  • Built and operated the service behind multi-TB backups, imports and restores for DynamoDB customers.
  • Raised the import S3-object limit 10,000 → 100,000, cutting large-import times ~20%.
  • On-call for a tier-1 service at very high traffic.
2019 — 2023

Earlier

  • I-ConnectResources — ServiceNow ITSM/ITOM & AWS discovery integration (certified ServiceNow Administrator, certified Appian developer).
  • Incture — SAP Analytics Cloud dashboards; Java/Spring microservices for geospatial analytics (Esri ArcGIS).
  • Hindustan Unilever (intern) — chatbots & NLP; a Russian-language email bot with Dialogflow.
jayanth@appalla: ~/projects// 04
ls ~/projects --featured

Things I've built

FLAGSHIP · ZERO SERVERS

The Agent Fleet

Twelve autonomous agents — each its own repo, schedule, Telegram bot and memory — built to run my mornings: mail triage, news, tech briefings, my own money movement, a code review of everything I pushed yesterday. A Cloudflare Worker dispatches GitHub Actions at exact minutes (after GitHub's own cron once ran 4 hours late); state is committed back after every run; a watchdog notices any agent that dies silently. The fleet scales up and down with my needs — and one agent audits every repo I own, with a live one-button dashboard.

news-intelligence-platform

Async FastAPI backend for news aggregation and querying — careful query design, async plumbing throughout.

election-dashboard

Election-results dashboard with real data modeling and caching (TypeScript).

DocMind

RAG document Q&A — parse, embed, ask. A compact end-to-end retrieval pipeline in Python.

Object detection for the visually impaired

Published research (IOP, 2020): YOLO object detection over Kafka-streamed video with text-to-speech, on Android.

jayanth@appalla: ~/skills// 05
tree ~/skills -L 1

What I work with

data engineering

Apache SparkPySpark Apache KafkaAzure Databricks Azure Data FactorySnowflake Delta Lake

languages & frameworks

PythonSQL RJava C#Spring / Spring Boot DjangoFastAPI TypeScript

ai / ml & genai

RAGhybrid search vector databasesModel Context Protocol LLM app developmentTensorFlow Hugging Facescikit-learn NLTKNumPy / Pandas

analytics, tooling & platforms

Power BITableau SAP Analytics CloudGit MavenGradle GitHub ActionsCloudflare Workers LinuxAndroid
jayanth@appalla: ~/certs// 06
ls ~/certs --verified

Certified in

Microsoft Certified Fabric Data Engineer

2025

Databricks Certified Associate Data Engineer

2025

Microsoft Certified Administrator Associate

2025

PCEP — Certified Entry-Level Python Programmer

2025

Tableau Certified Desktop Specialist

2024

AWS Certified Cloud Practitioner

2023
jayanth@appalla: ~/education// 07
cat education.md research.bib

Where I studied

MS, Computer Science

University of Illinois at Chicago · 2021 – 2022

BE, Computer Science

National Institute of Engineering, Mysore · 2016 – 2020 · GPA 9.09/10

Publication

“Real-time Object Detection and Face Recognition System to Assist the Visually Impaired” — Journal of Physics: Conference Series, Vol. 1706 (IOP Publishing), 2020 · ICAPSM 2020.

jayanth@appalla: ~/contact// 08
mail -s "hello" jayanth

Let's connect

Have a role, a project, or just want to talk data platforms and agents? My inbox is open.