About Me
I am a Senior Software Engineer at Astronomer, where I work on the design and engineering of Apache Airflow - an open source data orchestration platform. Astronomer is the orchestration platform for the modern data stack. Built on Kubernetes, Astronomer makes it easy to run, monitor, and scale Apache Airflow clusters in our cloud or yours. I’m passionate about building scalable data infrastructure and contributing to open source projects that impact the developer community.
As a strong advocate of open source and believer in “Learning by Doing,” I have contributed to several high-impact projects including Apache Airflow, Ask-Astro, Universal Transfer Operator, Astro-Python-SDK, Astronomer-Providers, and OpenCV CVAT.
📋 Table of Contents
Experience
1
Jan 2022 — Present
Senior Software Engineer
Astronomer
• Working on Apache Airflow 3.0 release and core platform development
• Led development of Ask-Astro, an open-source reference implementation of Andreessen Horowitz's LLM Application Architecture
• Working on Universal Transfer Operator that simplifies data transfer workflows and reduces 100+ operators to a single interface
• Design and contribute to Astro Python SDK for rapid development of ETL workflows in Apache Airflow
• Implemented Apache Airflow Providers with Deferrable Operators & Sensors for improved performance
• Presented "Love for writing deferrable operators: Why and how to defer?" at Airflow Summit 2022
• Active contributor to open-source Apache Airflow with strong community presence
• Work on data retrieval and embedding, prompt orchestration, and feedback loops for LLM applications
• Led development of Ask-Astro, an open-source reference implementation of Andreessen Horowitz's LLM Application Architecture
• Working on Universal Transfer Operator that simplifies data transfer workflows and reduces 100+ operators to a single interface
• Design and contribute to Astro Python SDK for rapid development of ETL workflows in Apache Airflow
• Implemented Apache Airflow Providers with Deferrable Operators & Sensors for improved performance
• Presented "Love for writing deferrable operators: Why and how to defer?" at Airflow Summit 2022
• Active contributor to open-source Apache Airflow with strong community presence
• Work on data retrieval and embedding, prompt orchestration, and feedback loops for LLM applications
Python
Apache Airflow
LLM
LangChain
AWS
GCP
2
Feb 2019 — Jan 2022
Senior Software Engineer / Software Product Engineer
Wadhwani AI
• Hired and led engineering teams across multiple projects in healthcare and agriculture domains
• Led engineering effort for annotation studio - data management and job orchestration platform using Apache Airflow, FastAPI and React
• Engineered microservices including authentication, geospatial directory and emailing service using Django, AWS SES, OAuth 2.0, and AWS Cognito
• Reduced video buffering time by 75% on open-source CVAT annotation tool by implementing Redis cache
• Designed, developed and deployed pest management system using PyTorch-based model on phone/cloud to identify harmful pests and alert farmers about infestation
• Part of team that won $2M grant from Google AI Impact Challenge, becoming the only team from India to do so
• Developed complete pipeline for data collection (ODK), annotation (LabelMe), model deployment, analytics dashboard with Django backend
• Built COVID-19 mobility dashboard for 11 state government authorities in India with actionable insights to optimize emergency protocols
• Demoed AI solutions to Sundar Pichai at Google AI Impact Challenge Summit
• Systems currently used by 11,000+ farmers for pest management
• Led engineering effort for annotation studio - data management and job orchestration platform using Apache Airflow, FastAPI and React
• Engineered microservices including authentication, geospatial directory and emailing service using Django, AWS SES, OAuth 2.0, and AWS Cognito
• Reduced video buffering time by 75% on open-source CVAT annotation tool by implementing Redis cache
• Designed, developed and deployed pest management system using PyTorch-based model on phone/cloud to identify harmful pests and alert farmers about infestation
• Part of team that won $2M grant from Google AI Impact Challenge, becoming the only team from India to do so
• Developed complete pipeline for data collection (ODK), annotation (LabelMe), model deployment, analytics dashboard with Django backend
• Built COVID-19 mobility dashboard for 11 state government authorities in India with actionable insights to optimize emergency protocols
• Demoed AI solutions to Sundar Pichai at Google AI Impact Challenge Summit
• Systems currently used by 11,000+ farmers for pest management
Python
Django
FastAPI
React
Apache Airflow
PyTorch
AWS
GCP
3
Dec 2017 — Jan 2019
Software Development Engineer
DreamVu Inc.
• Developed end-to-end modular video acquisition and processing software for VR/AR and machine vision applications for in-house camera
• Built SDK for third party integration to enable external developers to use the camera platform
• Built camera calibration software for intrinsic and extrinsic camera calibration
• Helped secure angel funding from SRI capital through technical contributions to 360-degree, 3D video capture platform
• Worked on real-time 3D video processing and streaming capabilities
• Built SDK for third party integration to enable external developers to use the camera platform
• Built camera calibration software for intrinsic and extrinsic camera calibration
• Helped secure angel funding from SRI capital through technical contributions to 360-degree, 3D video capture platform
• Worked on real-time 3D video processing and streaming capabilities
Computer Vision
VR/AR
SDK Development
Camera Calibration
3D Video
4
Aug 2016 — Nov 2017
Senior Software Developer
aapkapainter.com
• Joined as founding team member and developed Customer Relationship Management (CRM) and task management system
• Built sales and marketing automation platform using CodeIgniter framework
• Built customer and vendor transaction module integrating with Razorpay payment gateway handling INR 10+ million monthly transactions
• Built Flask-RESTful API to extract room wall measurements from floor plan images using Google Cloud Vision, Ocropus and Tesseract
• Created real-time wall paint and texture visualizer by training Haar Classifier to detect walls
• Worked extensively on Search Engine Optimization (SEO) and Search Engine Marketing (SEM)
• Built sales and marketing automation platform using CodeIgniter framework
• Built customer and vendor transaction module integrating with Razorpay payment gateway handling INR 10+ million monthly transactions
• Built Flask-RESTful API to extract room wall measurements from floor plan images using Google Cloud Vision, Ocropus and Tesseract
• Created real-time wall paint and texture visualizer by training Haar Classifier to detect walls
• Worked extensively on Search Engine Optimization (SEO) and Search Engine Marketing (SEM)
CodeIgniter
Flask
Payment Gateway
Computer Vision
CRM
5
Apr 2015 — Mar 2016
Project Lead
TrackThisBus (Startup)
• Founded startup as part of Design Challenge hosted by Indian School of Business Hyderabad
• Created fully working position-reporting system for local buses displaying real-time position without using GPS
• Winner of Design Challenge by ISB Hyderabad, beating multiple competing teams
• Pitched idea to Telangana IT minister and received seed funding offer from TSRTC (Telangana State Road Transport Corporation)
• Developed innovative GPS-free tracking solution for public transportation systems
• Created fully working position-reporting system for local buses displaying real-time position without using GPS
• Winner of Design Challenge by ISB Hyderabad, beating multiple competing teams
• Pitched idea to Telangana IT minister and received seed funding offer from TSRTC (Telangana State Road Transport Corporation)
• Developed innovative GPS-free tracking solution for public transportation systems
Startup
Real-time Systems
GPS Alternative
Public Transport
Leadership
6
Jan 2015 — Jan 2016
Quality Control and Management Coordinator
Technozion, NIT Warangal
• Got ISO 9001:2008 certification and UNESCO patronage for Technozion 15, South India's second largest technical fest
• The fest saw revenue of over 1.5 Crore INR (200k USD) from sponsorships and events
• Was responsible for leading, coordination, quality control, risk management, blogging and management for various 150+ events during Technozion 15
• Managed large-scale event operations with multiple stakeholders and vendors
• Ensured quality standards and compliance across all festival activities
• The fest saw revenue of over 1.5 Crore INR (200k USD) from sponsorships and events
• Was responsible for leading, coordination, quality control, risk management, blogging and management for various 150+ events during Technozion 15
• Managed large-scale event operations with multiple stakeholders and vendors
• Ensured quality standards and compliance across all festival activities
Event Management
Quality Control
Leadership
ISO Certification
Project Management
📋 View detailed experience history on LinkedIn →
Skills & Expertise
Programming Languages: Python, C++, SQL, NoSQL
Technologies: Apache Airflow, Django, FastAPI, Kubernetes, Docker, Redis
Domains: Data Engineering, Analytics, Machine Learning, Computer Vision, MLOps
Leadership: Engineering team management, SDLC, Technical hiring, Open source contributions
Education
1
2012 — 2016
Bachelor's in Technology, Computer Science and Engineering
National Institute of Technology Warangal
• Grade: 6.44/10
• Coordinator at Technozion 2015 - South India's second largest technical fest
• General Secretary at Electronics, Amateur and HAM Club NIT Warangal
• National Robotics Championship (Robo-war) winner
• Member of Innovation Garage (IG) 2014-2016
• Founded startup that built real-time position reporting system for buses without GPS
• Worked on AR/VR camera applications, drone data analysis, and ML-based web solutions
• Fellow at Teach For India contributing to education and social impact
• Coordinator at Technozion 2015 - South India's second largest technical fest
• General Secretary at Electronics, Amateur and HAM Club NIT Warangal
• National Robotics Championship (Robo-war) winner
• Member of Innovation Garage (IG) 2014-2016
• Founded startup that built real-time position reporting system for buses without GPS
• Worked on AR/VR camera applications, drone data analysis, and ML-based web solutions
• Fellow at Teach For India contributing to education and social impact
Computer Science
Robotics
Leadership
Innovation
Startup
2
2014 — 2016
Bachelor's degree, Technology Entrepreneurship Program
Indian School of Business Hyderabad
• Grade: 81.2%
• Won Design Challenge by ISB Hyderabad
• Participated in technology entrepreneurship programs focusing on startup development, business model creation, and product management
• Founded award-winning startup that built real-time position reporting system for buses without GPS
• Pitched idea to Telangana IT minister and received seed funding offer from TSRTC
• Gained hands-on experience in building scalable technology solutions and understanding market needs
• Won Design Challenge by ISB Hyderabad
• Participated in technology entrepreneurship programs focusing on startup development, business model creation, and product management
• Founded award-winning startup that built real-time position reporting system for buses without GPS
• Pitched idea to Telangana IT minister and received seed funding offer from TSRTC
• Gained hands-on experience in building scalable technology solutions and understanding market needs
Entrepreneurship
Product Management
Business Strategy
Startup
Innovation
3
2009 — 2011
Grade 12
SOS Hermann Gmeiner Higher Secondary School Bharatpur, Nepal
• Head boy of the school
• Active in Robotics activities and competitions
• Head Designer of School Magazine
• Member of Debate team
• Youth Red Cross member
• Scout participant
• Guitar player
• Eco-club member
• Developed strong foundation in analytical thinking and problem-solving skills that later contributed to success in computer science and engineering
• Active in Robotics activities and competitions
• Head Designer of School Magazine
• Member of Debate team
• Youth Red Cross member
• Scout participant
• Guitar player
• Eco-club member
• Developed strong foundation in analytical thinking and problem-solving skills that later contributed to success in computer science and engineering
Leadership
Robotics
Design
Debate
Community Service
Certifications
- Astronomer Certification - DAG Authoring for Apache Airflow (Jan 2022)
- Astronomer Certification - Apache Airflow Fundamentals (Jan 2022)
- Apache Airflow - Udemy Certification (Jan 2021)
- SQL - HackerRank Certification (Sep 2020)
Notable Projects
Ask-Astro
LLM-powered chatbot for Apache Airflow community with RAG and Weaviate vector store. Integrates Apache Airflow with advanced LLM technology to create a versatile chatbot and knowledge interface, leveraging Retrieval Augmented Generation for enhanced AI-driven query response capabilities.
Python
Apache Airflow
LLM
RAG
Weaviate
Universal Transfer Operator
Unified interface that simplifies data transfer workflows in Apache Airflow. Offers a consistent agnostic interface, improving user experience by reducing the need for 100+ transfer operators to a single operator on Airflow.
Python
Apache Airflow
Data Engineering
ETL
Pest Management System
PyTorch-based model running on phone/cloud to identify harmful pests, alert farmers about infestation and reduce crop loss in cotton farming. Currently used by 11,000+ farmers and contributed to winning Google's $2M AI Impact Challenge.
PyTorch
Computer Vision
Mobile
Agriculture
AI for Good
COVID-19 Mobility Dashboard
Real-time dashboard integrating with COVID-19 Mobility Data Network and Facebook Data For Good, enabling 11 state government authorities in India with actionable insights to optimize emergency protocols during the pandemic.
Python
Data Visualization
Dashboard
Public Health
Interests
I’m broadly interested in Software Engineering, Data Engineering, Computer Vision, and Computer Systems. I’m also a robotics enthusiast and was a Fellow at Teach for India. Always an aspiring polymath!
📄 View my complete resume → {#resume}
Recent Updates
2023
- December: Presented “Data pipelines from ETL to ML to LLM: Powered by Apache Airflow” at Microsoft India Development Center Hyderabad with Vikram Koka, SVP of Engineering at Astronomer. [Presentation]
- November: Led development of Ask-Astro, Astronomer’s innovative open-source LLM application integrating Apache Airflow with advanced AI technology
- June: Contributed to Universal Transfer Operator, simplifying data transfer workflows and reducing 100+ operators to a single interface
- Ongoing: Active contributor to Apache Airflow core platform with strong community presence (6K+ LinkedIn followers)
2022
- December: Joined Astronomer as Senior Software Engineer
- August: Presented “Love for writing deferrable operators: Why and how to defer” at Airflow Summit 2022 [Video]
- June: Met Astronomers from around the world in Washington D.C.
- June: Reduced video buffering time by 75% on open-source CVAT annotation tool by implementing Redis cache
- January: Started contributing to astronomer-providers
2021
- March: Google employees join the Wadhwani family on a 6-month Fellowship program. Led engineering effort for annotation studio which is data (artifacts and annotation) management and job orchestration platform to manage, schedule and orchestrate annotation jobs across multiple annotation vendors using Apache Airflow, FastAPI and React
- January: Promoted to Senior Software Engineer at Wadhwani AI
2020
- December: Designed and developed COVID-19 mobility dashboard for 11 state government authorities in India
- May: Published “Pest management in cotton farms: an AI-system case study from the global South” at KDD 2020 [PDF] [Video]
- April: Transitioned to engineering team at Wadhwani AI focusing on Systems and MLOps
- February: Attended a 4-day Google AI Impact Challenge Summit in San Francisco. Had a wonderful time interacting with lots of Googlers and external folks about how they are using AI to build products for societal good. Got lucky to have an unexpected meet with Sundar Pichai!
2019
- September: Invited for Google For India event to showcase AI solution for Early Pest Management in cotton farming and how it can benefit small-holder cotton farmers
- August: Attended 5-day Google AI accelerator in London, UK. Had a wonderful time interacting with lots of Googlers and got feedback on our work with integrated pest management
- May: Part of the team that won a $2 million grant as part of the Google AI Impact Challenge offered to only 20 teams worldwide, becoming the only team from India to do so and featuring in Google I/O and Google for India [Article]
- March: Designed, developed and deployed a pest management system which runs a PyTorch-based model on the phone/cloud to identify the harmful pests, alert farmers about infestation and reduce crop loss in cotton farming. Currently being used by over 11,000 farmers
- February: Joined Wadhwani AI to build AI solutions for social good. Joined as the first software engineer in the team
Contact
For more details, connect with me on LinkedIn • View detailed professional experience →