Data Engineer-II

At Shaadi.com, we’re not just building a platform — we’re playing Cupid for millions across the world! 🏹❤️ Behind every successful match, swipe, and connection lies a continuous stream of data. With over 100+ million records generated daily, we rely on rock-solid data engineering to power real human stories, smart recommendations, and seamless user experiences.
If you love building heavy-duty pipelines, taming data lakes, and turning raw data streams into matchmaking magic, this is your sign to join our team! 🚀

*What You’ll Do (Your Daily Quests) *🎸

● 🌊 Build High-Volume Pipelines: Design, build and maintain scalable data pipelines (real-time and batch) and large-scale distributed systems that ingest, process and organize large volumes of data.
● 🏰 Architect Data Lakes & Warehouses: Manage scalable data architecture across AWS (S3, Redshift, Glue) so our Data Science, Product, and Analytics teams have clean, queryable data at their fingertips.
● ⚡ Stream in Real-Time: Work with streaming frameworks like Kafka to move event data instantly — making sure live activity, recommendations, and notifications happen without a hitch ⏱️.
● 🧹 Data Zen & Quality Control: Clean, structure, and optimize raw datasets. Monitor data drift, system performance, and maintain immaculate data reliability ️.
● 🤝 Cross-Functional Collaboration: Partner with Product, Backend Engineering and Data Science teams to build features that directly impact business metrics and user happiness 🎯.

*What You Bring (Your Tech Superpowers) *🎯

● 💻 Coding Mastery: 2–4 years of hands-on experience in Python (Java or Go is a great plus!) with advanced SQL wizardry ‍♂️.
● ☁️ Cloud & Big Data: Solid experience with AWS services (Redshift, S3, Glue, CloudFormation, or ECS) and modern data lake setups.
● 🔄 Streaming & Messaging: Hands-on experience or deep understanding of the Kafka ecosystem (or AWS Kinesis).
● ️ ETL & Data Modeling: Proven track record of writing efficient, complex ETL/ELT jobs and understanding microservices architectures.
● ⚙️ Dev Tools: Comfortable with Git version control, CI/CD pipelines, and writing optimized queries.

*Bonus Points & Culture *✨❤️

● 🔍 Nice to Have: Familiarity with Elasticsearch, Snowplow, or Docker 🐳, and curiosity about how data feeds into ML models & recommender systems 🤖.
● 🌟 Real Human Impact: Your pipelines directly power products that help millions find their life partners.
● 📈 Scale & Growth: Work on complex, high-velocity data problems that will rapidly elevate your engineering career.
● ☕ Great Vibe: Collaborative teams, vibrant office culture, and brainstorming overchai! 🏢🎉