Senior Data Engineer

India About Us Udacity is now an Accenture company, and exciting things are happening! 🚀 We are on a mission of forging futures in tech through *radical* talent transformation in digital technologies. We offer a unique and immersive online learning platform, powering corporate technical training in fields such as Artificial Intelligence, Machine Learning, Data Science, Autonomous Systems, Cloud Computing and more. Our rapidly growing global organization is revolutionizing how the enterprise market bridges the talent shortage and skills gaps during their digital transformation journey. Data Driven is a Udacity core value. Udacity Data Engineering Team is looking for a Software Engineer to help us to design and develop Udacity’s company-wide data solutions in support of that value. The ideal candidate will be comfortable talking to data analysts, data scientists and business stakeholders, understand the data that powers their products, generalize it and implement common fact tables across the company. This is a high-impact opportunity and you’ll be a part of a global Data Team of highly talented Software Engineers, Data Analysts and Data Scientists based primarily in India and North America. The system you will be working on consists of a cloud-based data lake and is built completely on a cloud-native environment on AWS, using technologies such as Apache Spark, Airflow, Postgres and Redshift. About Udacity Data Engineering

We prioritize the quality and trustworthiness of the data
We embrace common and proven software engineering practices to achieve quality while maximizing the productivity
We promote collective and shared ownership of our technical assets
We value the flexibility needed in working in a global while balance and minimize non-work hour involvement in all locations

How You Can Help

Design and develop infrastructure and tools for the systems powering all of Udacity’s data, analytics and reporting
Work with analysts to generalize the data points behind their work to form multi-dimensional data stores
Building out the lakehouse for analytics, machine learning and AI use cases with strong focus on accuracy and reliability using technologies such as Spark, Airflow, dbt and Iceberg on AWS
Working with stakeholders from other departments and successfully translating their requirements to engineering solutions
Being a champion and thought leader of effective agile software development practice and producing high quality readable code in such a setting

What We Need From You

BS or MS in Computer Science , MIS or related degrees
6+ years of experience working in the software industry, with at least 3 of which in data engineering
Solid understanding and experience practicing Agile software development methodologies such as test driven development
Good understanding in the principles of building robust data processing pipeline and track record of putting them in practice
Proven ability to trace, identify and resolve issue in data, infrastructure and code
Hands-on experience working with Apache Spark, cloud data storage and relational databases
Hands-on experience working on cloud platforms, preferably AWS
Proficiency in Python, Scala and SQL
Experience working with generative AI is desired
Experience working with US or Europe based remote teams is a strong plus

Benefits: Experience a rewarding work environment with Udacity's perks and benefits!

At Udacity, we offer you the flexibility of working from home. We also have in-person collaboration spaces in Mountain View, Cairo, Dubai and Noida and continue to build opportunities for team members to connect in person
Flexible working hours
Paid time off
Comprehensive medical insurance coverage for you and your dependents
Employee wellness resources and initiatives (access to wellness platforms like Headspace)
Quarterly wellness day off
Personalized career development
Unlimited access to Udacity Nanodegrees

Compensation at Udacity... [truncated for brevity]