Job title: Senior Data Engineer
Company: Delta Air Lines
Job description: About Delta Air Lines
About the Company
Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good.
In 2023, Delta was named the World’s Most Admired Airline by , with the company ranking No. 1 across the board in the industry for values including innovation and people management. Delta also rated higher than any other airline on the overall list of Most Admired Companies, climbing to No. 12 this year.
Job Description
YOUR RESPONSIBILITIES IN THIS ROLE:
- Build and maintain data pipelines between source data and analytical databases
- Implement and evangelize engineering best practices for sustainable and scalable delivery
- Work with Solution Architect, Data Modelers, BI Analysts, and Product owners to take an active role in solution design
- Help identify minimum viable product and iterative design approach in an agile framework
- Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g. data latency, frequency, etc.)
- Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment
WHAT YOU NEED TO SUCCEED (MINIMUM QUALIFICATIONS)
- Bachelor of Science degree in Computer Science or equivalent
- At least 3+ years of post-degree professional experience as a data engineer developing and maintaining data pipelines
- Extensive experience coding data pipelines in the AWS ecosystem including deep knowledge of data lake concepts, S3, Glue (catalog and ETL), Lambda functions, and Redshift modeling
- Experience developing and maintaining CDK codeand Practice good software engineering techniques, e.g., Git, scrum, branching, code reviews, spikes
- Proficiency in SQL (CTE, window functions, temporal data)
- Proficiency in Python and data-focused packages, e.g., Pandas, Numpy
- Proficiency with software development tools such as Git, IDEs, Swagger, CI/CD
- Working knowledge of statistical/machine learning tools (e.g. SAS, R, TensorFlow) preferred
- Working knowledge of “Big Data” solutions such as Hadoop, NoSQL, MapReduce, etc preferred
- Working knowledge of API Consumption preferred
- Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g. data latency, frequency, etc.)
- Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment
- Familiar with best practices for data ingestion and data design
- Solid understanding of writing test cases to ensure data quality, reliability, and high level of confidence
- Knowledge of working with queries/applications, including performance tuning, utilizing indexes, and materialized views
- Strong project management, organizational, and prioritization skills in an agile DataOps environment
WHAT WILL GIVE YOU A COMPETITIVE EDGE (PREFERRED QUALIFICATIONS)
- Desired Airline industry experience
- Desired Experience working with financial data
- Experience working with SAP HANA as an analytics database
- Track record of advancing new technologies to improve data quality and reliability
- Knowledge of working with queries/applications, including performance tuning, utilizing indexes, and materialized views to improve query performance
Expected salary:
Location: Bangalore, Karnataka
Job date: Fri, 27 Oct 2023 07:43:57 GMT
Apply for the job now!
