Job Description:
We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with cross-functional teams, and ensuring efficient data processing.
Key Responsibilities:
Design, develop, test, and deploy Matillion ETL jobs in accordance with project requirements.
Collaborate with the Data and BI team to understand data integration needs and translate them into Matillion ETL solutions.
Create and modify Python code/components in Matillion jobs.
Identify opportunities for performance optimization and implement enhancements to ensure efficient data processing.
Collaborate with cross-functional teams, including database administrators, data engineers, and business analysts, to ensure seamless integration of ETL processes.
Create and maintain comprehensive documentation for Matillion ETL jobs, ensuring knowledge transfer within the team.
Create, test, and deploy SQL Server Integration Service (SSIS) packages and schedule them via Active Batch scheduling tool.
Create Matillion deployment builds using Azure DevOps CI/CD pipeline and perform release manager activities.
Review code of other developers (L2, L3-BI/DI) to ensure code standards and provide approval as part of code review activities.
Resolve escalation tickets from the L2 team as part of the on-call schedule.
Working knowledge of API and Postman tool is an added advantage.
Qualifications:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
5+ years of experience in data engineering, with a focus on ETL processes.
Proficiency in Matillion, SSIS, Azure DevOps, and ETL.
Strong knowledge of SQL, Python, and data integration techniques.
Experience with performance optimization and data processing enhancements.
Excellent collaboration and communication skills.
Ability to work in a fast-paced, dynamic environment.
Preferred Skills:
Experience with cloud platforms such as AWS or Azure.
Knowledge of data warehousing and data modeling.
Familiarity with DevOps practices and CI/CD pipelines.
Strong problem-solving skills and attention to detail.
...REGIONAL CLASS-A CDL TRUCK DRIVER WANTED! 6 Months Minimum Experience REQUIRED Your Schedule: Home Every 57 Days Enjoy 48 Hours of Quality Home Time 100% No-Touch Freight Stress-Free Driving! Your Route: Southwestern Region Travel in Style with...
...Job Description and Duties The California Lottery is looking for a dynamic Email Marketing and Loyalty Program Analyst who is passionate about email marketing and fostering player relationships and retention. About Us The California Lottery is a multi-billion-...
...Unleash your creativity and shape the future of fashion with a renowned apparel company! As a key member of their innovative design team, youll transform fashion trends into stunning apparel concepts, influencing the wardrobes of countless individuals. Partnering with...
...Required Qualifications: # Candidate should have a strong hand on experience working in Public cloud technologies like AWS # Experience in building and maintaining cloud native software solutions including advanced knowledge of managing infrastructure...
...Main Responsibilities of a Waiter/Waitress: Taking orders and delivering food and beverages. Helping guests with menu recommendations. Providing exceptional customer experience. Waiter/Waitress Job Description: Our restaurant is looking for a waiter/waitress...