Position Overview
The job profile for this position is for a Data Engineering Sr. Advisor. This is a Band 4 Senior Contributor Career Track Role.
We are seeking an experienced Data Engineering Sr. Advisor to join our dynamic team. The ideal candidate will have a strong background in data engineering and extensive experience with AWS data engineering services. This role involves designing, developing, and maintaining scalable data pipelines and infrastructure to support various data-driven projects.
Responsibilities:
- Design and hands-on development of robust solutions to hard problems considering scale, security, reliability, performance, operational excellence, and cost.
- Supports other product delivery partners in the successful build, test, and release of solutions.
- Works with distributed requirements and technical stakeholders to complete shared design and development.
- Supports the full software lifecycle of design, development, testing, and support for technical delivery.
- Actively participate in agile ceremonies.
- Work with the team to understand the business value and break down the feature as stories.
- Reviews user story/requirements to identify ambiguities.
- Communicate clearly, concisely, and effectively for your audience.
- Collaborate across teams and departments to help create best practices.
- Identify risks and help mitigate.
- Ability to design with ambiguous requirements.
- Guide and mentor team members on all aspects of software engineering.
- Ability to drive innovation in the organization.
- Ability to make presentations on software technologies, frameworks, and patterns to the organization.
Skills:
- AWS Services: S3, Glue, Lambda, Step Functions, API Gateway.
- Experience with developing complex ETL jobs using PySpark.
- Strong knowledge of SQL, analyzing, data profiling, designing and developing backend applications with complex and highly normalized data models.
- Data Integration (batch, real-time) following the established Integration Patterns.
- Experience working with various database engines - MSSQL, PostgreSQL, DynamoDB.
- Experience in developing cloud-native data pipelines and backend applications following AWS well-architected principles.
- Programming experience with at least one of Python, Node.js, or Java.
- Experience in integrating RESTful web services.
- Experience with build and deployment tools, e.g., Git, Jenkins, etc.
- Experience with IAC (Terraform or equivalent).
- Attention to details.
- Quick learner.
- Excellent communication.
- Automation-driven mindset to improve maintainability and testability.
- Document design and solution to provide clarity.
- Certification desired: AWS certified Developer Associate, AWS certified Data Engineer Associate, Databricks Spark certification.
Education:
- College or University degree in Computer Science or a related discipline preferred.
- 10+ years of work experience in software engineering.
- 3+ years of experience in AWS.
- Strong desire to learn and upskill.
#J-18808-Ljbffr
