We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That's where you come in!
Job Description
REQUIREMENTS:
- Experience: 10+ Years
- Hands-on experience as a Data engineer with extensive working experience using Pyspark, Advanced SQL, DBT, Snowflake, complex understanding of SQL and Skills, Spark, Snowflake and Glue.
- Expert with AWS (Azure, google will work too) - Lambda, Glue, S3 etc
- Experience in working Snowflake and understanding of Snowflake architecture along with concepts like internal, external tables, stages, masking policies etc.
- Experienced on Big Data platform like Hadoop, hbase, hive, Pig etc.
- Worked with TeraData, Oracle, MySQL, Tableau, QlikView or similar reporting and BI packages.
- Used SQL, PL/SQL and similar languages, UNIX shell scripting.
- Experienced with data modeling, design patterns, building highly scalable and secured solutions.
- Knowledge of agile software development process and familiarity with performance metric tools.
- Experience working with JSON, yaml, xml etc.
- Data Governance (Knowledge about meta data mgmt., data catalogue/access).
- ETL scheduling tools like Apache Airflow
RESPONSIBILITIES:
- Understanding the client’s business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers.
- Identifying different solutions and being able to narrow down the best option that meets the client’s requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation
- Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers
- Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
- Understanding and relating technology integration scenarios and applying these learnings in projects
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications
Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
#J-18808-Ljbffr
