Ventures Unlimited is a service centric organization. Our success begins with our ability to apply our relationships, leverage technologies, and identify talent - often in combination - to an endless array of real-world customer needs.
Job Description
Position: Hadoop Lead with Python
Location: Beaverton, OR
Duration: Full Time
Responsibilities
- Design and implement map reduce jobs to support distributed processing using Java, Python, Hive and Pig; Design and implement end‑to‑end solutions.
- Build libraries, user defined functions, and frameworks around Hadoop.
- Research, evaluate and utilize new technologies/tools/frameworks around the Hadoop ecosystem.
- Develop user defined functions to provide custom Hive and Pig capabilities.
- Define and build data acquisition and consumption strategies.
- Define and develop best practices.
- Work with support teams to resolve operational and performance issues.
- Collaborate with architecture and engineering leads and other teams on capacity planning.
- Co‑operate with the Site‑Operations team on configuration and upgrades of the cluster.
- Maintain excellent communication skills.
Qualifications
- MS/BS degree in a computer science field or related discipline.
- At least 8 years of experience in large‑scale software development.
- Experience with data warehousing, dimensional modeling and ETL development.
- Strong Java programming, shell scripting, Python, and SQL skills.
- Strong development skills around Hadoop, MapReduce, Hive, Pig, and Impala.
- Strong understanding of Hadoop internals.
- Good understanding of AVRO and JSON.
- Experience with build tools such as Maven.
- Experience with databases like Oracle.
- Experience with performance and scalability tuning, algorithms, and computational complexity.
- Experience (or familiarity) with data warehousing, dimensional modeling and ETL development.
- Capability to understand ERDs and relational database schemas.
- Proven ability to work cross‑functional teams to deliver effective resolutions.
- Experience with open‑source NoSQL technologies such as HBase and Cassandra.
- Experience with messaging and complex event processing systems such as Kafka and Storm.
- Machine learning framework experience is a plus.
- Statistical analysis skills with Python, R, or similar.
#J-18808-Ljbffr