• Job3 (水城百事)

by Metro , 168 Victoria Street North, Kitchener, Monday, November 28, 2016, 17:14 @ Metro

Software Architect, Data Systems

Job Description:

POSITION SUMMARY

The Systems Architect will oversee the design, architecture, and operations of our rapidly growing Hadoop infrastructure. You will be responsible for designing efficient approaches to ingesting, extracting and maintaining our big data platform while also mentoring and coaching junior members of the team. You’ll be working in a fast-paced and high-volume processing environment, where quality and attention to detail are vital. Our mission is to provide the best possible user experience for our BlackBerry platform by providing invaluable insights to engineering, sales, and executive decision makers

RESPONSIBILITIES

•Design and lead development efforts for new processes utilizing Hive, Python, Java, Pig, Kafka, Oozie, and Apache Spark
•Mentor junior developers to ensure search queries and map reduce jobs are optimized
•Design and develop custom tooling to optimize the ingest of analytics and diagnostics data into HDFS
•Estimate and plan development work, track and report on task progress, and deliver on work schedule
•Lead initiatives within the team and across cross-functional teams
•Design and develop proof of concept for bleeding edge features and processes
•Oversee and contribute to a complex data processing pipeline and analytics framework
•Programming using Java and Map Reduce Frameworks (i.e. Pangool)

ESSENTIAL SKILLS AND QUALIFICATIONS

•BS in CS/EE or related discipline, Master’s or PhD is preferred.
•8-10 years’ work experience focused on Java and Big Data development
•Extensive experience with big data tools such as Pig, Sqoop, Hive, Hadoop, Kafka, and Spark.
•Experience in implementing ETL processes
•Able to work directly with users, developers, and business analysts to provide technical support in developing and maintaining large scale data pipelines.
•Thorough and holistic understanding of Big Data platforms and design patterns.
•Excellent organizational, written, analytical, and problem solving skills
•Must have very strong debugging and troubleshooting skills
•Effectively able to work independently with minimal hands-on supervision delivering to aggressive timelines
•Effectively able to collaborate with multiple teams across geographically diverse areas

Job Family Group Name:

Product Development