Data Engineer

About the job

With a career at The Home Depot, you can be yourself and also be part of something bigger.

Position Purpose:
For this role, we are looking for someone who can design, build, and maintain the data models, transformations, and pipelines that turn raw contact center data into trusted metrics and datasets in a cloud-based data warehouse. This person will own metric logic and data quality, partner with operations and enterprise data teams, and hold source system owners to quality standards in support of Customer Solutions and Data Science initiatives that drive better customer experiences and more profitable outcomes.

• Key Responsibilities:
• 20% Implement a real time streaming data ingestion and processing pipeline using Google Dataflow (Apache Beam)
• 20% Interface with business intelligence analyst and others in IT (i.e. data engineers, architects, WebOps) in frequent whiteboard sessions to discuss the design, implementation, and testing of data pipelines
• 20% Maintain data architecture standards and ETL/ELT best practices consistent with a column oriented data store in an analytic use case
• 20% Active and engaged participation in the Scrum delivery process
• 20% Support solutions in production

• Direct Manager/Direct Reports:
• Position Reports to Sr Mgr. of EDW
• This position has 0 direct reports

• Travel Requirements:
• Typically requires overnight travel less than 10% of the time.

• Physical Requirements:
• Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions there may be a need to move or lift light articles.

• Working Conditions:
• Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable.

• Minimum Qualifications:
• Must be eighteen years of age or older.
• Must be legally permitted to work in the United States.

• Preferred Qualifications:
• Familiarity with Agile methodologies
• Experience with Spark dataframes, SparkSQL, Kafka, KSQL, real-time streaming, and message bus technologies
• Experience with data science technologies such as SAS, R, Matlab, or similar
• Experience with data warehousing and dimensional modeling

• Minimum Education:
• The knowledge, skills and abilities typically acquired through the completion of a bachelor's degree program or equivalent degree in a field of study related to the job.

• Preferred Education:
• No additional education

• Minimum Years of Work Experience:
• 6

• Preferred Years of Work Experience:
• No additional years of experience

• Minimum Leadership Experience:
• None

• Preferred Leadership Experience:
• None

• Certifications:
• None

• Competencies:
• Experience in building real time streaming data ingestion and processing pipeline using Apache Beam (running on either Google Datflow or Apache (Apex, Flink, or Spark) or Kafka in an analytics or data science use case
• Experience with data processing tools (e.g. Hadoop, Spark, Dataflow, etc.)
• Experience building ETL/ELT pipelines
• Experience with column-oriented databases (e.g Redhift, BigQuery, Vertica)
• Ability to go from whiteboard discussion to code
• Ability to effectively communicate with technical and non-technical audiences
• Strong programming ability
• Success in a highly dynamic environment and ability to shift priorities with agility
• Ability to act independently with minimal supervision
• Willingness to explore and implement new ideas and technologies
• Experience working directly with subject matter experts in both business and technology domains
• Experience as a team lead

For California, Colorado, Connecticut, Rhode Island, Nevada, New York City, Ithaca (NY), Westchester County (NY), and Washington residents:

The pay range for this position is between $110,000.00 - $125,000.00