Data Engineer III, Washington

Description:

Must be tied to Austin office. Will this be a hybrid role? (This is hybrid role for 3 days in Austin office)

Seattle is now an option - 3 days onsite/week but Austin is preferred

Glider Assessment name "Data Engineer III (SQL, Apache Airflow, Data Warehouse Spark, ETL, Coding (Python)

Duration: 45 mins

Candidates must score 80% or higher on the Glider assessment.

What you'll do:

Develop various facets of data capture, data processing, storage and distribution

Understand and apply AWS standard methodologies and products (compute, storage, databases)

Translate marketing concepts/requirements into functional specifications

Write clean, maintainable and well-tested code

Propose new ways of doing things and contribute to the system architecture

Manage ETL data to and from Expedia Group entities to third party solutions

Create and maintain functional utilities (SPAs) that provide point solutions to scale our marketing operations

Develop scalable and highly-performant distributed systems with everything this entails (availability, monitoring, resiliency)

Communicate and document solutions and design decisions

Work with business collaborators, analytics, and senior leadership to define and scope solutions that the marketing team can leverage to efficiently scale out our marketing operations

Who you are:

Bachelor's degree; or equivalent related professional experience

5+ years of development experience, particularly in using marketing acquisition technologies to deliver automation of multiple channels and drive operational efficiencies

4+ years' experience with with programming languages such as PHP, Python or Java stack

Experience building data pipelines from multiple sources including APIs, CSV, event streams, NoSQL, etc. using distributed data frameworks

Experience with different aspects of data systems including database design, data ingestion, data modeling, unit testing, performance optimization, SQL etc

Demonstrable history creating on and leveraging AWS

Experience in batch and/or stream processing (using Spark) and streaming systems/queues such as Kafka or SQS

Daily practice of agile methods including use of sprints, backlog, user stories

Experience with AWS ecosystem or other big data technologies such as EC2, S3, Redshift, Batch, AppFlow

AWS: EC2, S3, Lambda, DynamoDB, Cassandra, SQL

Hadoop, Hive, HDFS, Spark, other big data technologies

Understand, Analyze, design, develop, as well as implement RESTful services and APIs

Describe 2-4 ideal candidate skillset (must-haves)

What you are:

· Bachelor's degree; or equivalent related professional experience

· 8+ years of development experience, particularly in using marketing acquisition technologies to deliver automation of multiple channels and drive operational efficiencies

· 4+ years' experience with PHP, Python or Java stack

· Experience building data pipelines from multiple sources including APIs, CSV, event streams, NoSQL, etc. using distributed data frameworks

· Experience with different aspects of data systems including database design, data modelling, performance optimization, SQL etc

· Demonstrable history creating on and leveraging AWS

· Experience in batch and/or stream processing (using Spark) and streaming systems/queues such as Kafka or SQS

· Daily practice of agile methods including use of sprints, backlog, user stories

· AWS: EC2, S3, Lambda, DynamoDB, Cassandra, SQL

· Hadoop, Hive, HDFS, Spark, other big data technologies

· Understand, Analyze, design, develop, as well as implement RESTful services and APIs

What technical skills will the successful candidate have? List is order of importance.

What you'll do:

· Develop various facets of data capture, data processing, storage and distribution

· Understand and apply AWS standard methodologies and products (compute, storage, databases)

· Translate marketing concepts/requirements into functional specifications

· Write clean, maintainable and well-tested code

· Propose new ways of doing things and contribute to the system architecture

· Manage ETL data to and from Expedia Group entities to third party solutions

· Create and maintain functional utilities (SPAs) that provide point solutions to scale our marketing operations

· Develop scalable and highly-performant distributed systems with everything this entails (availability, monitoring, resiliency)

· Communicate and document solutions and design decisions

· Work with business collaborators, analytics, and senior leadership to define and scope solutions that the marketing team can leverage to efficiently scale out our marketing operations