Senior Data Engineer
LOCALiQ

As Senior Data Engineer, you will be responsible for expanding and optimizing our data pipeline and data architectures. In addition, you will be optimizing data flow between cross-functional teams as well as applications. You will be supporting our software engineers, database teams, analysts and data scientists on data initiatives that will enhance our products and operations. This role requires self-direction and the ability to support the data needs of product, engineering and data science. We are looking for candidates that are curious and excited by data challenges and are eager to optimize or help re-design our company's data architecture.

We are a fast-paced product-led engineering team working to build the next generation of Digital Marketing management systems partnering with Google, Bing, Yahoo, Facebook and Snap. If you are profoundly technical, analytical, and eager to build solutions that directly impact the company's core values, we want to talk to you!

About Your Responsibilities:

· Create and maintain data pipeline architecture

· Assemble large, complex data sets that meeting functional/non-functional business requirements

· Build and/or enhance infrastructure required for extraction, transformation and loading of data from a wide variety of internal and external data sources

· Deep understanding of cloud data offerings and ability to apply when necessary

· Build monitoring and automated testing to ensure data consistency and availability

· Work with stakeholders in product, engineering and data science

· Create custom reports in a modular manner to allow for re-use

· Work with data science and analysts for increased functionality in our data systems

· Practical knowledge on technology selection and choosing the right solution

· Ability to join data sets from disassociated data sources and extract value

· Strong time management and organizational skills

About You

· 5+ years of experience in a Data Engineering role

· BS or MS in Computer Science or related fields or equivalent work experience

· Experience with Google Cloud services such as GKE, Big Query, Big Table, PubSub (equivalent experience with AWS RedShift, Kinesis, etc accepted)

· Advanced working knowledge with SQL and relational databases including MySQL, key value stores, NoSQL databases, and custom datastores

· Experience building data pipelines and data sets

· Ability to work with unstructured datasets

· Experience with data pipeline and workflow management tools (i.e.Azkaban, Luigi, Airflow) and when to apply

· Experience with object-oriented/object function scripting languages: Python, Java, etc.

· Understanding of tools such as Storm, Spark-Streaming

Desirable Skills

· Experience in Digital Marketing / Online advertising (SEO/SEM) an advantage

· Familiar with Agile / Scrum methodologies and principles

· Eager attitude ready to solve challenges on a daily basis

· Curious and motivated by new concepts and ideas

· Driven to accomplish goals, setting trends and obliterating the agenda