Senior Data Engineer - Ingestion

Description

Groupon is an experienced marketplace that brings people more ways to get the most out of their city or wherever they may be. By enabling real-time mobile commerce across local businesses, live events, and travel destinations, Groupon helps people find and discover experiences––big and small, new and familiar––that make for a full, fun, and rewarding life. Groupon helps local businesses grow and strengthen customer relationships––resulting in strong, vibrant communities. Even with thousands of employees spread across multiple continents, we still maintain a culture that inspires innovation, rewards risk-taking, and celebrates success.

Are you a passionate, energetic technology enthusiast eager to work at a rapid pace with the flexibility to work across a broad tech stack? Are you a problem solver; someone who enjoys debugging code, resolving issues, and creating solutions for exciting problems? 

The Data Ingestion team at Groupon is at the heart of all things “data”, working on defining and building the next-generation cloud-based solutions to ingest and curate petabytes of data into our data lake. Our mission is to empower data analysts & data scientists across all business units to make better business decisions. This role offers a unique combination of skills in computer science (distributed systems, big data) and scalable, high-performance production systems.   

We're a "best of both worlds" kind of company. We're big enough to have resources and scale, but small enough that a single person has a surprising amount of autonomy and can make a meaningful impact. We're curious, fun, a little intense, and kind of obsessed with helping local businesses thrive. Does that sound like a great way to grow your career? Let's get into the details:

You’ll spend time on the following:

• Design and develop high-volume batch / streaming data ingestion pipelines and frameworks spanning both AWS and GCP data platforms.

• Conceive, code, and launch the next-generation data ingestion and curation platforms

• Participate in defining the requirements, system, and data architectural discussions 

• Technically lead and mentor junior engineers for best practices in software development and data engineering lifecycle.

• Collaborate with cross-functional agile teams of software engineers, data engineers, ML experts, Data Analysts, and others in building new product features

We’re excited about you if you have

• BS/MS in Computer Science, with 7+ years of experience in distributed systems, data engineering, software engineering, or similar fields. 

• Strong coding skills in Scala and Java.

• Experience with Teradata or BigQuery, MySql, and Postgres

• Experience in big data technologies like Hadoop, Hive, Kafka, Apache Spark, Airflow, etc.

• In-depth experience in dealing with, understanding, and troubleshooting ETL, data lineage, data leaking, overall data quality issues, backfills, etc. Can drive and lead independent resolution,  communication, and follow-ups for the same.

• Experience in batch and streaming data pipelines 

• Experience in both software development and data engineering 

• Experience in AWS or GCP Cloud technologies-3

• Designing, implementing, and supporting production services with tight SLAs

• Experience developing distributed applications with central logging, metrics, monitoring, and alerting tools such as Elasticsearch and Wavefront.

• Excellent written and oral communication skills

• A clear understanding of testing methodologies, CI/CD, and other industry best practices

Nice to Haves

• String coding skills in Python

• Experience with HBase and Redis cache

• Experience in Data Streams, Data Flow, and Tungsten

• Experience with Delta lake and Hudi frameworks

We value engineers who are:

• Customer-focused: We believe that doing what’s right for the customer is ultimately what will drive our business forward.

• Obsessed with Quality: Your code just works & scales linearly

• Team players: You believe that more can be achieved together. You listen to feedback and also provide supportive feedback to help others grow/improve.

• Fast learners: We are willing to disrupt our existing business to trial new products and solutions. You love learning how to use new technologies and then rapidly apply them to further problems.

• Pragmatic: We do things quickly to learn what our customers desire. You know when it’s appropriate to take shortcuts that don’t sacrifice quality or maintainability.

• Owners: Engineers at Groupon know how to positively impact the business.

Groupon’s purpose is to build strong communities through thriving small businesses. To learn more about the world’s largest local ecommerce marketplace, click here for the latest Groupon news. Plus, be sure to check out the values that shape our culture, guide our strategy and make our company a great place to work. And just don’t take our word for it. Hear from real Groupon team members, learn more about our inclusive employee groups, and check out our benefits. If all of this sounds like something that’s a great fit for you, then click apply and let’s see where this takes us.

Groupon is an Equal Opportunity Employer

Qualifications for employment, promotion, and other terms and conditions of employment are based upon the ability to perform the job. Equal-employment opportunities are provided to all applicants and employees without regard to race, creed, religion, color, age, national origin, sex, disability, medical condition, sexual orientation, gender identity or expression, genetic information, ancestry, marital status, military discharge status (excluding dishonorable discharge), veteran status, citizenship status, or other legally protected status. We are all responsible for maintaining this policy. Groupon is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may email us at hraccommodations at groupon.com. If you have concerns related to Groupon’s equal employment opportunities, you may contact Groupon’s Ethics Reporting Service Ethicspoint.