Software Engineer, Data Platform

Etsy
Full time
Software Development
United States
Hiring from: Anywhere
Company Description

As an Etsy employee, you can do the work you love, be yourself, and make an impact in the lives of millions. Our commitments to diversity and inclusion, team culture and the spaces where we work all reflect our mission to keep commerce human.


Job Description

As a member of our Data Platform team, you’ll help us build infrastructure and tools for collecting and processing data in streaming and batch pipelines. Your work will enable other developers and data scientists to write custom data pipelines that power data science, machine learning, and product development.

You should have experience building and supporting at scale data processing platforms, and collaborating with other teams that use them. Experience building applications using one of the major cloud providers is a bonus but not required. We value curiosity, enthusiasm, responsibility and generosity of spirit.

We primarily write in Java, Scala, and Python and use technologies like Kafka, Kafka Streams, Kubernetes, Avro/Protobuf, Airflow, and GCP services like Dataproc, Dataflow, and BigQuery.

This is a full time role. Our team is headquartered in Brooklyn, but we support remote work and accept remote applicants.


 

Qualifications

ABOUT THE ROLE 




  • We build highly-performant systems that are maintainable and easy to understand by selecting and integrating with the best of current technologies.




  • Our team is responsible for developing and monitoring our batch and streaming environments and improving or fixing them over time. 




  • We build a lot of tools and libraries in Java, Scala, or Python. 




 


ABOUT YOU




  • Understand that being an effective software engineer is about communicating with people as much as it is about writing code.




  • Are willing to work with and improve code you did not originally write.




  • Are generous with your time and experience, and can mentor and learn from other engineers.




  • Can tackle unconstrained problems and know when to seek help.




  • Have familiarity with a few of the following: advantages and limitations of distributed systems, building and monitoring cloud services/infrastructure, writing ETL pipelines, and using or maintaining batch data processing environments like Hadoop or Spark in Dataproc, and stream processing systems like Kafka Streams, Spark, or Dataflow




 

Additional Information

At Etsy, we believe that a diverse, equitable and inclusive workplace makes us a more relevant, more competitive, and more resilient company. We welcome people from all backgrounds, ethnicities, cultures, and experiences. Etsy is an equal opportunity employer. We do not discriminate on the basis of race, color, ancestry, religion, national origin, sexual orientation, age, citizenship, marital or family status, disability, gender identity or expression, veteran status, or any other legally protected status. We will ensure that individuals with disabilities are provided a reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. While Etsy supports visa sponsorship, sponsorship opportunities may be limited to certain roles and skillsets.


How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

About this job Compensation: EquityLocation options: Remote, Visa sponsor, Paid relocationJob type: Full-timeExperience level: Mid-Level, SeniorRole: Full Stack DeveloperIndustry: Information Technology, Social Networking, Web TechnologyCompany size: 1k–5k peopleCompany type: PublicTechnologies javascript, python, django Job description Our full stack engineers bridge...
javascript python django
Software Development
United Kingdom
Hiring from: United Kingdom
About this job Location options: RemoteJob type: Full-timeExperience level: Senior, LeadIndustry: Software DevelopmentCompany size: 201–500 peopleCompany type: PrivateTechnologies java, spring, amazon-web-services, git, microservices Job description Clevertech is a leading consultancy that is on a mission to build transformational digital solutions...
java spring amazon-web-services git microservices
Software Development
No Location
Hiring from: U.S. / Canada, Europe, North America, South America, Southern Africa
About this job Location options: RemoteJob type: Full-timeRole: Embedded DeveloperIndustry: Cloud Computing, Information Technology, Internet of ThingsCompany size: 501–1k peopleCompany type: PrivateTechnologies ubuntu, linux, embedded Job description What is Canonical? Canonical is a growing international software company that works with...
ubuntu linux embedded
Software Development
No Location
Hiring from: Anywhere