PySpark Engineer

Lisbon, Portugal May, 19th 2021
PySpark Engineer
Development Remote

Job Description

We are looking for a PySpark Engineer for an international project.

You have what it takes:

  • Required skills: ETL pipeline, Python programming, scripting with PySpark / Scala, Docker
  • Solid knowledge in ETL pipeline development, Python programming, scripting with PySpark / Scala, Docker etc.
  • Strong analytical skills to analyze data inconsistencies and “provide insights” from large volumes of data
  • Good knowledge of Hadoop Architecture and its ecosystem
  • Experience in optimizing Hive SQL queries and working with Spark
  • Problem solving skills, including knowledge of algorithms and data structure
  • Experience in agile software development processes
  • Experience with Spark using Python on Dataproc / Cloudera will be valued

INTEGER exists because we believe in people, talent, and technology. Our mission is to create the right teams for each technological project, opening doors in reference companies. We promote a participative and inclusive culture, where everyone is recognized for their talent. If you identify with this and feel you have what it takes for this position, don’t hesitate to apply.

Danielson Ribeiro

Talent Acquistion Specialist

If you are interested in this position and want to know a little better the context of the project or talk to the person who will accompany you throughout the recruitment process, get in touch:

Company Benefits
  • Health Insurance
  • Free Training & Courses
  • Career Progression
  • Personalized Monitoring
  • Events and Partnerships

Our latest Development Openings

Java / Spark Developer
Development Remote
.NET Backend
Development Remote
Product Owner
Development Remote

Integer Consulting uses cookies to improve your experience on the website. They help us understand how our website is being used. By continuing to use our website you consent to our cookies in accordance to our Cookie Policy. By continuing on our website you agree to our Privacy Policy.