Remote Senior Data Engineer
@ Sunscrapers

Posted: Jun 03
Location: Warsaw / Remote

Few words about project

We’re looking for a Senior Data Engineer (Warsaw or remotely) to join one of our remote projects.

As a Senior Data Engineer you’ll design and implement a system supporting the investment process for the US-based venture capital firm. You’ll need to integrate data from multiple systems and sources to enable data insights, machine learning and data-driven decision processes.

You will be responsible for...

  • Designing and implementing system architecture and data flow,
  • Integrating third-party systems (via APIs) and external data sources into data warehouse,
  • Implementing integrations between systems to match and enrich data (e.g. CRM, Wiki and Slack),
  • Designing and building AWS infrastructure with best DevOps practices in mind,
  • Developing data technology stack including data warehouse and ETL pipelines,
  • Building data flows for fetching, aggregation and data modeling using batch pipelines,
  • Designing datasets and schemes for consistency and easy access,
  • Building and extending recommendation systems.

What's important for us?

Must have:

  • At least 5 years of professional experience in data-related role, software engineering or DevOps
  • Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
  • Excellent command in spoken and written English, at least C1
  • Expertise in Python, SQL and Linux scripting
  • Experience in designing schemes in data warehouses
  • Experience in building ETL processes and data pipelines with platforms like Airflow or AWS services (Glue, Lambda, Batch, Data Pipelines).
  • Expertise in AWS stack, Docker as well as deployment automation
  • Great analytical skills and attention to detail - asking questions and proactively searching for answers
  • Creative problem-solving skills
  • Great customer service and troubleshooting skills

Nice to have:

  • Experience with infrastructure-as-code tools, like Terraform
  • Familiarity with Azure DevOps stack
  • Proficiency in statistics and machine learning, as well as Python libraries like Pandas, NumPy, matplotlib, seaborn, scikit-learn, etc
  • Experience in operating within a secure networking environment, like a corporate proxy




* Please reference that you found the job on Remojobs.com



Tags: sunscrapers python aws amazon web services sql etl terraform devops azure linux data warsaw warszawa poland europe

30 000 - 42 000 PLN
+ VAT per month

Apply for this position