Remote Senior Data Engineer
@ Sunscrapers

Few words about project

We’re looking for a Senior Data Engineer (Warsaw or remotely) to join one of our remote projects.

As a Senior Data Engineer you’ll design and implement a system supporting the investment process for the US-based venture capital firm. You’ll need to integrate data from multiple systems and sources to enable data insights, machine learning and data-driven decision processes.

You will be responsible for...

• Designing and implementing system architecture and data flow,
• Integrating third-party systems (via APIs) and external data sources into data warehouse,
• Implementing integrations between systems to match and enrich data (e.g. CRM, Wiki and Slack),
• Designing and building AWS infrastructure with best DevOps practices in mind,
• Developing data technology stack including data warehouse and ETL pipelines,
• Building data flows for fetching, aggregation and data modeling using batch pipelines,
• Designing datasets and schemes for consistency and easy access,
• Building and extending recommendation systems.

What's important for us?

Must have:

• At least 5 years of professional experience in data-related role, software engineering or DevOps
• Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
• Excellent command in spoken and written English, at least C1
• Expertise in Python, SQL and Linux scripting
• Experience in designing schemes in data warehouses
• Experience in building ETL processes and data pipelines with platforms like Airflow or AWS services (Glue, Lambda, Batch, Data Pipelines).
• Expertise in AWS stack, Docker as well as deployment automation
• Great analytical skills and attention to detail - asking questions and proactively searching for answers
• Creative problem-solving skills
• Great customer service and troubleshooting skills

Nice to have:

• Experience with infrastructure-as-code tools, like Terraform
• Familiarity with Azure DevOps stack
• Proficiency in statistics and machine learning, as well as Python libraries like Pandas, NumPy, matplotlib, seaborn, scikit-learn, etc
• Experience in operating within a secure networking environment, like a corporate proxy

* Please reference that you found the job on Remojobs.com