Data Engineer

Data Engineer - €80,000 - €90,000 per annum depending on experience.

Consortia are proud to offer a Data Engineer opportunity at one of the specialists of automated solutions for procurements in industrial enterprises.

As one of the first team members in engineering, you will outline our design decisions and address some of the most exciting technical challenges to building bleeding-edge software. This is a high-impact role where you will be part of the core team, shape the product, and help us to deliver value to our consumers.

As one of the first team members in engineering, you will outline our design decisions and address some of the most exciting technical challenges to building bleeding-edge software. This is a high-impact role where you will be part of the core team, shape the product, and help us to deliver value to our consumers.

What the role involves:

• Building and maintaining their data stack that fuels insight generation for their customers
• Connecting and ingesting data from several customer ERP systems to feed their data models
• Setting up data pipelines to acquire, cleanse, validate, and transform data
• Evaluating 3rd party data sources to augment customer data and increase business value
• Interpreting the results of analysis and setup continuous monitoring to track value creation on customer side
• Exploring and selecting tools for internal BI to enable data-driven decisions for sales and product development
• Writing clean and maintainable code with sensible testing so that the ideal candidate will enjoy taking over from a colleague
• Doing 1:1s, review code, leave the codebase better than previously found and assisting everyone in the team to become better
• Proactively communicating, document, and sharing approach, progressing, results, and challenges

What experience you will need to have:

• Experience with different data storages and data warehouses, e.g. S3, Azure Blob Storage, AWS Redshift, Google Big Query, Snowflake, etc.
• Orchestrating tasks with Airflow, Prefect or other tools
• Building data pipelines, ingest data from different sources and know how to connect to 3rd party systems, .i.e. through Airbyte
• Understadning of handling and exploring data sets using languages like SQL and Python with respective packages like PyArrow, duckdb, numpy, pandas, etc.
• Demonstration of data modeling, common data schemas, e.g. Star or Snowflake schema, and are familiar with fundamentals of databases
• Experience of setting up a BI tool, e.g. Tableau, PowerBI, Metabase, and the likes

If you think you would be a good fit for this role, please feel free to apply to the role directly or feel free to email me directly at max.sinclairkemp@consortia.com.