Data Engineer

Jelentkezés a cégnél

Cég neve

Cushman & Wakefield Kft.
Munkavégzés helye

Budapest

Munkaidő, foglalkoztatás jellege
- Alkalmazotti jogviszony
- Általános munkarend
Elvárt technológiák
- DATABASE BI TESTING GIT AZURE SQL PYTHON ANALYTICS TROUBLESHOOTING SPARK AGILE R TFS SCRUM SVN
Elvárások
- Angol középfok
- 5-10 év tapasztalat
- Középiskola

Állás elmentve

A hirdetést eltávolítottuk a mentett állásai közül.

Responsibilities

Building, maintaining, and optimizing the global BI and Analytics platform
Designing, implementing, and supporting data artifacts in the database and data lake
Developing, testing, and maintaining data extract, load, and transformation (ELT/ETL) pipelines and data flows
Creating and enhancing data ingestion processes
Preparing data sets for benchmarking, trend analysis and data science
Supporting the technical leads to build, implement, and maintain the technical data infrastructure
Developing, testing, and maintaining Azure Data Factory pipelines and data flows
Building, maintaining, and enhancing database objects in Azure SQL Database
Using Azure Databricks for complex data cleansing, preparation, and analysis
Working closely with Business and Data Analysts to understand and document source-to-target mapping specifications
Developing and enhancing the Triana data warehouse
Contributing to high-/low-level designs and technical specifications of data integration processes
Supporting data science and experimental initiatives using Databricks, ADF, Python and SQL
Performing complex data analysis to improve data quality and extract value
Assisting with data-related technical issues and proposing solutions
Providing verbal and written updates to management
Promoting effective and consistent communication within and outside the team
Working closely with a multi-disciplinary team in an Agile / Scrum environment
Contributing to innovation and constant improvement for best practices and business standards in data, analytics and development

Requirements

In-depth experience (5-6 years) in at least one technology among Azure SQL Database and/or SQL Server 2019+, Azure Data Factory, Databricks or similar, and a language used in data cleansing and analysis such as Python, Scala, or R
Broad practical experience (3+ years) with at least one other technology among the listed
Good knowledge of T-SQL for querying data, building reports, troubleshooting data issues, and summarising/aggregating data
Good understanding of data warehouse design principles and data integration processes
Routine use of source control (Git, SVN, TFS, etc)
Experience gathering, analysing, and documenting system requirements and technical specifications
Proven experience troubleshooting and resolving data and code issues
Strong communication skills for documenting business processes and data analysis
Test-driven development experience using common testing frameworks (pytest, nUnit, tSQLt, etc.)
Experience with migrations-based Database Lifecycle Management tools (Flyway, Liquibase)
Understanding of software engineering principles including design patterns, version control, branching & merging, automated release builds, CI/CD
Experience with Data Lake House technologies including Delta Tables, Unity Catalog, Delta Live, Spark Structured Streaming, Photon