Data Engineer

Munkaidő, foglalkoztatás jellege
- Alkalmazotti jogviszony
- Általános munkarend
Elvárt technológiák
- SECURITY TESTING JAVA BASH APACHE PYTHON SQL AZURE SPARK DATABASES TROUBLESHOOTING JSON XML JAVASCRIPT
Elvárások
- Angol középfok
- 1-3 év tapasztalat
- Középiskola

Állás elmentve

A hirdetést eltávolítottuk a mentett állásai közül.

Designing, implementing, testing, and optimizing reliable, efficient, and high-quality data pipelines
Automating the extraction, loading and transformation of data from a wide variety of sources
Developing solutions for the automated acquisition of data from source systems
Ensuring compliance with data security standards and guidelines
Analyzing data flows and processes to identify opportunities for improvement
Collaborating with project teams and business stakeholders primarily across Europe, with interaction with colleagues based in India
Identifying and evaluating data provisioning capabilities across various source systems and technologies
Analyzing data and investigating data quality issues in close collaboration with business stakeholders
Maintaining, troubleshooting, and continuously improving existing data pipelines

Proven track record of building data sets and data pipelines for analytical use cases
Proficiency in Python, PySpark, and SQL
Expert-level experience in building and optimizing data lakes, distributed data processing solutions, and data pipelines, particularly using Apache Spark
Hands-on experience with the Azure data ecosystem, including Databricks and Azure Data Factory
Strong knowledge of common data formats, including JSON, XML, Parquet, and CSV
Excellent analytical skills and architectural expertise to select the most appropriate technology for each use case
Strong understanding of non-functional requirements, including performance, data quality, and security
Experience working with relational databases and advanced SQL skills
Experience with deployment automation, testing, CI/CD practices, and the setup of monitoring, alerting, and logging for data platforms and services
Fluency in spoken and written English

Experience with additional programming languages such as JavaScript, Scala, Java, and shell scripting (Bash, Ksh, Sh)

Hybrid working with even only weekly 2 office days and flexible working hours based on core time
Financial benefits such as an outstanding amount of cafeteria, referral reward and team or individual reward based on accomplishments
Corporate health insurance package at one of the largest private healthcare providers with nationwide coverage
Carefully designed career paths, with the appropriate training courses and projects to accomplish aims such as language courses, tech talks and trainings
Lufthansa Group flight ticket discounts