Data engineer állás, munka

• Learn data engineering principles
• Learn to design and implement ETL processes and pipelines
• Work with SQL, Python and different programming languages and notebooks
• Learn Power BI report building, Data Bricks and various ETL tools

• Design, build, and maintain robust data pipelines that are scalable, efficient, and meet business needs
• Collaborate with cross-functional teams to understand and translate business requirements into data solutions

• riportigények, adatforrások specifikálása
• adatfeldolgozási folyamatok, adathalmazok rendszerezése, adatmodellek kialakítása
• riport megoldások tervezése, specifikálása, kialakítása, dokumentálása
• folyamat monitoring
• Számvitel csoport saját, belső ellenőrzési folyamatainak automatizálása; 

• Manage and maintain dataflow processes within the local YouGov Shopper Operation.
• Maintain and update the YouGov Shopper master databases to ensure data accuracy and consistency.
• Monitor and troubleshoot dataflow processes to ensure smooth and timely data delivery.

• Nehezen elérhető adatok manuális kigyűjtése SAP ARIBA rendszerből
• Adatok tisztítása, strukturálása és validálása reporting célokra
• Adatkészletek előkészítése EPM data platform feltöltéshez
• Manuális folyamatok megértése és automatizációs lehetőségek keresése

• Learn Generative AI principles and models
• Learn Large Language Models, Natural language processing
• Work with Different generative AI Tools and uses
• Learn the LLMs, NLP fundamentals, Transformers, and attention mechanism
• Build Custom dataset for LLM, Build your own custom chatbot/AI bot/custom GPT

• Komplex Excel megoldások kialakítása és optimalizálása
• Power Query alapú adatfeldolgozás
• Makrók és script megoldások készítése
• Feladatautomatizálást segítő VB scriptek fejlesztése és módosítása
• Adatkezelési és adminisztratív folyamatok támogatása

Maintaining and evolving our existing data platform Building processes to ingest data from Kafka, APIs and Databases using AWS MSK Connect Development and Maintenance of real-time data processing applications using frameworks like Spark Structured Streaming and Kafka Streams Applying...

Develop, optimize, and maintain backend services using Java, leveraging internal framework components Be a key contributor in the architectural decisions which help us build the framework Work on data pipelines that power operations for various different sports like American football or ice hockey...

Work in cross-functional agile teams alongside data scientists, machine learning engineers, product managers, and industry experts to innovate with clients and consulting teams Design and build robust, modular, scalable, and secure data pipelines for machine learning that are deployable,...

Designing and developing platform to fulfil business needs Design new data pipelines Maintain platforms hosted on data streams for batch-loading and real-time visualisations Maintaining and evolving existing data platform Follow and mentor engineers on data modelling following standards e.g. Inmon,...

Deliver complex data engineering projects individually or by leading small delivery teams Work with EMEA and US customers to solve data engineering, ML, ML Ops, and cloud migration challenges Set up new data architectures from scratch Guide customers through adopting the latest technologies Manage...

Maintaining and evolving our Data Structures Build new ETL flows and maintain/improve existing ones Be part of designing new data structures and data modelling concepts Ensure data quality by verifying data consistency and accuracy – being able to create data validation methods Write, optimize, and...

Design, write and execute comprehensive test plans, test cases and test scripts to validate ETL/data‑pipeline processes, data transformations, and data integrity (source‑to‑target, cross‑reference, reconciliation). Validate data extraction, transformation and loading processes for accuracy,...

Implement and maintain large‑scale data pipelines and the Azure/Databricks data platform in close collaboration with the Architect, contributing to design discussions and proposals. Build robust, scalable pipelines using Azure Databricks (PySpark / SQL), integrating data ingestion, processing,...

Lead or participate in scoping the engagement, designing high-level architecture, defining subtasks, and project delivery schedules Deliver projects independently or within a mixed DS/DE team, often as technical lead Act as client-facing interface or SPOC to customers Provide ML/DS consultancy to...

Implement and maintain large‑scale data pipelines and the Azure/Databricks data platform in close collaboration with the Architect, contributing to design discussions and proposals. Build robust, scalable pipelines using Azure Databricks (PySpark / SQL), integrating data ingestion, processing,...