Data engineer állás, munka

• üzleti koncepció, működési modell(ek), folyamatok
• szervezeten belüli működési modell(ek), új IT szolgáltatások kialakítást célzó, támogató IT projektekben

Crafting innovative solutions through requirements analysis, constructing workflow charts, and drafting precise specifications Transforming business requests into actionable development plans, user stories, and robust acceptance criteria Guiding projects from concept to seamless implementation,...

• Collaborate with cross-functional teams to understand and translate business requirements into data solutions.
• Ensure data quality, integrity, and governance by implementing best practices in data management.

• ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data quality.
• Monitor and troubleshoot production data pipelines, ensuring their performance and reliability.

Bridge Between Tech and Stakeholders: Act as intermediaries between engineering teams and stakeholders, ensuring clean, transformed datasets. Understand business requirements and translate them into technical specifications...

Implement and maintain large‑scale data pipelines and the Azure/Databricks data platform in close collaboration with the Architect, contributing to design discussions and proposals. Build robust, scalable pipelines using Azure Databricks (PySpark / SQL), integrating data ingestion, processing,...

Design and implement security architecture for Azure Databricks platforms Enforce Role-Based Access Control (RBAC) across Azure and Databricks environments Integrate security into DevSecOps pipelines, ensuring automated security controls and policy enforcement Manage and secure Azure resources,...

Design, write and execute comprehensive test plans, test cases and test scripts to validate ETL/data‑pipeline processes, data transformations, and data integrity (source‑to‑target, cross‑reference, reconciliation). Validate data extraction, transformation and loading processes for accuracy,...

Establishing consistent product development frameworks, discovering both customer and business needs across our diverse portfolio, without sacrificing flexibility Leading the product team's evolution to full-stack product thinkers Optimizing team structures and product roadmaps to ensure the right...

Design, implement, and manage Azure cloud infrastructure to support Databricks and data platform workloads Build and maintain Azure resources including Resource Groups, VNets, Key Vaults, Storage Accounts, and Azure Active Directory (AAD) integrations Implement Infrastructure as Code (IaC) using...

Deliver complex data engineering projects individually or by leading small delivery teams Work with Apache Spark/Databricks on AWS/Azure Manage customer relationships alone or with a Project Manager Mentor more junior engineers Evaluate the quality of junior engineers' work Contribute to hiring...

• Design and implement ETL processes
• Develop and maintain data pipelines to ingest, transform, and load data from various sources
• Ensuring development tasks to support new release of the project/solutions
• Support production issues, or requests
• Ensure data quality and integrity throughout the ETL lifecycle

Architect, build and maintain backend services and APIs using Python and web frameworks such as Flask or Django (or comparable) Design and implement RESTful APIs / microservices, ensuring clean, maintainable, and efficient code, adhering to best practices (coding standards, documentation, testing)...

Steer and drive the high-level technology direction of Datapao, including how projects are delivered, solutions built, scaled, and technical teams enabled Oversee the technology strategy of Datapao, including key technical areas, projects, capabilities, standards, and roadmaps; align them with...

Design & implement AI/ML solutions Build end-to-end ML/AI pipelines: data ingestion, preprocessing, feature engineering, model training, evaluation, deployment and monitoring Develop AI-powered applications and services using Python and modern ML frameworks (e.g., PyTorch, TensorFlow, scikit-learn)...

Implement and maintain large‑scale data pipelines and the Azure/Databricks data platform in close collaboration with the Architect, contributing to design discussions and proposals. Build robust, scalable pipelines using Azure Databricks (PySpark / SQL), integrating data ingestion, processing,...

Take ownership of technical challenges, bringing curiosity and resourcefulness to ambiguous problems. Define and drive the development of complex features ensuring scalability, reliability, and security. Translate business requirements into clear technical plans, communicating risk/impact crisply....

• Termékfejlesztéssel kapcsolatos üzleti igények, visszajelzések gyűjtése (kapcsolódó interjúk, UAT-ok, megbeszélések szervezése és vezetése)
• Részvétel az üzleti megoldások tervezésében

• Az üzleti elemzés támogatása a tervezés és koncepció készítés során, hogy a technológiai korlátokat figyelembe véve a leginkább felhasználóbarát felületek készülhessenek.
• Az architektek támogatása az optimális kliens oldali technológiák kiválasztásában az adott projekten belül.

Work in cross-functional agile teams alongside data scientists, machine learning engineers, product managers, and industry experts to innovate with clients and consulting teams Develop new or enhance existing assets Design and build robust, modular, scalable, and secure data pipelines for machine...