Python programmer állások X. kerületben (adatbázisszakértő)

• Design, build, and deploy production-grade agentic AI and automation solutions that collect, validate, and quality-assure data at scale
• Engineer multi-agent orchestrations, data pipelines, MCP integrations, and API connections that power autonomous, end-to-end data workflows

• Understanding underlying data structure of an ERP system (Microsoft Dynamics 365 Finance & Operations)
• Creating technical specification (design) documents for functional requirements
• Managing existing and creating new automations using Alteryx, Python, SSIS
• Creating reports and dashboards in Power BI

Vizualizáció és döntéstámogatás: Interaktív Dashboardok és riportok készítése, ahol a vezetők valós időben követhetik a cég fő mutatóit, amelyek közvetlenül támogatják a döntéshozatalt. A keletkező nagy mennyiségű adat tisztítása, rendszerezése, értelmes, emészthető és számszerűsíthető...

• Dashboard development for sustainability data visualization
• Data integration from various sources for comprehensive reports
• Client reporting collaboration with sustainability team
• Data analysis to identify trends and insights for sustainability initiatives

• Design and build scalable, reusable frameworks and services for data ingestion, transformation, and processing
• Develop and maintain the platform’s core capabilities such as orchestration, data quality validation, and schema management tools

• Maintaining and evolving data structures
• Building new ETL flows and maintaining or improving existing ones
• Designing new data structures and data modelling concepts
• Ensuring data quality by verifying data consistency and accuracy
• Creating data validation methods

adatbázis lekérdezések elkészítése, adathibák feltárása és javítása üzleti igényeknek megfelelő magas szintű figyelem a részletekre az adatinkonzisztenciák, hibák és anomáliák azonosításában és javításában projektjellegű és rendszeres adattisztítási feladatok önálló elvégzése adattisztítási...

• statisztikai és gépi tanulási modellek fejlesztése, karbantartása és monitorozása
• piackutatások készítése
• adatvezérelt megoldások kidolgozása az értékesítés, kárrendezés, ügyfélkiszolgálás és termékterületek támogatására

• Ownership of data engineering features, architecture, and code quality
• Design, implementation, and maintenance of Databricks-based data pipelines and workflows
• Building and optimization of ETL/ELT processes using Apache Spark on Databricks

Performing tasks related to the position....

• Managing day-to-day operations of Databricks data pipelines, including monitoring, troubleshooting, and performance tuning
• Maintaining Delta Lake data layers (bronze / silver / gold), ensuring data availability, consistency, and smooth pipeline execution

• Development, testing, and maintenance of data pipelines to extract, transform, and load (ETL) data from various sources
• Writing high-quality, maintainable Python code
• Participation in code reviews
• Participation in technical discussions for tool selection and architectural decisions

• Designing data pipelines
• Implementing data pipelines
• Testing data pipelines
• Optimizing data pipelines
• Automating data extraction, loading and transformation
• Developing automated data acquisition solutions
• Ensuring compliance with data security standards
• Analyzing data flows and processes

• Design and implement modern data architectures and lakehouse solutions
• Provide technical leadership throughout the project lifecycle
• Collaborate with business stakeholders
• Create effort estimations
• Provide technical expertise during the pre-sales phase
• Mentor 3-6 person project teams

• Design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments (Azure, AWS, or GCP)
• Design, build, and optimize modular data pipelines using Delta Lake to ensure data efficiency, reliability, and quality

• Design, develop, and optimize scalable data pipelines for processing large-scale structured and unstructured data
• Ensure reliability, performance, and scalability of data systems
• Build solutions to handle real-time streaming data from multiple sources

• Design and implement pipelines to ingest, clean, and transform data into Data Lakes and Data Warehouses
• Active monitoring and optimization of pipelines for performance and cost
• Configuration of pipeline deployments and management of environment settings using IaC tools and CI/CD

• Lead the design and implementation of scalable data pipelines and Lakehouse architectures
• Act as the design authority
• Solve the hardest technical challenges including optimizing high-load streaming pipelines, debugging complex Spark jobs, and designing generic frameworks

• Measuring performance of multi-channel patient recruitment campaigns across clinical trial portfolios
• Optimizing performance of multi-channel patient recruitment campaigns across clinical trial portfolios

• Data pipeline development
• Data integration
• Data warehousing
• Data modelling
• Data quality and governance
• Performance optimization
• Collaboration with data scientists and analysts
• Technology selection
• Security and compliance
• Monitoring and troubleshooting