Data scientist állások, munkák programozó, fejlesztő kategóriában

Implement and maintain large‑scale data pipelines and the Azure/Databricks data platform in close collaboration with the Architect, contributing to design discussions and proposals. Build robust, scalable pipelines using Azure Databricks (PySpark / SQL), integrating data ingestion, processing,...

• Develop and optimize our job data crawling pipeline, ensuring high-quality job data acquisition.
• Implement and refine import mapping, improving data accuracy and classification.
• Support the integration of external data sources via APIs or scraping frameworks.

• Keep data moving: Build, run, and refine data pipelines and workflows (Python, Airflow/Cloud Composer) so they're reliable, fast, and easy to change
• Shape our data models: Use BigQueryand Cloud Spanner to design wellstructured, highperformance datasets for analytics and machinelearning use cases

Developing and maintaining data pipelines in Azure Databricks Writing transformation logic using Python and SQL Supporting data migrations and platform improvements Working within a structured, company-level Databricks framework Collaborating in a Scrum-based setup (2-week sprints, Jira, daily...