Kluczowe kompetencje: Bardzo dobra znajomość języka Python. Doświadczenie z Databricks i Azure Machine Learning. Umiejętność projektowania potoków danych (ETL/ELT). Zrozumienie zasad CI/CD i ich zastosowania w środowiskach AI/ML. Zdolność do współpra
2024-12-19 15:13:44EngeniousQualifications Mandatory skills: Data Processing: Apache Spark - Scala or Python Data Storage: Apache HDFS or respective cloud alternative Resource Manager: Apache Yarn or respective cloud alternative Lakehouse: Apache Hive/Kyuubi or alternative Work
2024-11-07 10:55:10Tesco TechnologyWhat kind of experience should you have? Strong hands-on experience with Azure cloud services, including Spark/Databricks, and a deep understanding of cloud-based data architectures. Minimum 5 years of experience as a Data Engineer Proficiency in Pyt
2024-12-11 16:29:16Medius2+ years of experience Experience in working with low-code solutions Experience in working with large data volumes Good knowledge of Microsoft Azure Platform (Azure Data Factory, Logic App, Service Bus, Azure SQL Server) Experience with data modeling
2024-12-27 15:15:45Kambu8+ years experience in Java, Scala or Python development 3+ years of experience in Big Data systems development Experience building complex data pipelines with data transformation tools like DBT or Dataform and SQL. Expertise using BigQuery or other
2024-12-23 10:17:34OpenXYour responsibilities, Develop and maintain ML algorithms and workflows on Databricks to assess patient risk and screen and match patients for clinical trials based on historical health records., Collaborate with clinical and technical teams to..
2024-12-20 09:40:32Kluczowe kompetencje: Bardzo dobra znajomość języka Python. Doświadczenie z Databricks i Azure Machine Learning. Umiejętność projektowania potoków danych (ETL/ELT). Zrozumienie zasad CI/CD i ich zastosowania w środowiskach AI/ML. Zdolność do współpra
2024-12-19 15:13:44EngeniousYour responsibilities, In brief:, • Design, build, and continuously scale the data ingestion, preparation, modeling, and aggregation in our data warehouse, while ensuring data quality and implementing industry best practices., • Contribute to..
2024-12-19 10:40:40Your responsibilities, Design, develop and maintain robust data pipelines using Python, Spark, Hadoop, SQL for batch and streaming data processing, Collaborate with cross-functional teams to understand data requirements and design efficient..
2024-12-18 09:40:35Your responsibilities, Migration from on-prem SQL Data Warehouse to Databricks., Developing pySpark applications and Spark jobs., Maintaining Databricks workspaces, clusters, and jobs., Integrating Databricks applications with various..
2024-12-13 13:40:41Requirements Bachelor or Masters Degree in (business) informatics and relevant job experience Experienced in SQL, Python Experience with the development and operation of cloud technologies (Microsoft Azure, GCP, AWS) Experience with modeling data (St
2024-12-12 15:56:22ALDI Tech HubWhat kind of experience should you have? Strong hands-on experience with Azure cloud services, including Spark/Databricks, and a deep understanding of cloud-based data architectures. Minimum 5 years of experience as a Data Engineer Proficiency in Pyt
2024-12-11 16:29:16MediusYou’re ideal for the role if you have: 5+ years of experience as a Data Engineer with strong hands-on expertise in Azure cloud services, including Spark/Databricks. Proficiency in Python and SQL, with a proven track record of building and optimizing
2024-12-04 09:56:51ITDSYour responsibilities, Design and implement scalable data processing infrastructures and ETL pipelines on Azure to support data-driven applications and AI/ML models., Establish robust data governance practices to ensure data security, integrity,..
2024-12-02 15:40:50Your responsibilities, Technical Activities: coordinating and executing data migration activities, including data extraction, cleansing, loading, and reconciliation; designing and implementing data mapping, transformation, and validation processes..
2024-11-28 09:40:33Your responsibilities, Develop new data pipelines and maintain our data ecosystem, with a strong focus on fault-tolerant data ingestion, storage, and lifecycle management, as well as the computation of metrics, reports, and derived insights; ,..
2024-11-20 16:40:29Your responsibilities, Design and implement data pipelines using DBT for transformation and modeling;, Manage and optimize data warehouse solutions on Snowflake;, Develop and maintain ETL processes using Fivetran for data ingestion;, Utilize..
2024-11-20 09:40:39Your responsibilities, Develop software and engineer services which handle billions of records, analyse large datasets and find value in the data., Work on the prominent timeseries technology in financial markets., Build expertise in a functional..
2024-11-19 16:40:37Twój zakres obowiązków, Projektowanie, budowa, testowanie i utrzymanie skalowalnych systemów zarządzania danymi,, Integracja nowych technologii zarządzania danymi i narzędzi inżynierii oprogramowania,, Tworzenie i wdrażanie metod zbierania i..
2024-11-12 14:40:45Qualifications Mandatory skills: Data Processing: Apache Spark - Scala or Python Data Storage: Apache HDFS or respective cloud alternative Resource Manager: Apache Yarn or respective cloud alternative Lakehouse: Apache Hive/Kyuubi or alternative Work
2024-11-07 10:55:10Tesco Technology 4,9Your responsibilities, Designing, developing, testing, and deploying data ingest, refinement, and presentation layers, Operating and iterating on cloud data platform capabilities to meet internal engineering needs, Ensuring data quality through..
2024-11-06 14:40:40Your responsibilities, Participation in the software development process based on Agile methodology, Building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Cloud..
2024-11-04 16:40:34Your responsibilities, Working with a data platform to develop and make decisions about architectural changes., Migrating data marts to improve performance and resilience., Implementing features and working with business-critical pipelines to..
2024-11-01 00:40:05Your responsibilities, Develop and maintain data architecture strategy, Own data warehouse – the backend of our B2B SaaS platform, Work directly with customers on data ingest and reporting requirements, Manage the process of data ingestion into..
2024-10-31 15:40:48Your responsibilities, Create and maintain optimal data pipeline architecture, Assemble large complex data sets that meet functional / non-functional business requirements., Identify design and implement internal process improvements: automating..
2024-10-30 16:40:32Ul. Mogilska 35
2024-10-29 08:56:05Stonex PolandUl. Mieszczańska
2024-10-25 13:56:03KambuYour responsibilities, Design and implement data pipelines using Spark and GCP cloud-based data stack technologies, Maintain data quality and ensure governance across data processes, Manage Infrastructure as Code (IaC) utilizing Terraform, Oversee..
2024-10-23 11:40:41Your responsibilities, Developing complex data products to assess the effectiveness of marketing campaigns, Building and maintaining ETL pipelines which process billions of records, Supporting Data Scientist through data provisioning, Maintaining..
2024-10-18 09:41:33Your responsibilities, Understands system protocols, how systems operate and data flows. Aware of current and emerging technology tools and their benefits., Expected to independently develop a full software stack., Understands the building blocks,..
2024-10-14 17:41:06You’re ideal for the role if you have: 5+ years of experience as a Data Engineer with strong hands-on expertise in Azure cloud services, including Spark/Databricks. Proficiency in Python and SQL, with a proven track record of building and optimizing
2024-12-04 09:56:51ITDSWhat you need to have to succeed in this role: An analytical mind and are excited about problem-solving complex data engineering problems. Strong computer science fundamentals or have worked with functional programming languages (e.g. Clojure, Haskel
2024-11-19 15:39:42HSBC Technology Poland