Senior Data Engineer
<div class="show-more-less-html__markup show-more-less-html__markup--clamp-after-5 relative overflow-hidden"> <p><strong>Role: Sr. Data Engineer </strong></p><p><strong>Location: Remote (Germany)</strong></p><p><br/></p><p>Job Responsibilities</p><ul><li>Design, develop, and maintain scalable and high-performance data pipelines using <strong>Databricks</strong> and <strong>Azure Data Services</strong>.</li><li>Build and manage end-to-end data solutions leveraging <strong>Microsoft Fabric</strong>, including Data Factory, Lakehouse, Data Warehouse, and Real-Time Analytics capabilities.</li><li>Develop and optimize ETL/ELT processes for structured, semi-structured, and unstructured data.</li><li>Implement and maintain modern data lakehouse architectures using <strong>Databricks Delta Lake</strong> and <strong>Microsoft Fabric</strong>.</li><li>Collaborate with business stakeholders, data analysts, and data scientists to understand data requirements and deliver robust solutions.</li><li>Design data models, data integration frameworks, and data governance processes to ensure data quality and consistency.</li><li>Optimize performance, scalability, and cost efficiency of cloud-based data platforms.</li><li>Implement data security, monitoring, and compliance standards across Azure and Fabric environments.</li><li>Troubleshoot complex data processing issues and provide technical leadership on best practices.</li><li>Support CI/CD implementation, automation, and infrastructure-as-code practices for data engineering solutions.</li></ul><p>Mandatory Skills</p><ul><li><strong>Strong hands-on experience with Databricks</strong> (mandatory).</li><li><strong>Strong experience with Microsoft Azure</strong> data services (mandatory).</li><li><strong>Strong experience with Microsoft Fabric</strong> (mandatory).</li><li>Expertise in <strong>PySpark</strong>, <strong>Spark SQL</strong>, and distributed data processing.</li><li>Experience with <strong>Azure Data Factory (ADF)</strong>, <strong>Azure Data Lake Storage (ADLS)</strong>, <strong>Azure Synapse Analytics</strong>, and related Azure services.</li><li>Strong knowledge of <strong>Delta Lake</strong>, Lakehouse architecture, and data warehousing concepts.</li><li>Experience building large-scale ETL/ELT pipelines and data integration solutions.</li><li>Proficiency in SQL and data modeling techniques.</li><li>Experience with version control systems such as Git and CI/CD pipelines.</li><li>Understanding of data governance, security, and performance optimization best practices.</li></ul><p><br/></p><p>Preferred Qualifications</p><ul><li>Experience with real-time/streaming data processing.</li><li>Knowledge of Power BI integration with Microsoft Fabric.</li><li>Exposure to DevOps practices and infrastructure automation.</li><li>Azure and/or Microsoft Fabric certifications are highly preferred.</li><li>Experience working in Agile/Scrum environments.</li><li>Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.</li></ul><p><strong>Must-Have Technologies:</strong> Databricks, Microsoft Azure, Microsoft Fabric, PySpark, SQL, Delta Lake, ADF, ADLS.</p> </div>