Senior Data Engineer / Consultant - Databricks & Azure (m/w/d) in Erlangen, Deutschland

Do you want to help shape architectural decisions, develop them yourself, and experience the impact of your work on clients? At Data Insight Consulting, you'll support companies from technical conception to productive data pipelines and reliable analyses.

We are a Hamburg-based consulting firm specializing in Databricks and Microsoft Azure. We combine data engineering, modern data architecture, business intelligence, and AI for companies in the DACH region (Germany, Austria, and Switzerland). To strengthen our team, we are looking for an experienced individual who can take on technical responsibility and provide clear and understandable consulting services to clients.

Your tasks

• Developing data platforms: You design and implement Lakehouse solutions on Databricks and Azure – from connecting data sources to deployment for analytics and AI.
• Making pipelines production-ready: You develop with Python, PySpark and SQL, improve existing solutions and establish tests, monitoring and automated deployments.
• Designing architecture: You make transparent decisions regarding data models, processing, and interfaces. In doing so, you consider maintainability, performance, and costs.
• Establish data quality and governance: You implement quality checks, authorization concepts and traceable data management, for example with Unity Catalog.
• Advising clients: You translate technical requirements into actionable work packages, explain technical options, and make effort and risks transparent.
• Sharing knowledge: You support colleagues through reviews and professional exchange and empower customer teams to further develop solutions.

This is what you bring with you

• Several years of practical experience in data engineering and responsibility for productive data solutions.
• Solid project experience with Databricks and Microsoft Azure, especially in the development or enhancement of data platforms.
• Excellent knowledge of Python/PySpark and SQL.
• Experience with Lakehouse architectures, Delta Lake, and data modeling.
• A secure handling of Git, CI/CD and automated tests.
• The ability to systematically analyze errors and improve solutions in terms of reliability, runtime, and cost.
• Experience in direct interaction with customers or specialist departments.
• Excellent German skills for customer service and good English skills.

For us, seniority is demonstrated by your ability to justify decisions, take responsibility, and help others advance professionally.

This makes you a particularly good addition to our team.

You don't need to bring everything. Experience with the following is also interesting:

• Data Vault 2.0 and the migration of existing data warehouse solutions.
• Power BI, semantic data models and self-service analytics.
• Terraform und Infrastructure as Code.
• MLflow, RAG, or the integration of AI applications into enterprise data platforms.
• Databricks or Azure certifications.

What you can expect from us

• A clear professional focus on Databricks, Azure and modern data platforms.
• Client projects that combine architecture, practical implementation, and professional benefits.
• The opportunity to help shape technical standards and reusable solutions.
• Direct communication with customers and responsibility for verifiable results.
• Space to contribute your experience and further develop our consulting services professionally.

Let's get to know each other

Send us your CV or a link to your professional profile to [email protected] .

We are particularly interested in a project where you took on technical responsibility: What was the challenge, what contribution did you make, and what was achieved?

Please also tell us your possible start date and your salary expectations. A detailed cover letter is not required.

Data Insight Consulting GmbH · Hamburg

We welcome applications regardless of gender, origin, age, disability, religion or sexual identity.

Salary: €70,000.00 - €90,000.00 per year

Services:

• In-company training
• Flexible working hours
• Flexible working hours
• Home office option
• Free drinks
• Additional vacation days

Work location: Home office