Opis oferty pracy
Niniejsze ogłoszenie dotyczy pracy w N-iX
________
We are seeking a Senior Data Engineer specializing in Databricks to join our global team. You will be instrumental in setting up and maintaining our Databricks platform, building robust data pipelines, and collaborating closely with our solution architects and data scientists. Your expertise will directly support our mission to leverage data and AI effectively within a cutting-edge automotive claims management environment.
Zakres Obowiązków i odpowiedzialności
- Design, build, and maintain robust data pipelines within Databricks.
- Collaborate closely with international teams, including data scientists and architects, to develop scalable data solutions.
- Debug complex issues in data pipelines and proactively enhance system performance and reliability.
- Set up Databricks environments on cloud platforms (Azure/AWS).
- Automate processes using CI/CD practices and infrastructure tools such as Terraform.
- Create and maintain detailed documentation, including workflows and operational checklists.
- Develop integration and unit tests to ensure data quality and reliability.
- Migrate legacy data systems to Databricks, ensuring minimal disruption.
- Participate actively in defining data governance and management strategies.
Wymagane Kompetencje i doświadczenie
- 5+ years of proven experience as a Data Engineer.
- Advanced proficiency in Python for developing production-grade data pipelines.
- Extensive hands-on experience with Databricks platform.
- Strong knowledge of Apache Spark for big data processing.
- Familiarity with cloud environments, specifically Azure or AWS.
- Proficiency with SQL and experience managing relational databases (MS SQL preferred).
- Practical experience with Airflow or similar data orchestration tools.
- Strong understanding of CI/CD pipelines and experience with tools like GitLab.
- Solid skills in debugging complex data pipeline issues.
- Proficiency in structured documentation practices.
- B2 level or higher proficiency in English.
- Strong collaboration skills, ability to adapt, and eagerness to learn in an international team environment.
Mile widziane
- Experience with Docker and Kubernetes.
- Familiarity with Elasticsearch or other vector databases.
- Understanding of DBT (data build tool).
- Ability to travel abroad twice a year for on-site workshops.
To oferujemy
Why Join Us
- Work on impactful projects with cross-functional teams.
- Opportunity to grow your BI and analytics career in a data-driven organization.
- Flexible working hours and remote work options.
- Competitive compensation and benefits.
- Opportunity to work on presales
We offer*:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
Nota prawna
*Powyższe ogłoszenie zostało opublikowane grzecznościowo przez administrację portalu DigiJobs.pro i nie stanowi oferty w świetle obowiązującego prawa. Portal nie bierze odpowiedzialności za prowadzenie procesu rekrutacyjnego, jedynie cytuje treść oficjalnego ogłoszenia. Aplikowanie na ofertę pracy odbywa się bezpośrednio na stronie Pracodawcy wskazanego w ogłoszeniu lub platformie zewnętrznej wskazanej przez Pracodawcę do tego celu w zewnętrznych źródłach.