Our client is looking for an experienced Azure Cloud/Data Engineer to develop a Customer Orchestrator end to end within a Microsoft Azure and Databricks environment.
Context
The client is building a data and information platform in Databricks within a Microsoft Azure Cloud environment. Various Azure services support the platform, while Power BI is used as the central reporting tool for business intelligence, reporting, and analytics.
Multiple data sources and applications are integrated into the platform, which is structured across several data and information layers to support advanced analytics and operational use cases.
A domain-based organization of data teams has been established. Within this structure, Data and BI specialists develop data products that support analytical and operational use cases within their respective domains.
Within the Customer & Network Operations domain, the client is developing a Customer Orchestrator. This tool will use information from data products within the domain to determine the optimal sequence for executing customer operations.
The Azure Cloud/Data Engineer will be responsible for developing the solution end to end, including:
-
Near-real-time data processing and streaming to the platform
-
Building data products in accordance with the applicable architecture and design principles
-
Exposing data products to applications through APIs and event processing
-
Developing application components, including a rule engine for the Customer Orchestrator
Project Approach
The project will be delivered in close collaboration with internal colleagues and stakeholders.
You will join a self-managing Scrum team and perform the following activities:
-
Create functional analyses and specifications and discuss them with information analysts, solution architects, application specialists, and other stakeholders
-
Develop data models across the different platform layers based on the identified business needs and applicable BI guidelines
-
Design the application components required to deliver the complete Customer Orchestrator solution
-
Take responsibility for the technical implementation within the Microsoft Azure environment, with Databricks as the primary service, from data extraction through to the final application
-
Follow the standard platform development lifecycle and comply with the applicable ICT Change and Release processes
-
Validate completed work using a test plan and help prepare the test data required to execute the test cases
-
Ensure that the solution is correctly integrated into operational processes, enabling end-to-end monitoring and achievement of the agreed service levels
-
Develop and maintain overarching communication and training materials in Confluence and Jira
-
Support and guide fellow engineers where required during the development of the end-to-end solution
Profile
-
You have strong experience as an Azure Cloud Engineer and/or Data Engineer
-
You have hands-on experience with Microsoft Azure and Databricks
-
You are experienced in data modelling, data products, APIs, event-driven processing, and near-real-time data streaming
-
You are capable of developing both data components and application components
-
You can independently deliver an end-to-end technical solution
-
You have experience working in an Agile or Scrum environment
-
You have very good spoken and written Dutch, as intensive collaboration with various stakeholders is required
-
You are able to integrate into an existing team and technical environment within two weeks
-
You are self-organized and possess a strong ability to learn quickly
-
You communicate diplomatically, transparently, and effectively with different stakeholders
-
You actively exchange information and contribute to strong collaboration within the team
-
You are pragmatic, solution-oriented, and able to work within an agreed scope
-
You analyze problems and translate them into efficient and straightforward solutions
-
You work in a structured manner and document your work carefully
-
You have an innovative mindset and continuously look for the most effective and workable solution
Additional Information
An earlier start date is negotiable.