Om uppdraget
The project is completing a Proof of Value for an Enterprise Data Catalog built as a Databricks App. The solution is intended to provide secure and scalable metadata discovery, search, glossary navigation and governed access to data assets for a large enterprise user base. Unity Catalog is the technical governance backbone, complemented by stewardship workflows, classification, lineage and AI-assisted discovery capabilities. The assignment supports continued development and potential implementation of the application.
Plats och erfarenhet
- Plats
- Stockholm Sweden
- Erfarenhetsnivå
- Senior
Arbetsuppgifter
- Design and develop the Enterprise Data Catalog application, including front-end and back-end components.
- Integrate the application with Unity Catalog APIs, Databricks services, metadata sources and external systems.
- Implement secure authentication, SSO, role-based and group-based authorisation, and user-context data access.
- Design high-performing metadata search, caching and indexing for a large user base.
- Implement CI/CD, automated testing, audit logging, monitoring and application observability.
- Support deployment, security and architecture reviews, troubleshooting and performance optimisation.
- Produce maintainable code, configuration and technical documentation, and provide knowledge transfer.
- Production-ready application components and integrations.
- Secure and scalable technical design and documented implementation decisions.
- Automated build, test and deployment pipelines.
- Monitoring, logging, operational documentation and support model inputs.
- Technical handover and knowledge transfer to the internal team.
Krav
- Experience designing enterprise-scale web applications supporting large user groups.
Meriterande
- Living in / around Solna office is ideal but full remote working can be considered for this role. Office presence not mandatory.
Obligatoriska kompetenser
- Strong Databricks Apps development experience using React, Node.js, Python, Streamlit or similar technologies.
- Experience integrating with Unity Catalog APIs and metadata services.
- Proven experience implementing OAuth, Microsoft Entra ID, SSO, RBAC and group-based authorisation.
- Strong knowledge of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture and governance.
- Experience integrating external systems through REST APIs.
- Experience with CI/CD, Git and Azure DevOps or GitHub Actions.
- Experience implementing audit logging, monitoring and application observability.
- Good understanding of metadata management, data catalogues, business glossaries and data governance.
- Experience designing search, caching and indexing solutions for high-concurrency applications.
- Experience integrating through the Databricks SDK and/or REST APIs.
Meriterande kompetenser
- MCP / JSON-RPC integration patterns.
- Databricks Genie and Genie Ontology.
- Unity Gateway or comparable governed data-access patterns.
- Metadata classification, lineage and stewardship workflows.
Kvalifikationer
Utbildning
- Bachelor or Master in relevant engineering field.
Språk
- English language is required