Job Title: Data & AI Platform Architect (Databricks Specialist)
Location:Manchester or London
Employment Type:Full-time
Experience Level:Senior
About the Role
As aData & AI Platform Architect, you will work closely with clients to design, implement, and optimize Databricks-based platforms tailored to their unique needs. You will play a critical role in shaping the data strategy for diverse industries, leading teams to deliver scalable, efficient, and secure solutions that unlock the value of data and AI.
This role requires a deep understanding of data engineering, machine learning, and cloud-native architectures, coupled with exceptional consulting and stakeholder management skills.
Key Responsibilities
- Client Engagement:Collaborate with clients to understand their business goals and technical requirements, translating them into scalable data platform architectures.
- Platform Design & Implementation:Design and implement Databricks-based data platforms, leveraging Delta Lake, Spark, MLflow, and other tools to meet client needs.
- Solution Delivery:Lead technical teams in delivering robust, end-to-end data pipelines, machine learning workflows, and AI-powered solutions.
- Optimization & Best Practices:Ensure the delivery of cost-efficient, high-performing, and secure solutions by applying industry best practices and innovative approaches.
- Cloud Integration:Architect and deploy solutions leveraging cloud platforms like Azure, AWS, or GCP, ensuring seamless integration with clients' existing systems.
- Data Governance:Implement governance frameworks for data security, quality, and compliance tailored to client-specific requirements.
- Thought Leadership:Provide insights on emerging trends in data and AI, conducting workshops and presenting recommendations to clients and stakeholders.
- Team Leadership:Mentor junior consultants and contribute to developing the company’s data and AI consulting methodology.
Requirements:
7+ years of experience in data platform implementation, with significant hands-on expertise in Databricks.
Proven experience working in consulting or client-facing roles, delivering complex solutions to enterprise clients.
Strong proficiency in Databricks, Delta Lake, Spark, and MLflow.
Expertise in Python, SQL, and optionally Scala.
Extensive knowledge of ETL/ELT pipelines, data lakes, data warehousing, and real-time data processing.
Hands-on experience with cloud platforms like Azure (preferred), AWS, or GCP.
Strong client-facing skills, including the ability to translate technical concepts into business value.
Exceptional problem-solving and stakeholder management abilities.
Experience in AI/ML workflows and operationalization of machine learning models.
Familiarity with visualization tools like Power BI or Tableau.
Relevant certifications (e.g., Databricks Certified Professional, Azure Solutions Architect).
Experience in industries such as finance, healthcare, or retail.
Why Join Us?
- Impactful Work:Collaborate with our clients on transformational data and AI projects.
- Professional Growth:Opportunities to lead projects, mentor teams, and advance your technical and consulting expertise.
- Innovative Culture:Work with cutting-edge technologies and stay at the forefront of data and AI innovation.
- Competitive Package:Attractive compensation, benefits, and flexible working arrangements.