DevOps Engineer - Cloud Native AI (Sovereign Cloud)
We usually respond within two weeks
Employment Type: Full-Time
Department: Engineering / AI Infrastructure
Language Requirement: Italian & English
The Opportunity: Join a Rocket Ship
AIVB isn't just a startup; we are a high-velocity scaleup redefining how AI solutions reach the market.
Hyper-Growth: 300% YoY growth, jumping from zero to £1.4M in our first full year.
Proven Pedigree: Founded by the pioneers behind Deep Learning Italia, the gold standard for AI education in Italy.
Global Ambition: Backed by £4.5M in seed funding, we are preparing for a major US-led Series A in Q4 2026 to dominate international markets.
We are building the "Operating System" for AI ventures. We don't just build products; we build companies.
About AIVB
Founded in 2024 by Marco Tognoni and Matteo Testi, AIVB is an AI Venture Builder designed to scale innovation at speed. Our team of 40 is anchored by an elite engineering core, primarily AI PhDs, who transform complex research into vertical-specific powerhouses.
We operate through a Centralized Powerhouse that develops strategic blueprints for specialized spinoffs in high-impact sectors such as Fashion, Real Estate, and CyberDefense. We are "International by Design", English is our language, and global scale is our target.
Why this role matters
We are building cutting-edge AI solutions within the boundaries of the Italian National Cloud Strategy. You won't just be clicking buttons in AWS; you will be architecting compliant, self-hosted AI platforms on sovereign infrastructure. This is a role for an engineer who understands how to build cloud-native reliability without relying on public hyperscalers.
Role Summary
As a DevOps Engineer for Sovereign AI, you will design and maintain the infrastructure that powers our AI/ML workloads on Italian National Cloud providers (e.g., PSN, Aruba, TIM Enterprise). Your focus will be on self-managed Kubernetes, strict Data Sovereignty, and implementing open-source MLOps toolchains that function independently of US-based public clouds.
Key Responsibilities
1. Sovereign Infrastructure & Orchestration
Deploy and manage production-grade Kubernetes clusters on private cloud or national provider infrastructure (using Rancher, OpenShift, or Kubespray).
Ensure high availability and disaster recovery within the specific zones/regions of the national provider.
2. Self-Hosted MLOps
Since we cannot use managed services, you will architect and maintain a self-hosted MLOps stack using tools like Kubeflow, MLflow, or Polyaxon.
Configure and optimize MinIO or Ceph for S3-compatible object storage to handle large training datasets locally.
Manage container registries (Harbor) located strictly within Italian borders.
3. Compliance & Security (GDPR/AGID)
Strictly enforce Data Sovereignty principles; ensure no data egresses outside of Italy/EU.
Implement security standards compliant with AGID (Agenzia per l'Italia Digitale) and ACN (Agenzia per la Cybersicurezza Nazionale) guidelines.
Manage strict network policies (Calico/Cilium) and air-gapped or proxy-restricted environments.
4. GPU & Hardware Optimization
Configure NVIDIA vGPU or PCI passthrough on virtualized national cloud instances.
Optimize the AI stack (CUDA drivers, Container Toolkit) for maximum performance on constrained infrastructure.
Serverless GPU usage experience
Tech Stack & Skills
The environment is "Cloud Native" but relies heavily on open-source and self-hosted equivalents of public cloud services.
Domain & Related Technology:
Cloud Environment - Italian National Cloud (Seeweb, Netalia)
Orchestration - Kubernetes, SUSE Rancher
Virtualization - OpenStack, KVM, VMware
Storage - Ceph, Rook, GlusterFS, MinIO (S3 compatible), Vast
AI/ML Platform - Kubeflow (Crucial), MLflow, JupyterHub
CI/CD - GitLab CI (Self-hosted), Jenkins, ArgoCD
Observability - Prometheus, Grafana, Loki (PLG Stack)
Qualifications
Required:
3+ years of experience in roles such as: DevOps Engineer, DevSecOps Engineer, Cloud Architect, Infrastructure Engineer, Release Engineer, Platform Engineer, MLOps
Strong expertise in Kubernetes: you must be able to deploy, manage, and troubleshoot K8s clusters without relying on external support (e.g., cloud providers)
Hands-on experience with containerization and orchestration tools (Docker, Helm)
Experience in designing and maintaining CI/CD pipelines
Solid experience with Linux System Administration (RHEL, Ubuntu, CentOS) at a deep level
Knowledge of messaging/streaming systems (e.g. Redis Streams)
Basic understanding of cybersecurity principles (secure configurations, secrets management, vulnerability awareness)
Understanding of Data Sovereignty and GDPR regulations in a technical context
Proficiency in Python and Bash scripting
Knowledge of MIG Technology (Multi-Instance GPU)
Preferred:
Experience with event-driven and autoscaling tools such as KEDA and workload schedulers like Kueue
Knowledge of GitOps principles and tools (e.g. ArgoCD, Flux)
Experience migrating workloads from AWS/Azure to Private/National Clouds
Experience working with Public Sector clients or heavily regulated industries (Finance, Healthcare)
Italian language fluency (often required for documentation with national providers)
What We Offer
Competitive salary tailored to the Italian market.
Opportunity to work on high-impact projects within the National Strategic framework.
[Welfare Plans / Buoni Pasto / CCNL Metalmeccanico or Commercio level].
Training budget for Kubernetes (CKA/CKS) and Red Hat certifications.
Do you want to be part of our team? Apply now!
- Dipartimento
- Technology
- Locations
- EU (Hybrid), Italy (Hybrid)
- Remote status
- Fully Remote
About AIVB
AIVB started in early 2024 as the natural evolution of Deep Learning Italia (the Italian Coursera). Marco Tognoni and Matteo Testi built one of the very first Venture Builders in Europe with an AI Focus. It gathered some of the most talented hands-on AI PhDs in Europe to create a unique AI Factory that is currently disrupting Real-Estate, Fashion, Defense and Cyber Resilience.
We raised in 2025, 5M£ in VC Funding.