About Salvo Software Salvo Software is a integral technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence. We're growing our AI department and are looking for a hands-on AI Developer to help build it.
Role Overview We are looking for an AI Developer to join and strengthen our AI department. Your core work will be building and operating LLM-powered systems: serving open-source models with Ollama and llama.cpp, building RAG pipelines, and developing MCP integrations that connect large languange models to real tools and data. Solid DevOps fundamentals - Docker, CI/CD, Azure - support this work, but AI engineering is the heart of the role.
You don't need to be a deep ML researcher. What matters is production-grade Python, strong fundamentals, and the aptitude to learn fast. You'll work closely with our engineering and product teams to take LLM-powered features from prototype to reliably deployed systems, with mentorship available as you ramp up in areas like RAG architecture, Kafka, and advanced MCP work.
Key Responsibilities AI / LLM Engineering (core focus)
Serve and operate open-source LLMs using Ollama and llama.cpp, locally and in on-prem environments.
Build and maintain RAG pipelines: embeddings, vector databases, chunking strategies, and retrieval quality.
Develop MCP (Model Context Protocol) integrations connecting LLMs to internal tools and data sources.




Build backend services in Python that power ML inference and AI-driven product features.
Parse and process structured and semi-structured data (XML/XSD, Office document formats) as pipeline inputs.
Grow into model optimization over time: quantization (GGUF), GPU/CUDA tuning, and offline/air-gapped deployments.
DevOps & Infrastructure (supporting)
Build and maintain CI/CD pipelines for AI services (Azure DevOps preferred; GitHub Actions / GitLab CI also used).
Deploy AI workloads to Microsoft Azure,AWS and containerize services with Docker.
Automate operational tasks with Python, Bash and/or PowerShell scripting.
Troubleshoot across the stack - dig into root causes rather than patching symptoms.
Support event-driven architectures using Apache Kafka (producers/consumers).
Requirements
Required
Production-level Python - real services and pipelines, not just scripts.
Hands-on experience serving LLMs with Ollama and/or llama.cpp.
3–5 years of hands-on experience across backend, ML engineering, DevOps, or infrastructure.
Working knowledge of Docker and Linux fundamentals.
Experience with Microsoft Azure, AWS and cloud-based deployments.




Practical experience building and maintaining CI/CD pipelines (Azure DevOps strongly preferred; GitHub Actions / GitLab CI also relevant).
Comfortable scripting in Python, Bash and/or PowerShell.
Strong Git fundamentals and branching/workflow discipline.
A troubleshooting mindset - able to work through ambiguity and dig into root causes.
Fast learner with genuine aptitude and willingness to pick up new tools quickly.
Good communication and collaboration skills; comfortable in a remote, distributed team.
GPU/CUDA troubleshooting experience.

Should Have (can ramp up with mentorship)
RAG concepts: vector databases, embeddings, chunking strategies.
Advanced MCP (Model Context Protocol) knowledge.
Kubernetes (kubectl basics).
Infrastructure as code with Terraform.
Apache Kafka fundamentals (producer/consumer patterns).

Nice to Have
A systems language: Go, Rust, C++, or Zig.
llama.cpp at a deeper level - building and quantizing models.
Observability tooling (Prometheus/Grafana) and SRE practices.
Exposure to security and compliance frameworks (SOC 2, ISO 27001, Zero Trust).
Familiarity with DevSecOps practices and secure pipeline design.
Experience deploying Kotlin (or other JVM-based) applications.
Linux and Windows systems administration background.

Soft Skills
Can explain why something broke, not just that it did.
Comfortable saying "I don't know - I'll find out."
Self-directed learner (side projects, home lab, open-source contributions).
Takes feedback well and asks good questions.
Strong ownership and problem-solving ability across time zones.

📌 AI Developer (Ciudad de México)
🏢 Salvo Software
📍 Ciudad de México