ML Ops and LLM Ops Engineers/ Specialist

ML Ops and LLM Ops Engineers/ Specialist

BCforward is currently seeking a highly motivated ML Ops and LLM Ops Engineers/ Specialist for a Remote opportunity!

Position Title: ML Ops and LLM Ops Engineers/ Specialist

Location: Remote

Anticipated Start Date: 04/21

Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date.

Expected Duration: 12+ months contract + Renewable

Job Type: [FULL TIME (>%3D40 HRS WEEKLY) [CONTRACT], [REMOTE]

Pay Range: $80 - $100/hr

Please note that actual compensation may vary within this range due to factors such as location, experience, and job responsibilities, and does not encompass additional non-standard compensation (e.g., benefits, paid time off, per diem, etc.).

Summary

Client is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists, DevOps, and

Role Description

Core LLM Ops Responsibilities:

• Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.).
• Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines.
• Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines.
• Manage vector databases, embedding stores, and document stores used in conjunction with LLMs.
• Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments.
• Continuously monitor models for its performance and ensure alert system in place.
• Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows.

Core ML Ops Responsibilities:

• Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring.
• Implement version control, model registry, and reproducibility strategies for ML models.
• Automate data ingestion, feature engineering, and model retraining workflows.
• Monitor model performance, drift, and ensure proper alerting systems are in place.
• Implement security, compliance, and governance protocols for model deployment.
• Collaborate with Data Scientists to streamline model development and experimentation.

What We're Looking For

• Bachelor's/Master's degree in Computer Science, Engineering, or related fields.
• Strong experience with ML Ops tools (Kubeflow, MLflow, TFX, SageMaker, etc.).
• Experience with LLM-specific tools and frameworks (LangChain,Lang Graph, LlamaIndex, Hugging Face, OpenAI APIs, Vector DBs like Pinecone, FAISS, Weavite, Chroma DB etc.).
• Solid experience in deploying models in cloud (AWS, Azure, GCP) and on-prem environments.
• Proficient in containerization (Docker, Kubernetes) and CI/CD practices.
• Familiarity with monitoring tools like Prometheus, Grafana, and ML observability platforms.
• Strong coding skills in Python, Bash, and familiarity with infrastructure-as-code tools (Terraform, Helm, etc.).Knowledge of healthcare AI applications and regulatory compliance (HIPAA, CMS) is a plus.
• Strong skills in Giskard, Deepeval etc.

Qualifications

• Bachelor, Masters or PHD in Computer Sciences, Data Sciences, or any related filed
• Experience with fine-tuning LLMs and serving them in production at scale.
• Knowledge of model compression techniques for LLMs (LoRA, QLoRA, quantization-aware training).
• Experience with distributed systems and high-performance computing for large-scale model serving.
• Awareness of AI fairness, explainability, and governance frameworks.

Benefits:

BCforward offers all eligible employees a comprehensive benefits package including, but not limited to major medical, HSA, dental, vision, employer-provided group life, voluntary life insurance, short-term disability, long-term disability, and 401k.

Keywords:

LLM, Version Control, CI/CD Pipelines

About BCforward:

Founded in 1998 on the idea that industry leaders needed a professional service, and workforce management expert, to fuel the development and execution of core business and technology strategies, BCforward is a Black-owned firm providing unique solutions supporting value capture and digital product delivery needs for organizations around the world. Headquartered in Indianapolis, IN with an Offshore Development Center in Hyderabad, India, BCforward's 6,000 consultants support more than 225 clients globally.

BCforward champions the power of human potential to help companies transform, accelerate, and scale. Guided by our core values of People-Centric, Optimism, Excellence, Diversity, and Accountability, our professionals have helped our clients achieve their strategic goals for more than 25 years. Our strong culture and clear values have enabled BCforward to become a market leader and best in class place to work.

BCforward is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against based on disability.

To learn more about how BCforward collects and uses personal information as part of the recruiting process, view our Privacy Notice and CCPA Addendum. As part of the recruitment process, we may ask for you to disclose and provide us with various categories of personal information, including identifiers, professional information, commercial information, education information, and other related information. BCforward will only use this information to complete the recruitment process.

This posting is not an offer of employment. All applicants applying for positions in the United States must be legally authorized to work in the United States. The submission of intentionally false or fraudulent information in response to this posting may render the applicant ineligible for the position. Any subsequent offer of employment will be considered employment at-will regardless of the anticipated assignment duration.

Interested candidates please send resume in Word format Please reference job code 236437 when responding to this ad.

---