AMA Consulting, LLC, a Maryland-based Limited Liability Company, provides analytical, acquisition, and business management support services to federal agencies. AMA Consulting is an Equal Opportunity/Affirmative Action Employer. Join a dynamic team of forward-thinking professionals in our growing company supporting cutting-edge AI innovation and national security initiatives.

 

Machine Learning Engineer

The Machine Learning Engineer will develop the AI testing, evaluation, and monitoring tools that power AMA’s AI assurance platform. This role focuses on building model evaluation pipelines, bias detection systems, and AI monitoring capabilities.

 

Key responsibilities include:

1. AI Model Testing

• Develop automated pipelines for testing AI model performance.
• Build model validation systems and evaluation metrics.
• Implement bias detection and fairness testing tools.

2. AI Monitoring Systems

• Develop tools to monitor AI models in production environments.
• Build explainability and model transparency capabilities.

3. Data Science & AI Development

• Build machine learning models supporting platform analytics.
• Develop algorithms supporting AI assurance and risk evaluation.

4. Platform Integration

• Work closely with software engineers to integrate ML tools into the platform infrastructure.

 

Required qualifications to be successful in this role:

• Bachelor’s or Master’s degree in Computer Science, Data Science, AI, or related field.
• 5+ years of experience in machine learning engineering.
• Strong proficiency in Python and machine learning libraries.
• Experience building production ML pipelines.
• Experience with explainable AI frameworks.

 

Preferred skills include:

• Familiarity with bias detection and model fairness techniques.
• Experience supporting federal or defense programs.