Data Scientist - AI Evaluation and Responsible AI in Ferrara

Data Scientist - AI Evaluation and Responsible AI in Ferrara

Ferrara Full-Time In sede
NTT DATA Europe & Latam

Who We Are

We operate beyond organizational silos, combining deep expertise in data engineering and AI-driven solutions to design and deliver scalable, user-centric applications and modern data architectures. We support a wide range of industries, including Automotive, Banking, Insurance, Telecommunications, E-commerce, and Public Services.

We operate beyond organizational silos, combining deep expertise in data engineering and AI-driven solutions to design and deliver scalable, user-centric applications and modern data architectures. We support a wide range of industries, including Automotive, Banking, Insurance, Telecommunications, E-commerce, and Public Services. We are looking for a Senior Data Scientist to own a shared evaluation framework, release gates and responsible-AI controls across machine learning, RAG, agent, document and vision use cases. The role works directly with delivery teams from baseline creation through release decisions, production monitoring and quality reporting.

What You’ll Be Doing

  • Define evaluation strategies, golden datasets, metrics, thresholds and release gates for ML, RAG, agent, document and vision solutions.
  • Build automated evaluation harnesses, regression tests, red-team and prompt-injection tests, and human-evaluation protocols.
  • Define responsible-AI controls covering explainability, bias, PII, human oversight, traceability and model risk.
  • Integrate evaluation into CI/CD and MLOps or LLMOps pipelines.
  • Specify monitoring, alerts, model cards and audit evidence, and investigate production quality issues.
  • Work hands-on with use-case teams from baseline creation to release decisions and report quality against business measures.
  • Challenge weak evidence or unsafe release decisions constructively.
  • Deliver reusable, tested Python code, evaluation assets and governance templates.

What You'll Bring Along

  • At least 10 years of professional experience preferred
  • 6+ years of experience in data science, ML evaluation, model validation, experimentation or responsible AI.
  • 4+ years of strong Python and SQL experience with model, log and monitoring data.
  • Production experience evaluating and monitoring AI or ML systems.
  • Strong foundation in statistics, experimental design, error analysis and calibration.
  • Experience with RAG, LLM or agent evaluation and safety testing.
  • Ability to challenge weak evidence or unsafe release decisions constructively.
  • Strong technical communication, stakeholder influence, ownership, mentoring and judgment under ambiguity.
  • Experience with adversarial testing, PII validation, Bedrock Guardrails, CloudWatch, New Relic, Langfuse or safety-sensitive applications is preferred.
  • Excellent command of English, both written and spoken

Data Scientist - AI Evaluation and Responsible AI in Ferrara datore di lavoro: NTT DATA Europe & Latam

NTT DATA è un datore di lavoro eccezionale, offrendo un ambiente stimolante e innovativo per i Senior ML Engineer. Con sedi in città dinamiche come Napoli, Roma, Milano e Cosenza, i dipendenti possono beneficiare di opportunità di crescita professionale, formazione continua e un forte focus sulla collaborazione globale. La cultura aziendale valorizza il contributo individuale e promuove un equilibrio tra vita lavorativa e personale, rendendo NTT DATA un luogo ideale per costruire il proprio futuro nel campo dell'Intelligenza Artificiale.

NTT DATA Europe & Latam

Dettagli di contatto:

Team di recruiting di NTT DATA Europe & Latam