SAP S/4HANA Logistics Consultant - AI Evaluation

Overview Huzzle Labs is seeking a senior SAP S/4HANA logistics consultant to establish an expert-validated gold standard for an AI system that supports S/4HANA implementation work, and to evaluate the system’s outputs against that standard. You will translate realistic business requirements into implementation-ready solutions, assess the AI’s responses, and document where and why they fall short. The role draws on expertise in MM-IM, EWM inbound processes, inbound delivery and Advanced Shipping Notification (ASN) processing, and fit-to-standard workshops. This is an expert judgement role focused on hands-on solution design, functional validation, evaluation, and documentation. Key Responsibilities Develop a gold standard: Build a reference set of requirements. For each requirement, document the correct decomposition, relevant scope item mappings, fit/gap assessment, proposed solution, and specific enhancement objects, including Business Add-Ins (BAdIs) where applicable. Validate proposed enhancements: Verify their functional suitability and identify the concrete enhancement objects that would be used in a real implementation. Evaluate AI outputs: Compare the system’s responses with the gold standard and identify omissions, inaccuracies, and unsuitable recommendations. Categorise errors consistently: Develop and apply a structured error taxonomy that helps the product team understand recurring issues and prioritise improvements. Model reference processes: Create 2 to 3 implementation-level Business Process Model and Notation (BPMN) process models. Retest after adjustments: Rerun the evaluation following the client’s changes and document improvements, unresolved issues, and any new errors. Collaborate with the project team: Clarify edge cases, resolve ambiguities, and refine evaluation criteria and error categories. Example Assignment For a realistic requirement involving ASN processing into EWM, you would: Break the requirement into its functional and technical components. Map those components to the relevant S/4HANA scope items. Assess which elements fit standard functionality and which require enhancements. Specify the proposed solution, including the relevant BAdIs or enhancement objects. Compare the AI’s response with your validated solution and record each discrepancy under a consistent error category. Repeat the evaluation after the client’s adjustments and report the changes. Ideal Qualifications At least 5 years of hands-on SAP S/4HANA logistics consulting experience, with senior-level responsibility for solution design and implementation. Experience leading fit-to-standard workshops and documenting fit/gap decisions. Ability to validate enhancements functionally and identify specific enhancement objects and BAdIs. Strong expertise in MM-IM, EWM inbound processes, and inbound delivery/ASN processing. Experience creating implementation-level BPMN process models. A structured approach to documentation, evaluation, and error categorisation. Clear written English and the ability to explain complex solutions simply. Ability to work independently and deliver the first phase within two weeks. Confidentiality: An NDA must be signed before the engagement begins. About Huzzle Labs Huzzle Labs partners with leading AI organisations to evaluate and improve frontier models through deep human expertise. Contributors assess advanced AI systems in their specialist fields, receive competitive compensation, and help define the standards used to measure model performance.

View the full posting and apply