Idaho National Laboratory Experimental Program to Support Validation of CFD Codes

1
Idaho National Laboratory Experimental Program to
Support Validation of CFD Codes

• Hugh M. McIlroy Jr
• 2008 RELAP5 International Users Seminar
• November 19, 2008

2
Objectives

• INL Policy Review
• Lab Notebooks
• QA requirements
• Uncertainty Analysis
• AIAA Guide
• Other sources
• Generally accepted principles
• NGNP VHTR LP standard problem overview

3
INL Policy on Lab Notebooks

• MCP-2875
• Accurate records
• Instruction and Best Management Practices

4
Instruction and Best Management Practice Label
5
Instruction and Best Management Practice Label
6
INL Policy on Lab Notebooks

• MCP-2875
• Accurate records
• Instruction and Best Management Practices
• Registered through EDMS
• Policy on entries

7
Lab Notebook Entries

• Sufficiently complete to allow duplication by a
  skilled researcher
• Experimental Plans
• Experimental and theoretical information
• Data
• Interpretations
• Printouts, photographs, charts
• Reference location of archival recording media
  (computer disks, backup tapes, hard drives, etc.)

8
INL Policy on Lab Notebooks

• MCP-2875
• Accurate records
• Instruction and Best Management Practices
• Registered through EDMS
• Policy on entries
• Protection as required

9
INL Quality Assurance Requirements for Research
and Development

• LRD-13010
• Quality
• A condition achieved when an item, service or
  process meets or exceeds requirements
• Quality Assurance
• All actions that provide adequate confidence that
  quality is achieved
• Procedures
• Were procedures in place
• Were procedures used

10
INL Quality Assurance Requirements for Research
and Development

• Application rigor depends on type of research and
  quality level
• Normally basic or applied research

11
Typical QA Requirements for Basic and Applied
Research

• Defined organization
• Procurement IAW QL-standards
• Training and qualification of personnel
• Logistics and property management
• Dealing with suspect/counterfeit items
• Assessments and quality improvements
• Document control
• Design control

12
Typical QA Requirements for Basic and Applied
Research

• Peer reviews
• Work process/fabrication/assembly control
• Material research, selection and control
• Software development and use
• Test control
• Data reduction and analysis
• Measuring and test equipment
• Records management

13
Other Issues

• Calibration
• PDD-13450 Calibration and Data Integrity
• Establishes calibration requirements
• LWP-13455 Control of Measurement and Test
  Equipment
• Program for all portable, non-rad MT E
• MCP-6303 Calibration of Facility Process and
  Control
• Intended to cover fixed, installed instruments
• QA initiated issue regarding application to MT

14
Calibration and Data Integrity (PDD-13450)

• Proper selection and use of MT E
• Type
• Range
• Accuracy
• Tolerance
• MT E calibrated and controlled
• Only MT E with current calibration used
• Proper handling and storage

15
Other Issues

• Ethics
• Committee on Science, Engineering, and Public
  Policy, National Academy of Sciences National
  Academy of Engineering, Institute of Medicine,
  National Academy Press, Wash DC, 1995, 2nd Ed.
• Minimize influence of individual bias
• Produce results others can easily reproduce
• Use generally accepted methods
• Clearly identify methods used to gather and
  analyze data
• Continuously scrutinize for possible errors

16
AIAA Requirements for Experimental Data

• AIAA G-077-1998 Guide for the Verification and
  Validation of Computational Fluid Dynamics
  Simulations
• Joint design by experimentalists and code
  developers
• Work together throughout the project
• Experiment must capture essential flow physics,
  modeling data, initial conditions and boundary
  conditions required by the code
• Experiment must emphasize synergism between
  computational and experimental approaches
• Independent results
• Hierarchy of experimental measurements of
  increasing difficulty
• Uncertainty analysis must delineate and quantify
  systematic and random errors by type

17
Uncertainty Analysis

• No specific technique prescribed
• Journal policy statements in
• ASME Journal of Fluids
• ASME Journal of Heat Transfer
• International Journal for Numerical Methods in
  Fluids
• AIAA Journal
• ASME Journal of Fluids Engineering

18
General Journal Principles

• Experimental uncertainties should be set at the
  scale at which comparisons (validation) will be
  attempted
• Uncertainties must address total error
• Precision (random)
• Bias (fixed, systematic)
• Bias can come from
• Calibration errors
• Data acquisition errors
• Data reduction errors
• Test technique errors, etc.

19
Workshops, Conferences, Schools, Seminars

• INL VV Workshop July 08
• Frederick Joliot and Otto Hahn Summer School,
  Aix-en-Provence, France, Aug-Sep 08
• XCFD4NRS Grenoble, France, Sep 08

20
Other Sources

• International Integral Experiments Databases in
  Support of Nuclear data and Code Validation
• See Briggs, J. B., Gado, J., Hunter, H., Kodeli,
  I., Salavatores, M. and Sartori, E., 2002,
  International Integral Experiments Databases in
  Support of Nuclear Data and Code Validation, J.
  Nuc Sci and Tech, Suplmnt 2, p 854.

21
Other Sources

• International Criticality Safety Benchmark
  Experiments Project Handbook (ICSBEP) principles
• Describe data handling method
• Specification of corrections, if any
• Specific handling of technological uncertainty
• Estimation of biases
• Compliance with formal requirements
• Presentation of sample calculations

22
Generally Accepted Principles

• Defined geometry
• Description of important physical phenomena
• Scalable to full-size
• Measurements that can be compared to code
• Description of dominant physics
• Description of data reduction methodology
• Comprehensive uncertainty analysis
• Adherence to Quality Assurance requirements

23
INL NGNP VHTR Lower Plenum Experimental Program
24
INL NGNP VHTR Lower Plenum Experimental Program

• Conducted at Matched Index-of-Refraction Lab
• Documented Design
• Documented geometry (designed and as-built)
• Scaled
• Instrumented (temperature, flow rates, position,
  etc.)
• Controlled
• Repeatable
• Documented measurement and data reduction
  techniques
• Uncertainty Analysis
• Quality Assurance

25
INL NGNP VHTR Lower Plenum Experimental Program
26
Matched-Index-of-Refraction Facility (MIR)
Located at the INL Research Center INL
Engineering Demonstration Facility (IEDF) Bldg
IF657 Bays E-1 E-2 Idaho Falls, Idaho (208)
526-6176 email Hugh.McIlroy_at_inl.gov website htt
p//www.inl.gov/physics/mir/