Gradient Free Design of Microfluidic Structures on a GPU Cluster

Similar documents
Two-Phase flows on massively parallel multi-gpu clusters

FEM techniques for interfacial flows

Investigating The Stability of The Balance-force Continuum Surface Force Model of Surface Tension In Interfacial Flow

The 3D DSC in Fluid Simulation

Imagery for 3D geometry design: application to fluid flows.

A Massively Parallel Two-Phase Solver for Incompressible Fluids on Multi-GPU Clusters

A 3D VOF model in cylindrical coordinates

A Novel Approach to High Speed Collision

Droplet collisions using a Level Set method: comparisons between simulation and experiments

Overview of Traditional Surface Tracking Methods

Adaptive-Mesh-Refinement Hydrodynamic GPU Computation in Astrophysics

Development of Hybrid Fluid Jet / Float Polishing Process

2.7 Cloth Animation. Jacobs University Visualization and Computer Graphics Lab : Advanced Graphics - Chapter 2 123

Computational Fluid Dynamics - Incompressible Flows

Least Square Curvature Calculation Method for VOF Schemes

Driven Cavity Example

Interaction of Fluid Simulation Based on PhysX Physics Engine. Huibai Wang, Jianfei Wan, Fengquan Zhang

Literature Report. Daniël Pols. 23 May 2018

Implicit surface tension model for stimulation of interfacial flows

An accurate numerical method for computing surface tension forces in CFD codes

Tutorial 17. Using the Mixture and Eulerian Multiphase Models

Phase-field simulation of two-phase micro-flows in a Hele-Shaw cell

Moment of fluid method for multimaterial flows

MESHLESS SOLUTION OF INCOMPRESSIBLE FLOW OVER BACKWARD-FACING STEP

CUDA. Fluid simulation Lattice Boltzmann Models Cellular Automata

Solving Partial Differential Equations on Overlapping Grids

Stratified Oil-Water Two-Phases Flow of Subsea Pipeline

The Immersed Interface Method

Multigrid Solvers in CFD. David Emerson. Scientific Computing Department STFC Daresbury Laboratory Daresbury, Warrington, WA4 4AD, UK

Center for Computational Science

CFD Simulation for Stratified Oil-Water Two-Phase Flow in a Horizontal Pipe

Turbulencja w mikrokanale i jej wpływ na proces emulsyfikacji

A NURBS-BASED APPROACH FOR SHAPE AND TOPOLOGY OPTIMIZATION OF FLOW DOMAINS

FINITE POINTSET METHOD FOR 2D DAM-BREAK PROBLEM WITH GPU-ACCELERATION. M. Panchatcharam 1, S. Sundar 2

weighted minimal surface model for surface reconstruction from scattered points, curves, and/or pieces of surfaces.

Possibility of Implicit LES for Two-Dimensional Incompressible Lid-Driven Cavity Flow Based on COMSOL Multiphysics

ENERGY-224 Reservoir Simulation Project Report. Ala Alzayer

Numerical Analysis of Shock Tube Problem by using TVD and ACM Schemes

Multiphase flow metrology in oil and gas production: Case study of multiphase flow in horizontal tube

Verification and Validation in CFD and Heat Transfer: ANSYS Practice and the New ASME Standard

Parallelization study of a VOF/Navier-Stokes model for 3D unstructured staggered meshes

Divergence-Free Smoothed Particle Hydrodynamics

The Eikonal Equation

Surface Tension Approximation in Semi-Lagrangian Level Set Based Fluid Simulations for Computer Graphics

1.2 Numerical Solutions of Flow Problems

COMPUTATIONAL METHODS FOR ENVIRONMENTAL FLUID MECHANICS

Flux Vector Splitting Methods for the Euler Equations on 3D Unstructured Meshes for CPU/GPU Clusters

A study of Jumper FIV due to multiphase internal flow: understanding life-cycle fatigue. Alan Mueller & Oleg Voronkov

Towards a complete FEM-based simulation toolkit on GPUs: Geometric Multigrid solvers

Parallel Direct Simulation Monte Carlo Computation Using CUDA on GPUs

Unstructured Mesh Generation for Implicit Moving Geometries and Level Set Applications

Math 690N - Final Report

The Level Set Method. Lecture Notes, MIT J / 2.097J / 6.339J Numerical Methods for Partial Differential Equations

FEMLAB Exercise 1 for ChE366

ACCELERATION OF A COMPUTATIONAL FLUID DYNAMICS CODE WITH GPU USING OPENACC

Efficient Finite Element Geometric Multigrid Solvers for Unstructured Grids on GPUs

Three Dimensional Numerical Simulation of Turbulent Flow Over Spillways

Calculate a solution using the pressure-based coupled solver.

Accelerating Double Precision FEM Simulations with GPUs

Moving Interface Problems: Methods & Applications Tutorial Lecture II

Numerical Simulation of Coupled Fluid-Solid Systems by Fictitious Boundary and Grid Deformation Methods

WETTING PROPERTIES OF STRUCTURED INTERFACES COMPOSED OF SURFACE-ATTACHED SPHERICAL NANOPARTICLES

NUMERICAL VISCOSITY. Convergent Science White Paper. COPYRIGHT 2017 CONVERGENT SCIENCE. All rights reserved.

This is an author-deposited version published in : Eprints ID : 19938

General Purpose GPU Computing in Partial Wave Analysis

An added mass partitioned algorithm for rigid bodies and incompressible flows

Microwell Mixing with Surface Tension

Efficient Tridiagonal Solvers for ADI methods and Fluid Simulation

Continuum-Microscopic Models

SIMULATION OF INTERFACIAL FLOWS USING FRONT TRACKING APPROACH

>> 1 because the resulting discretization matrix is poorly conditioned. Consider the 1D discretization of eqn. 1.1

Drop Impact Simulation with a Velocity-Dependent Contact Angle

Multilevel Optimization for Multi-Modal X-ray Data Analysis

Optimizing Bio-Inspired Flow Channel Design on Bipolar Plates of PEM Fuel Cells

Using the Eulerian Multiphase Model for Granular Flow

Simulation of chaotic mixing dynamics in microdroplets

Free Surface Flow Simulations

Numerical Methods for (Time-Dependent) HJ PDEs

Computational Fluid Dynamics using OpenCL a Practical Introduction

The Level Set Method THE LEVEL SET METHOD THE LEVEL SET METHOD 203

Realistic Animation of Fluids

HYPERDRIVE IMPLEMENTATION AND ANALYSIS OF A PARALLEL, CONJUGATE GRADIENT LINEAR SOLVER PROF. BRYANT PROF. KAYVON 15618: PARALLEL COMPUTER ARCHITECTURE

CFD Best Practice Guidelines: A process to understand CFD results and establish Simulation versus Reality

Particleworks: Particle-based CAE Software fully ported to GPU

Characteristic Aspects of SPH Solutions

Studies of the Continuous and Discrete Adjoint Approaches to Viscous Automatic Aerodynamic Shape Optimization

Three-dimensional measurement of micro- multiphase flow using digital holographic microscopy

Prim ary break-up: DNS of liquid jet to improve atomization m odelling

Level Set Method in a Finite Element Setting

Final drive lubrication modeling

EVALUATION OF A GENERAL CFD-SOLVER FOR A MICRO-SCALE URBAN FLOW

Acknowledgements. Prof. Dan Negrut Prof. Darryl Thelen Prof. Michael Zinn. SBEL Colleagues: Hammad Mazar, Toby Heyn, Manoj Kumar

Flux Vector Splitting Methods for the Euler Equations on 3D Unstructured Meshes for CPU/GPU Clusters

Pump Modeler Template Documentation

Investigation of cross flow over a circular cylinder at low Re using the Immersed Boundary Method (IBM)

The Development of a Volume-of-Fluid Interface Tracking Method for Modeling Problems in Mantle Convection

CFD for Microfluidics

This tutorial illustrates how to set up and solve a problem involving solidification. This tutorial will demonstrate how to do the following:

Robust Simulation of Sparsely Sampled Thin Features in SPH-Based Free Surface Flows

Development of an Integrated Computational Simulation Method for Fluid Driven Structure Movement and Acoustics

Transcription:

Gradient Free Design of Microfluidic Structures on a GPU Cluster Austen Duffy - Florida State University SIAM Conference on Computational Science and Engineering March 2, 2011

Acknowledgements This work is with Mark Sussman - FSU Mathematics Michael Roper - FSU Chemistry And supported by the National Science Foundation through grant DMS-1016381

Motivation Microfluidic Devices are leading to rapid advances in various areas including biotechnology where the lab-on-a-chip has become very popular. Lab-on-a-chip devices allow for high throughput drug assays with small amounts of reactants which may be very expensive to produce. Precise control over droplet formation is a key factor for succesful experiments, and is dependent on channel geometry and surfactant properties.

Example Lab on a Chip Design W. Shi, J. Qin, N. Ye, B. Lin. Droplet-based microfluidic system for individual Caenorhabditis elegans assay. Lab on a Chip, 2008.

Droplet Trapping Device Droplet sizes must be precise for proper trapping behavior. W. Shi, J. Qin, N. Ye, B. Lin. Droplet-based microfluidic system for individual Caenorhabditis elegans assay. Lab on a Chip, 2008.

Microfluidic T-Junction Experiment from Roper s Lab

Project Goals With experimental backing from Roper s Lab, the two main computational goals of the project are to Improve the microfluidic simulation capabilities of our current multiphase flow code CLSVOF (coupled level set and volume of fluid code - structured, incompressible Navier-Stokes, adaptive mesh refinement) Develop an optimization code to couple with the CLSVOF code that will allow for numerical design of structures subject to two phase flow at the micro level

Challenges Optimization in two phase flows can be very difficult, gradient computation may not be feasible. In microfluidic simulations, surface tension can impose stringent stability constraints leading to lengthy flow solves.

The Problem We would like to develop a procedure for computationally designing microfluidic T-Junctions so that they can consistently produce precise droplets of a desired size. We will be seeking to discover things such as the ideal geometry, fluid inflow rates, and surfactant properties that a T-Junction should incorporate in order to operate in an optimal manner for its desired purpose.

Computational T-Junction Geometry

Mathematical Formulation The design problem can be formulated as an optimization problem min J(u, ψ) subject to N(u, ψ) Where J is the cost function (typically in integral form) and N is a governing PDE system with state variable u and design variable ψ.

Cost Function The cost function details haven t been completely worked out yet, but it should depend heavily on the droplet volume and resemble J = V Droplet ideal Droplet actual V

Design Variables The design variables will depend on T-Junction Geometry (can be described by as few as 2 control points for rectangular channels) flow rates of the continuous and dispersed fluids surfactant properties Others?

Governing PDE System The level set equations for incompressible multi-phase flow u = 0, u t + (u )u = 1 σκ H ( pi + 2µD) + g. ρ ρ φ t + (u )φ = 0. ρ = ρ D H + ρ C (1 H) µ = µ D H + µ C (1 H) H = { 1 φ 0 0 φ < 0

φ, the level set function, is positive in the dispersed droplet phase and negative in the continuos phase. u = u, v, w are the velocity components t is time, p is pressure I is the unit tensor, D is the rate of deformation tensor g is gravity, σ is the surface tension κ = n is the interface curvature ρ is the density, µ is the viscosity D and C subscripts represent dispersed and continuous phases

The Optimization Procedure Due to the nature of the problem, we have chosen a non-intrusive derivative free approach for the optimization procedure. We are currently developing a hybrid optimization method which uses a genetic algorithm (GA) to obtain the global solution the multidirectional search (MDS) method to obtain a locally refined solution a Monte Carlo method for generating an initial population of solutions for the GA.

A Multigrid Strategy Multigrid methods have been shown to reduce the number of iterations required for convergence of gradient based optimization methods. S.G. Nash. A multigrid approach to discretized optimization problems. Optimization Meth. & Soft., 2000. R.M. Lewis, S.G. Nash. Model problems for the multigrid optimization of systems governed by differential equations. SIAM J. Sci. Comp., 2005. Multigriding strategies may also be beneficial to derivative free methods

Hybrid Optimization Algorithm Given an initial design φ and a series of m meshes H 1, H 2,..., H m! Use MC to generate initial population of P solutions. Call generate population(φ,p) 1. Begin GA for i= 1 to m do Call GA(φ, H i ) if cost < lowcost then store solution lowcost = cost end if end for if Global Solution Obtained then Keep best solution φ 0, Go To 2. else Go Back To 1. end if

Hybrid Optimization Algorithm (continued) 2. Begin Local Refinement for i= 1 to m do Call MDS(φ 0, H i ) end for if Local Solution Obtained then Optimization Complete else Go Back To 2. end if

Remarks on the Optimization Algorithm Each call to GA or MDS requires multiple iterations. Each iteration requires O(N) flow solves, where N is the number of design variables. GA and MDS are both highly parallel, flow solves can be performed simultaneously. A low number of design variables make this problem ideal for a small cluster, each node can run a flow solve in parallel

Accelerating the Flow Solver Our derivative free algorithm is still hindered by many iterations (and hence frequent calls to the flow solver), so any improvements which can speed it up are vital to the success of the code. To make this solver fast, we intend to develop an improved explicit treatment of the surface tension which is trivially parallel and can be solved on a GPU.

Sussman and Ohta Surface Tension Treatment Given a distance function φ, initialize a provisional level set function d 0 = φ. for k=1 to N do a. Find the curvature κ near the zero level set of d k 1. b. For each separate interfacial segment Γ i find the average curvature κ avg i c. extend κ κ avg i into a small narrow band about the zero level set. d. d k = d k 1 + τ(κ κ avg ) e. reinitialize d k. end for Replace κ with the quantity d N d 0 t. M. Sussman, M. Ohta. A stable and efficient method for treating surface tension in incompressible two-phase flows. SIAM J. Sci. Comp., 2009.

Problems While Sussman and Ohtas algorithm was successful in easing the time step constraint associated with surface tension dominated flows involving droplet rupture/recoalescence, the advantages are limited to large density ratio flows and not applicable to problems applicable to Roper s Lab. New surface tension algorithms must be developed!

GPU Acceleration Exploitation of the computational power of emerging hybrid many-core architectures is key to the success of this project. With recent advances in GPU technology, parallel CFD codes are able to be accelerated on distributed hybrid architectures with multiple cores sharing a single GPU. A.C. Duffy, D.P. Hammond, E.J. Nielsen. Production level CFD code acceleration for hybrid many-core architectures. submitted to Parallel Computing, 2010.

GPU Advancements Architecture Cores L1 Cache L2 Cache Memory Access Speed G80 112 16 KB 1 128 KB 2 57.6 GB/s GDDR3 GT200 240 24 KB 1 256 KB 2 102 GB/s GDDR3 Fermi 448 48/16 KB 3 768 KB 144 GB/s GDDR5 GPU architecture evolution from G80, which approximately coincided with the release of Intel s quad core CPUs, to Fermi which coincided with the release of Intel s six core processors. GPU advancements over the last few years have noticeably outpaced those of CPUs. Representative GPUs are: G80-GeForce 8800 GT, GT200-Tesla C1060, Fermi-Tesla C2050. 1 shared memory, 2 texture memory, 3 Configurable L1/shared memory

Project summary The project goal is to develop a code for hybrid many-core architectures that couples LS-AMR-VOF to a novel MG/OPT code for the purpose of simulation based design of two-phase microfluidic devices.

Progress to date LS-AMR-VOF is currently capable of microfluidic simulations through T-Junction channels, but requires improvement in the surface tension treatment A multigrid MDS code has already been developed, but current results are mixed with limited test cases GPU acceleration of the LS-AMR-VOF code is well underway, but some bugs need to be worked out

Microfluidic T-Junction

Microfluidic T-Junction Simulation using data from Roper s Lab

Microfluidic T-Junction Simulation using data from Roper s Lab

QUESTIONS?