Cauchy Fast Multipole Method for Analytic Kernel

Size: px
Start display at page:

Download "Cauchy Fast Multipole Method for Analytic Kernel"

Transcription

1 Cauchy Fast Multipole Method for Analytic Kernel Pierre-David Létourneau 1 Cristopher Cecka 2 Eric Darve 1 1 Stanford University 2 Harvard University ICIAM July 2011 Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 1 / 19

2 Outline 1 Overview 2 Algorithm 3 Results Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 2 / 19

3 Outline 1 Overview 2 Algorithm 3 Results Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 3 / 19

4 Overview Perform matrix-vector product of the form N σ i K (x i, y j ) ; j = 1..N i=1 e.g. electrostatic kernel : K (x i, y j ) = 1 x i y j Naive implementation : O(N 2 ) Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 4 / 19

5 Overview One way to speed up the computation is to group together particles and use a low-rank approximation of the kernel. N σ i K (x i, y j ) P Q K (x, y) a pq u p (x)v q (y) p=1 q=1 ( Q P )) N a pq σ i u p (x i v q (y j ) i=1 q=1 p=1 i=1 Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 5 / 19

6 Tree decomposition Usually, it is not possible to get an efficient global separable approximation. Instead, use approximations valid only in certain region (far apart) and use a tree decomposition. 1 Use different low-rank approximation at each scale/tree level 2 Compute close-term interactions at lowest level e.g far-neighbors (top) and close-terms (bottom) Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 6 / 19

7 Goal We want to develop an algorithm with the following properties : 1 The algorithmic complexity is O(N) (up to log-factor) 2 The translation and transfer operators are diagonal P Q P K (x, y) a pqu p(x)v q(y) vs a pu p(x)v p(y) p=1 q=1 p=1 3 The algorithm is applicable to any analytic kernel Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 7 / 19

8 Outline 1 Overview 2 Algorithm 3 Results Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 8 / 19

9 Algorithm The algorithm is based on Cauchy Integral formula i.e. given K (z), z C, complex differentiable z Ω (holomorphic), then K (x) = 1 K (z) dz (1) 2πı Γ z x Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 9 / 19

10 Algorithm (Formal derivation) Assume that R(z (x y)) > 0 z Γ. Then, by the Laplace transform K (x y) = 1 K (z) 2πı Γ z (x y) dz = 1 K (z) e s(z (x y)) ds dz 2πı Γ 0 which upon discretization gives, K (x y) 1 K (z n ) e sp(zn (x y)) 2πı n p = ( ) 1 K (z n )e spzn e spx e spy 2πı p n This expansion possesses the desired form Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 10 / 19

11 Algorithm (Formal derivation) Current issues with the separable expansion : 1 It is not true that R(z (x y)) > 0 z Γ. 2 The use of exponentials e s k z n, e s k x and e s k y is numerically unstable Both problems can however be solved. Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 11 / 19

12 Algorithm (Formal derivation) To solve the first problem, we break the contour into paths and rotate each path by multiplying by {λ k } {1, ı, 1, ı}. Γ 3 Im Γ 2 x y Γ 1 Re Im Re x Γ2 = ıγ 2 Γ 4 1 λ k K (z) 2πı Γ k λ k z (x y) dz = λ k K (z) 2πı Γ k 0 e sλ k (z (x y)) ds dz Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 12 / 19

13 Algorithm (Formal derivation) To solve the stability problem, we introduce parameters {l k } such that R(λ k z 2l k ) > 0 (2) R(l k λ k x) > 0 (3) R(l k + λ k y) > 0 (4) Thanks to the well-separated condition, the tree decomposition and the choice of paths, it is always possible to find such parameters. Then, 0 e sλ k (z (x y)) ds = 0 e s(λ k z 2l k ) e s(l k λ k x) e s(l k +λ k y) ds which can be discretized efficiently to produce a stable approximation. Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 13 / 19

14 Outline 1 Overview 2 Algorithm 3 Results Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 14 / 19

15 Results Kernel studied, Algebraic growth (Multiquadric) : K (x y) = 1 + (x y) 2 Algebraic decay (Inverse Multiquadric) : K (x y) = Oscillatory (Helmholtz) : K (x y) = eık x y k x y Error considered, Maximum absolute error : max n φ FMM Relative L 2 error : Particle distribution, n (φfmm n φ Direct n ) 2 n (φdirect n ) 2 n φ Direct n N locations uniformly distributed in an interval Various interval size : 0.1, 1, 10, (x y) 2 Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 15 / 19

16 Results (Single level - Maximum absolute error vs # Quadrature points) Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 16 / 19

17 Results (Multiple levels - Relative L 2 error vs # Quadrature points) Number of particles : Number of levels : 8 Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 17 / 19

18 Results Multiple levels - Timing vs Problem Size Interval length : 100 Relative L 2 error : Multiquadric( 10 6 ), Inverse Multiquadric( 10 3 ), Helmholtz( 10 5 ) Computer : Dell 3GHz CPU, 8GBytes RAM Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 18 / 19

19 Conclusion 1 The algorithmic complexity is O(N log(n)) 2 The translation and transfer operators are diagonal 3 The algorithm is applicable to any analytic kernel 4 Extension to n-d is trivial K (x, y, z) = 1 K (z 1, z 2, z 3 ) (2πı) 3 Γ 1 Γ 2 Γ 3 (z 1 x)(z 2 y)(z 3 z) dz 1 dz 2 dz 3 Pierre-David Létourneau Cristopher Cecka Eric Darve Cauchy FMM 19 / 19

Kernel Independent FMM

Kernel Independent FMM Kernel Independent FMM FMM Issues FMM requires analytical work to generate S expansions, R expansions, S S (M2M) translations S R (M2L) translations R R (L2L) translations Such analytical work leads to

More information

The Fast Multipole Method on NVIDIA GPUs and Multicore Processors

The Fast Multipole Method on NVIDIA GPUs and Multicore Processors The Fast Multipole Method on NVIDIA GPUs and Multicore Processors Toru Takahashi, a Cris Cecka, b Eric Darve c a b c Department of Mechanical Science and Engineering, Nagoya University Institute for Applied

More information

Fast Multipole and Related Algorithms

Fast Multipole and Related Algorithms Fast Multipole and Related Algorithms Ramani Duraiswami University of Maryland, College Park http://www.umiacs.umd.edu/~ramani Joint work with Nail A. Gumerov Efficiency by exploiting symmetry and A general

More information

A Kernel-independent Adaptive Fast Multipole Method

A Kernel-independent Adaptive Fast Multipole Method A Kernel-independent Adaptive Fast Multipole Method Lexing Ying Caltech Joint work with George Biros and Denis Zorin Problem Statement Given G an elliptic PDE kernel, e.g. {x i } points in {φ i } charges

More information

Efficient O(N log N) algorithms for scattered data interpolation

Efficient O(N log N) algorithms for scattered data interpolation Efficient O(N log N) algorithms for scattered data interpolation Nail Gumerov University of Maryland Institute for Advanced Computer Studies Joint work with Ramani Duraiswami February Fourier Talks 2007

More information

Iterative methods for use with the Fast Multipole Method

Iterative methods for use with the Fast Multipole Method Iterative methods for use with the Fast Multipole Method Ramani Duraiswami Perceptual Interfaces and Reality Lab. Computer Science & UMIACS University of Maryland, College Park, MD Joint work with Nail

More information

Fast Multipole Accelerated Indirect Boundary Elements for the Helmholtz Equation

Fast Multipole Accelerated Indirect Boundary Elements for the Helmholtz Equation Fast Multipole Accelerated Indirect Boundary Elements for the Helmholtz Equation Nail A. Gumerov Ross Adelman Ramani Duraiswami University of Maryland Institute for Advanced Computer Studies and Fantalgo,

More information

Fast Multipole Method on the GPU

Fast Multipole Method on the GPU Fast Multipole Method on the GPU with application to the Adaptive Vortex Method University of Bristol, Bristol, United Kingdom. 1 Introduction Particle methods Highly parallel Computational intensive Numerical

More information

A fast direct solver for high frequency scattering from a cavity in two dimensions

A fast direct solver for high frequency scattering from a cavity in two dimensions 1/31 A fast direct solver for high frequency scattering from a cavity in two dimensions Jun Lai 1 Joint work with: Leslie Greengard (CIMS) Sivaram Ambikasaran (CIMS) Workshop on fast direct solver, Dartmouth

More information

Low-rank Properties, Tree Structure, and Recursive Algorithms with Applications. Jingfang Huang Department of Mathematics UNC at Chapel Hill

Low-rank Properties, Tree Structure, and Recursive Algorithms with Applications. Jingfang Huang Department of Mathematics UNC at Chapel Hill Low-rank Properties, Tree Structure, and Recursive Algorithms with Applications Jingfang Huang Department of Mathematics UNC at Chapel Hill Fundamentals of Fast Multipole (type) Method Fundamentals: Low

More information

Computational Fluid Dynamics - Incompressible Flows

Computational Fluid Dynamics - Incompressible Flows Computational Fluid Dynamics - Incompressible Flows March 25, 2008 Incompressible Flows Basis Functions Discrete Equations CFD - Incompressible Flows CFD is a Huge field Numerical Techniques for solving

More information

Normalized cuts and image segmentation

Normalized cuts and image segmentation Normalized cuts and image segmentation Department of EE University of Washington Yeping Su Xiaodan Song Normalized Cuts and Image Segmentation, IEEE Trans. PAMI, August 2000 5/20/2003 1 Outline 1. Image

More information

Fast multipole methods for axisymmetric geometries

Fast multipole methods for axisymmetric geometries Fast multipole methods for axisymmetric geometries Victor Churchill New York University May 13, 2016 Abstract Fast multipole methods (FMMs) are one of the main numerical methods used in the solution of

More information

A pedestrian introduction to fast multipole methods

A pedestrian introduction to fast multipole methods SCIENCE CHIN Mathematics. RTICLES. May 2012 Vol. 55 No. 5: 1043 1051 doi: 10.1007/s11425-012-4392-0 pedestrian introduction to fast multipole methods YING Lexing Department of Mathematics and ICES, University

More information

Mathematics for chemical engineers

Mathematics for chemical engineers Mathematics for chemical engineers Drahoslava Janovská Department of mathematics Winter semester 2013-2014 Numerical solution of ordinary differential equations Initial value problem Outline 1 Introduction

More information

Matrix algorithms: fast, stable, communication-optimizing random?!

Matrix algorithms: fast, stable, communication-optimizing random?! Matrix algorithms: fast, stable, communication-optimizing random?! Ioana Dumitriu Department of Mathematics University of Washington (Seattle) Joint work with Grey Ballard, James Demmel, Olga Holtz, Robert

More information

Constrained Willmore Tori in the 4 Sphere

Constrained Willmore Tori in the 4 Sphere (Technische Universität Berlin) 16 August 2006 London Mathematical Society Durham Symposium Methods of Integrable Systems in Geometry Constrained Willmore Surfaces The Main Result Strategy of Proof Constrained

More information

The Fast Multipole Method and the Radiosity Kernel

The Fast Multipole Method and the Radiosity Kernel and the Radiosity Kernel The Fast Multipole Method Sharat Chandran http://www.cse.iitb.ac.in/ sharat January 8, 2006 Page 1 of 43 (Joint work with Alap Karapurkar and Nitin Goel) 1 Copyright c 2005 Sharat

More information

Tomographic Image Reconstruction in Noisy and Limited Data Settings.

Tomographic Image Reconstruction in Noisy and Limited Data Settings. Tomographic Image Reconstruction in Noisy and Limited Data Settings. Syed Tabish Abbas International Institute of Information Technology, Hyderabad syed.abbas@research.iiit.ac.in July 1, 2016 Tabish (IIIT-H)

More information

Modern Methods of Data Analysis - WS 07/08

Modern Methods of Data Analysis - WS 07/08 Modern Methods of Data Analysis Lecture XV (04.02.08) Contents: Function Minimization (see E. Lohrmann & V. Blobel) Optimization Problem Set of n independent variables Sometimes in addition some constraints

More information

Mathematics. Jaehyun Park. CS 97SI Stanford University. June 29, 2015

Mathematics. Jaehyun Park. CS 97SI Stanford University. June 29, 2015 Mathematics Jaehyun Park CS 97SI Stanford University June 29, 2015 Outline Algebra Number Theory Combinatorics Geometry Algebra 2 Sum of Powers n k=1 k 3 k 2 = 1 n(n + 1)(2n + 1) 6 = ( k ) 2 = ( 1 2 n(n

More information

Adaptive boundary element methods in industrial applications

Adaptive boundary element methods in industrial applications Adaptive boundary element methods in industrial applications Günther Of, Olaf Steinbach, Wolfgang Wendland Adaptive Fast Boundary Element Methods in Industrial Applications, Hirschegg, September 30th,

More information

Robot Mapping. Least Squares Approach to SLAM. Cyrill Stachniss

Robot Mapping. Least Squares Approach to SLAM. Cyrill Stachniss Robot Mapping Least Squares Approach to SLAM Cyrill Stachniss 1 Three Main SLAM Paradigms Kalman filter Particle filter Graphbased least squares approach to SLAM 2 Least Squares in General Approach for

More information

Graphbased. Kalman filter. Particle filter. Three Main SLAM Paradigms. Robot Mapping. Least Squares Approach to SLAM. Least Squares in General

Graphbased. Kalman filter. Particle filter. Three Main SLAM Paradigms. Robot Mapping. Least Squares Approach to SLAM. Least Squares in General Robot Mapping Three Main SLAM Paradigms Least Squares Approach to SLAM Kalman filter Particle filter Graphbased Cyrill Stachniss least squares approach to SLAM 1 2 Least Squares in General! Approach for

More information

Introduction to Complex Analysis

Introduction to Complex Analysis Introduction to Complex Analysis George Voutsadakis 1 1 Mathematics and Computer Science Lake Superior State University LSSU Math 413 George Voutsadakis (LSSU) Complex Analysis October 2014 1 / 50 Outline

More information

Privacy Preserving Machine Learning: A Theoretically Sound App

Privacy Preserving Machine Learning: A Theoretically Sound App Privacy Preserving Machine Learning: A Theoretically Sound Approach Outline 1 2 3 4 5 6 Privacy Leakage Events AOL search data leak: New York Times journalist was able to identify users from the anonymous

More information

Stokes Preconditioning on a GPU

Stokes Preconditioning on a GPU Stokes Preconditioning on a GPU Matthew Knepley 1,2, Dave A. Yuen, and Dave A. May 1 Computation Institute University of Chicago 2 Department of Molecular Biology and Physiology Rush University Medical

More information

Long time integrations of a convective PDE on the sphere by RBF collocation

Long time integrations of a convective PDE on the sphere by RBF collocation Long time integrations of a convective PDE on the sphere by RBF collocation Bengt Fornberg and Natasha Flyer University of Colorado NCAR Department of Applied Mathematics Institute for Mathematics Applied

More information

2 Second Derivatives. As we have seen, a function f (x, y) of two variables has four different partial derivatives: f xx. f yx. f x y.

2 Second Derivatives. As we have seen, a function f (x, y) of two variables has four different partial derivatives: f xx. f yx. f x y. 2 Second Derivatives As we have seen, a function f (x, y) of two variables has four different partial derivatives: (x, y), (x, y), f yx (x, y), (x, y) It is convenient to gather all four of these into

More information

A PARALLEL SHARED MEMORY IMPLEMENTATION OF THE FAST MULTIPOLE METHOD FOR ELECTROMAGNETICS

A PARALLEL SHARED MEMORY IMPLEMENTATION OF THE FAST MULTIPOLE METHOD FOR ELECTROMAGNETICS A PARALLEL SHARED MEMORY IMPLEMENTATION OF THE FAST MULTIPOLE METHOD FOR ELECTROMAGNETICS MARTIN NILSSON 2 2 Department of Information Technology, Scientific Computing Uppsala University, SE-75105 Uppsala,

More information

Study and implementation of computational methods for Differential Equations in heterogeneous systems. Asimina Vouronikoy - Eleni Zisiou

Study and implementation of computational methods for Differential Equations in heterogeneous systems. Asimina Vouronikoy - Eleni Zisiou Study and implementation of computational methods for Differential Equations in heterogeneous systems Asimina Vouronikoy - Eleni Zisiou Outline Introduction Review of related work Cyclic Reduction Algorithm

More information

A boundary integral method for the three-dimensional heat equation subject to specification of energy

A boundary integral method for the three-dimensional heat equation subject to specification of energy A boundary integral method for the three-dimensional heat equation subject to specification of energy W. T. Ang Computational and Mathematical Sciences Group Faculty of Information Technology Universiti

More information

Lecture 9 - Matrix Multiplication Equivalences and Spectral Graph Theory 1

Lecture 9 - Matrix Multiplication Equivalences and Spectral Graph Theory 1 CME 305: Discrete Mathematics and Algorithms Instructor: Professor Aaron Sidford (sidford@stanfordedu) February 6, 2018 Lecture 9 - Matrix Multiplication Equivalences and Spectral Graph Theory 1 In the

More information

Math 407 Solutions to Exam 3 April 24, Let f = u + iv, and let Γ be parmetrized by Γ = (x (t),y(t)) = x (t) +iy (t) for a t b.

Math 407 Solutions to Exam 3 April 24, Let f = u + iv, and let Γ be parmetrized by Γ = (x (t),y(t)) = x (t) +iy (t) for a t b. Math 7 Solutions to Exam 3 April, 3 1. (1 Define the following: (a f (z dz, where Γ is a smooth curve with finite length. Γ Let f u + iv, and let Γ be parmetrized by Γ (x (t,y(t x (t +iy (t for a t b.

More information

arxiv: v1 [math.na] 9 Nov 2018

arxiv: v1 [math.na] 9 Nov 2018 arxiv:1811.04134v1 [math.na] 9 Nov 2018 An efficient method for block low-rank approximations for kernel matrix systems Xin Xing Edmond Chow Abstract In the iterative solution of dense linear systems from

More information

Diffusion Wavelets for Natural Image Analysis

Diffusion Wavelets for Natural Image Analysis Diffusion Wavelets for Natural Image Analysis Tyrus Berry December 16, 2011 Contents 1 Project Description 2 2 Introduction to Diffusion Wavelets 2 2.1 Diffusion Multiresolution............................

More information

Boundary element quadrature schemes for multi- and many-core architectures

Boundary element quadrature schemes for multi- and many-core architectures Boundary element quadrature schemes for multi- and many-core architectures Jan Zapletal, Michal Merta, Lukáš Malý IT4Innovations, Dept. of Applied Mathematics VŠB-TU Ostrava jan.zapletal@vsb.cz Intel MIC

More information

Center for Computational Science

Center for Computational Science Center for Computational Science Toward GPU-accelerated meshfree fluids simulation using the fast multipole method Lorena A Barba Boston University Department of Mechanical Engineering with: Felipe Cruz,

More information

A New Advancement in the Complex Variable Boundary Element Method with a Potential Flow Application

A New Advancement in the Complex Variable Boundary Element Method with a Potential Flow Application A A New Advancement in Complex Variable Boundary Element Method with a Potential Flow Massachusetts Institute of Technology, United States Military Academy bdwilkins95@gmail.com November 2, 2018 A Overview

More information

Curriculum Map: Mathematics

Curriculum Map: Mathematics Curriculum Map: Mathematics Course: Honors Advanced Precalculus and Trigonometry Grade(s): 11-12 Unit 1: Functions and Their Graphs This chapter will develop a more complete, thorough understanding of

More information

Edge and local feature detection - 2. Importance of edge detection in computer vision

Edge and local feature detection - 2. Importance of edge detection in computer vision Edge and local feature detection Gradient based edge detection Edge detection by function fitting Second derivative edge detectors Edge linking and the construction of the chain graph Edge and local feature

More information

PHYSICALLY BASED ANIMATION

PHYSICALLY BASED ANIMATION PHYSICALLY BASED ANIMATION CS148 Introduction to Computer Graphics and Imaging David Hyde August 2 nd, 2016 WHAT IS PHYSICS? the study of everything? WHAT IS COMPUTATION? the study of everything? OUTLINE

More information

CSCI5070 Advanced Topics in Social Computing

CSCI5070 Advanced Topics in Social Computing CSCI5070 Advanced Topics in Social Computing Irwin King The Chinese University of Hong Kong king@cse.cuhk.edu.hk!! 2012 All Rights Reserved. Outline Graphs Origins Definition Spectral Properties Type of

More information

Interlude: Solving systems of Equations

Interlude: Solving systems of Equations Interlude: Solving systems of Equations Solving Ax = b What happens to x under Ax? The singular value decomposition Rotation matrices Singular matrices Condition number Null space Solving Ax = 0 under

More information

Mesh-Based Inverse Kinematics

Mesh-Based Inverse Kinematics CS468, Wed Nov 9 th 2005 Mesh-Based Inverse Kinematics R. W. Sumner, M. Zwicker, C. Gotsman, J. Popović SIGGRAPH 2005 The problem 1 General approach Learn from experience... 2 As-rigid-as-possible shape

More information

A ray-based IPDG method for high-frequency time-domain acoustic wave propagation in inhomogeneous media

A ray-based IPDG method for high-frequency time-domain acoustic wave propagation in inhomogeneous media A ray-based IPDG method for high-frequency time-domain acoustic wave propagation in inhomogeneous media Eric T. Chung Chi Yeung Lam Jianliang Qian arxiv:1704.06916v1 [math.na] 23 Apr 2017 October 15, 2018

More information

FORSCHUNGSZENTRUM JÜLICH GmbH Jülich Supercomputing Centre D Jülich, Tel. (02461)

FORSCHUNGSZENTRUM JÜLICH GmbH Jülich Supercomputing Centre D Jülich, Tel. (02461) FORSCHUNGSZENTRUM JÜLICH GmbH Jülich Supercomputing Centre D-52425 Jülich, Tel. (02461) 61-6402 Technical Report Benchmark of fast Coulomb Solvers for open and periodic boundary conditions Sebastian Krumscheid

More information

Performance and Application of the DORT2002 Light Scattering Simulation Model

Performance and Application of the DORT2002 Light Scattering Simulation Model Performance and Application of the DORT22 Light Scattering Simulation Model Per Edström Marcus Lehto Mid Sweden University FSCN Report ISSN 165-5387 23:22 Internal FSCN Report Number: June 23 NET W O R

More information

Implementation of PML in the Depth-oriented Extended Forward Modeling

Implementation of PML in the Depth-oriented Extended Forward Modeling Implementation of PML in the Depth-oriented Extended Forward Modeling Lei Fu, William W. Symes The Rice Inversion Project (TRIP) April 19, 2013 Lei Fu, William W. Symes (TRIP) PML in Extended modeling

More information

Math 205 Test 3 Grading Guidelines Problem 1 Part a: 1 point for figuring out r, 2 points for setting up the equation P = ln 2 P and 1 point for the initial condition. Part b: All or nothing. This is really

More information

A Broadband Fast Multipole Accelerated Boundary Element Method for the 3D Helmholtz Equation. Abstract

A Broadband Fast Multipole Accelerated Boundary Element Method for the 3D Helmholtz Equation. Abstract A Broadband Fast Multipole Accelerated Boundary Element Method for the 3D Helmholtz Equation Nail A. Gumerov and Ramani Duraiswami (Dated: 31 December 2007, Revised 22 July 2008, Revised 03 October 2008.)

More information

Contents Computing with Formulas

Contents Computing with Formulas Contents 1 Computing with Formulas... 1 1.1 The First Programming Encounter: a Formula... 1 1.1.1 Using a Program as a Calculator... 2 1.1.2 About Programs and Programming... 2 1.1.3 Tools for Writing

More information

DS Machine Learning and Data Mining I. Alina Oprea Associate Professor, CCIS Northeastern University

DS Machine Learning and Data Mining I. Alina Oprea Associate Professor, CCIS Northeastern University DS 4400 Machine Learning and Data Mining I Alina Oprea Associate Professor, CCIS Northeastern University September 20 2018 Review Solution for multiple linear regression can be computed in closed form

More information

Control of industrial robots. Kinematic redundancy

Control of industrial robots. Kinematic redundancy Control of industrial robots Kinematic redundancy Prof. Paolo Rocco (paolo.rocco@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Kinematic redundancy Direct kinematics

More information

Theoretical Background for OpenLSTO v0.1: Open Source Level Set Topology Optimization. M2DO Lab 1,2. 1 Cardiff University

Theoretical Background for OpenLSTO v0.1: Open Source Level Set Topology Optimization. M2DO Lab 1,2. 1 Cardiff University Theoretical Background for OpenLSTO v0.1: Open Source Level Set Topology Optimization M2DO Lab 1,2 1 Cardiff University 2 University of California, San Diego November 2017 A brief description of theory

More information

Broad field that includes low-level operations as well as complex high-level algorithms

Broad field that includes low-level operations as well as complex high-level algorithms Image processing About Broad field that includes low-level operations as well as complex high-level algorithms Low-level image processing Computer vision Computational photography Several procedures and

More information

Numerical Aspects of Special Functions

Numerical Aspects of Special Functions Numerical Aspects of Special Functions Nico M. Temme In collaboration with Amparo Gil and Javier Segura, Santander, Spain. Nico.Temme@cwi.nl Centrum voor Wiskunde en Informatica (CWI), Amsterdam Numerics

More information

Integrated Math I. IM1.1.3 Understand and use the distributive, associative, and commutative properties.

Integrated Math I. IM1.1.3 Understand and use the distributive, associative, and commutative properties. Standard 1: Number Sense and Computation Students simplify and compare expressions. They use rational exponents and simplify square roots. IM1.1.1 Compare real number expressions. IM1.1.2 Simplify square

More information

Inverse and Implicit functions

Inverse and Implicit functions CHAPTER 3 Inverse and Implicit functions. Inverse Functions and Coordinate Changes Let U R d be a domain. Theorem. (Inverse function theorem). If ϕ : U R d is differentiable at a and Dϕ a is invertible,

More information

DEPARTMENT - Mathematics. Coding: N Number. A Algebra. G&M Geometry and Measure. S Statistics. P - Probability. R&P Ratio and Proportion

DEPARTMENT - Mathematics. Coding: N Number. A Algebra. G&M Geometry and Measure. S Statistics. P - Probability. R&P Ratio and Proportion DEPARTMENT - Mathematics Coding: N Number A Algebra G&M Geometry and Measure S Statistics P - Probability R&P Ratio and Proportion YEAR 7 YEAR 8 N1 Integers A 1 Simplifying G&M1 2D Shapes N2 Decimals S1

More information

Heat Kernels and Diffusion Processes

Heat Kernels and Diffusion Processes Heat Kernels and Diffusion Processes Definition: University of Alicante (Spain) Matrix Computing (subject 3168 Degree in Maths) 30 hours (theory)) + 15 hours (practical assignment) Contents 1. Solving

More information

Topology optimization of heat conduction problems

Topology optimization of heat conduction problems Topology optimization of heat conduction problems Workshop on industrial design optimization for fluid flow 23 September 2010 Misha Marie Gregersen Anton Evgrafov Mads Peter Sørensen Technical University

More information

Topology Changes for Surface Meshes in Active Contours

Topology Changes for Surface Meshes in Active Contours Topology Changes for Surface Meshes in Active Contours Jochen Abhau University of Innsbruck, Department of Computer Science FSP Conference Vorau, November 2006 Outline 1 Introduction 2 Topological Adaptation

More information

Parallel and Distributed Systems Lab.

Parallel and Distributed Systems Lab. Parallel and Distributed Systems Lab. Department of Computer Sciences Purdue University. Jie Chi, Ronaldo Ferreira, Ananth Grama, Tzvetan Horozov, Ioannis Ioannidis, Mehmet Koyuturk, Shan Lei, Robert Light,

More information

1.2 Numerical Solutions of Flow Problems

1.2 Numerical Solutions of Flow Problems 1.2 Numerical Solutions of Flow Problems DIFFERENTIAL EQUATIONS OF MOTION FOR A SIMPLIFIED FLOW PROBLEM Continuity equation for incompressible flow: 0 Momentum (Navier-Stokes) equations for a Newtonian

More information

Slat noise prediction with Fast Multipole BEM based on anisotropic synthetic turbulence sources

Slat noise prediction with Fast Multipole BEM based on anisotropic synthetic turbulence sources DLR.de Chart 1 Slat noise prediction with Fast Multipole BEM based on anisotropic synthetic turbulence sources Nils Reiche, Markus Lummer, Roland Ewert, Jan W. Delfs Institute of Aerodynamics and Flow

More information

CS545 Contents IX. Inverse Kinematics. Reading Assignment for Next Class. Analytical Methods Iterative (Differential) Methods

CS545 Contents IX. Inverse Kinematics. Reading Assignment for Next Class. Analytical Methods Iterative (Differential) Methods CS545 Contents IX Inverse Kinematics Analytical Methods Iterative (Differential) Methods Geometric and Analytical Jacobian Jacobian Transpose Method Pseudo-Inverse Pseudo-Inverse with Optimization Extended

More information

SPH: Why and what for?

SPH: Why and what for? SPH: Why and what for? 4 th SPHERIC training day David Le Touzé, Fluid Mechanics Laboratory, Ecole Centrale de Nantes / CNRS SPH What for and why? How it works? Why not for everything? Duality of SPH SPH

More information

Speeding Up the ARDL Estimation Command:

Speeding Up the ARDL Estimation Command: Speeding Up the ARDL Estimation Command: A Case Study in Efficient Programming in Stata and Mata Sebastian Kripfganz 1 Daniel C. Schneider 2 1 University of Exeter 2 Max Planck Institute for Demographic

More information

The Fast Multipole Method (FMM)

The Fast Multipole Method (FMM) The Fast Multipole Method (FMM) Motivation for FMM Computational Physics Problems involving mutual interactions of N particles Gravitational or Electrostatic forces Collective (but weak) long-range forces

More information

Image Based Visual Servoing Using Algebraic Curves Applied to Shape Alignment

Image Based Visual Servoing Using Algebraic Curves Applied to Shape Alignment The 29 IEEE/RSJ International Conference on Intelligent Robots and Systems October 11-15, 29 St. Louis, USA Image Based Visual Servoing Using Algebraic Curves Applied to Shape Alignment Ahmet Yasin Yazicioglu,

More information

Stability Analysis of the Muscl Method on General Unstructured Grids for Applications to Compressible Fluid Flow

Stability Analysis of the Muscl Method on General Unstructured Grids for Applications to Compressible Fluid Flow Stability Analysis of the Muscl Method on General Unstructured Grids for Applications to Compressible Fluid Flow F. Haider 1, B. Courbet 1, J.P. Croisille 2 1 Département de Simulation Numérique des Ecoulements

More information

MATRIX REVIEW PROBLEMS: Our matrix test will be on Friday May 23rd. Here are some problems to help you review.

MATRIX REVIEW PROBLEMS: Our matrix test will be on Friday May 23rd. Here are some problems to help you review. MATRIX REVIEW PROBLEMS: Our matrix test will be on Friday May 23rd. Here are some problems to help you review. 1. The intersection of two non-parallel planes is a line. Find the equation of the line. Give

More information

Experimental Data and Training

Experimental Data and Training Modeling and Control of Dynamic Systems Experimental Data and Training Mihkel Pajusalu Alo Peets Tartu, 2008 1 Overview Experimental data Designing input signal Preparing data for modeling Training Criterion

More information

Computation of the gravity gradient tensor due to topographic masses using tesseroids

Computation of the gravity gradient tensor due to topographic masses using tesseroids Computation of the gravity gradient tensor due to topographic masses using tesseroids Leonardo Uieda 1 Naomi Ussami 2 Carla F Braitenberg 3 1. Observatorio Nacional, Rio de Janeiro, Brazil 2. Universidade

More information

Animating Transformations

Animating Transformations Animating Transformations Connelly Barnes CS445: Graphics Acknowledgment: slides by Jason Lawrence, Misha Kazhdan, Allison Klein, Tom Funkhouser, Adam Finkelstein and David Dobkin Overview Rotations and

More information

Math 1B03/1ZC3 - Tutorial 3. Jan. 24th/28th, 2014

Math 1B03/1ZC3 - Tutorial 3. Jan. 24th/28th, 2014 Math 1B03/1ZC3 - Tutorial 3 Jan. 24th/28th, 2014 Tutorial Info: Website: http://ms.mcmaster.ca/ dedieula. Math Help Centre: Wednesdays 2:30-5:30pm. Email: dedieula@math.mcmaster.ca. Elementary Matrices

More information

Rational Trigonometry Applied to Robotics

Rational Trigonometry Applied to Robotics Robot Kinematic Modeling using Rational Trigonometry 6 de Novembro de 2007 Overview Overview 1 Overview 2 3 The Fixed Frames Model for Robot Kinematics 4 Conclusions 4 Perspectives and Future Work 5 Q&A

More information

CS 97SI: INTRODUCTION TO PROGRAMMING CONTESTS. Jaehyun Park

CS 97SI: INTRODUCTION TO PROGRAMMING CONTESTS. Jaehyun Park CS 97SI: INTRODUCTION TO PROGRAMMING CONTESTS Jaehyun Park Today s Lecture Algebra Number Theory Combinatorics (non-computational) Geometry Emphasis on how to compute Sum of Powers n k=1 k 2 = 1 6 n(n

More information

Panel methods are currently capable of rapidly solving the potential flow equation on rather complex

Panel methods are currently capable of rapidly solving the potential flow equation on rather complex A Fast, Unstructured Panel Solver John Moore 8.337 Final Project, Fall, 202 A parallel high-order Boundary Element Method accelerated by the Fast Multipole Method is presented in this report. The case

More information

Theoretical Concepts of Machine Learning

Theoretical Concepts of Machine Learning Theoretical Concepts of Machine Learning Part 2 Institute of Bioinformatics Johannes Kepler University, Linz, Austria Outline 1 Introduction 2 Generalization Error 3 Maximum Likelihood 4 Noise Models 5

More information

GPU-based Distributed Behavior Models with CUDA

GPU-based Distributed Behavior Models with CUDA GPU-based Distributed Behavior Models with CUDA Courtesy: YouTube, ISIS Lab, Universita degli Studi di Salerno Bradly Alicea Introduction Flocking: Reynolds boids algorithm. * models simple local behaviors

More information

Function approximation using RBF network. 10 basis functions and 25 data points.

Function approximation using RBF network. 10 basis functions and 25 data points. 1 Function approximation using RBF network F (x j ) = m 1 w i ϕ( x j t i ) i=1 j = 1... N, m 1 = 10, N = 25 10 basis functions and 25 data points. Basis function centers are plotted with circles and data

More information

Translation surfaces: saddle connections, triangles and covering constructions

Translation surfaces: saddle connections, triangles and covering constructions Translation surfaces: saddle connections, triangles and covering constructions Chenxi Wu Cornell University July 29, 2016 Translation surfaces A (compact) translation surface is: a compact surface with

More information

Lambertian model of reflectance II: harmonic analysis. Ronen Basri Weizmann Institute of Science

Lambertian model of reflectance II: harmonic analysis. Ronen Basri Weizmann Institute of Science Lambertian model of reflectance II: harmonic analysis Ronen Basri Weizmann Institute of Science Illumination cone What is the set of images of an object under different lighting, with any number of sources?

More information

Stability Analysis of Particle Methods with Corrected Derivatives

Stability Analysis of Particle Methods with Corrected Derivatives Stability Analysis of Particle Methods with Corrected Derivatives Shaoping iao and Ted Belytschko Northwestern University Supported by Office of Naval Research Outline: 1. Description of discretization

More information

ξ ν ecliptic sun m λ s equator

ξ ν ecliptic sun m λ s equator Attitude parameterization for GAIA L. Lindegren (1 July ) SAG LL Abstract. The GAIA attaitude may be described by four continuous functions of time, q1(t), q(t), q(t), q4(t), which form a quaternion of

More information

Lecture 15: More Iterative Ideas

Lecture 15: More Iterative Ideas Lecture 15: More Iterative Ideas David Bindel 15 Mar 2010 Logistics HW 2 due! Some notes on HW 2. Where we are / where we re going More iterative ideas. Intro to HW 3. More HW 2 notes See solution code!

More information

A More Efficient Approach to Large Scale Matrix Completion Problems

A More Efficient Approach to Large Scale Matrix Completion Problems A More Efficient Approach to Large Scale Matrix Completion Problems Matthew Olson August 25, 2014 Abstract This paper investigates a scalable optimization procedure to the low-rank matrix completion problem

More information

PURE MATHEMATICS 212 Multivariable Calculus CONTENTS. Page. 1. Assignment Summary... i 2. Summary Assignments...2

PURE MATHEMATICS 212 Multivariable Calculus CONTENTS. Page. 1. Assignment Summary... i 2. Summary Assignments...2 PURE MATHEMATICS 212 Multivariable Calculus CONTENTS Page 1. Assignment Summary... i 2. Summary...1 3. Assignments...2 i PMTH212, Multivariable Calculus Assignment Summary 2010 Assignment Date to be Posted

More information

Boundary Element Method Open Source Software in Excel VBA

Boundary Element Method Open Source Software in Excel VBA File / Module(s) Title Version(Date) and History Description Boundary Element Method Open Source Software in Excel VBA LBEMA_1.xlsm/ LBEMA.xlsm A spreadsheet that solves Laplace s equation in an axisymmetic

More information

Timo Lähivaara, Tomi Huttunen, Simo-Pekka Simonaho University of Kuopio, Department of Physics P.O.Box 1627, FI-70211, Finland

Timo Lähivaara, Tomi Huttunen, Simo-Pekka Simonaho University of Kuopio, Department of Physics P.O.Box 1627, FI-70211, Finland Timo Lähivaara, Tomi Huttunen, Simo-Pekka Simonaho University of Kuopio, Department of Physics P.O.Box 627, FI-72, Finland timo.lahivaara@uku.fi INTRODUCTION The modeling of the acoustic wave fields often

More information

Adaptive Binary Quantization for Fast Nearest Neighbor Search

Adaptive Binary Quantization for Fast Nearest Neighbor Search IBM Research Adaptive Binary Quantization for Fast Nearest Neighbor Search Zhujin Li 1, Xianglong Liu 1*, Junjie Wu 1, and Hao Su 2 1 Beihang University, Beijing, China 2 Stanford University, Stanford,

More information

Numerical Methods 5633

Numerical Methods 5633 Numerical Methods 5633 Lecture 7 Marina Krstic Marinkovic mmarina@maths.tcd.ie School of Mathematics Trinity College Dublin Marina Krstic Marinkovic 1 / 10 5633-Numerical Methods Organisational To appear

More information

Capturing, Modeling, Rendering 3D Structures

Capturing, Modeling, Rendering 3D Structures Computer Vision Approach Capturing, Modeling, Rendering 3D Structures Calculate pixel correspondences and extract geometry Not robust Difficult to acquire illumination effects, e.g. specular highlights

More information

GPU Implementation of Implicit Runge-Kutta Methods

GPU Implementation of Implicit Runge-Kutta Methods GPU Implementation of Implicit Runge-Kutta Methods Navchetan Awasthi, Abhijith J Supercomputer Education and Research Centre Indian Institute of Science, Bangalore, India navchetanawasthi@gmail.com, abhijith31792@gmail.com

More information

FMM implementation on CPU and GPU. Nail A. Gumerov (Lecture for CMSC 828E)

FMM implementation on CPU and GPU. Nail A. Gumerov (Lecture for CMSC 828E) FMM implementation on CPU and GPU Nail A. Gumerov (Lecture for CMSC 828E) Outline Two parts of the FMM Data Structure Flow Chart of the Run Algorithm FMM Cost/Optimization on CPU Programming on GPU Fast

More information

Robust 3D gravity gradient inversion by planting anomalous densities

Robust 3D gravity gradient inversion by planting anomalous densities Robust 3D gravity gradient inversion by planting anomalous densities Leonardo Uieda Valéria C. F. Barbosa Observatório Nacional September, 2011 Outline Outline Forward Problem Outline Forward Problem Inverse

More information

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry 55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography Estimating homography from point correspondence

More information

Spherical Microphone Arrays

Spherical Microphone Arrays Spherical Microphone Arrays Acoustic Wave Equation Helmholtz Equation Assuming the solutions of wave equation are time harmonic waves of frequency ω satisfies the homogeneous Helmholtz equation: Boundary

More information