Multilevel Iterative Methods

Size: px
Start display at page:

Download "Multilevel Iterative Methods"

Transcription

1 Mltleel Iterate Methods Erc Yn Adsor: Professor Randy Bank, UCSD

2 Contents Introdcton.. 3 Basc Mltgrd Algorthm. Mltgrd fondatons 3. Mltgrd algorthm 4 3 Epermentaton 5 4 Algebrac Mltgrd (AMG) 4. Introdcton to AMG Implementng AMG Epermentaton Acknowledgements References 7

3 Introdcton Ths paper noles the analyss and stdy of mltleel terate methods, otherwse known as Mltgrd. Mltgrd s generally sed to appromate the solton of ellptc partal dfferental eqatons. The defnton of a partal dfferental eqaton (PDE) s the relatons nolng an nknown fncton of seeral ndependent arables and ts partal derates wth respect to those arables. [6] An ellptc PDE s a specfc branch of PDEs whch wll be descrbed n the followng secton. Whle there are many methods that can drectly sole PDEs (.e. ntegral transform, separaton of arables, and Green s fncton), real lfe problems are often too comple to be soled drectly. Ths appromaton methods sch as SSOR, ILU, Congate Gradents, and Mltgrd are sed. In ths paper, we dscss aros aspects of Mltgrd. We wll look at the adantages of Mltgrd (as opposed to the other appromaton methods), break down the aros components that make p Mltgrd, descrbe the Mltgrd algorthm as a whole, do some epermentaton, and then eamne Algebrac Mltgrd, a more comple araton of the basc Mltgrd. Backgrond. Mltgrd fondatons Mltgrd s an terate method that can be sed to sole A = f (.) A s a sqare matr, f s a ector termed the rght hand sde, and s a ector for whch we are tryng to sole. An terate method s defned as a method that attempts to sole a problem by fndng sccesse appromatons to the solton startng from an ntal gess. [6] Mltgrd s prmarly sed to sole ellptc partal dfferental eqatons. Ths branch of problems can be represented n general terms as: a(, + b(, + c(, + d(, + e(, + g(, f (, where b ac < 0 y yy y =, and Ω (the doman) and Ω (the bondares) are proded. There are other terate methods sed to sole ellptc PDEs bt the rate of conergence and cost of Mltgrd s what makes the algorthm sgnfcant. Below s a chart that depcts the aros appromaton methods and ther respecte spectral rads (whch measres the rate of conergence) and cost. 3

4 Method Cost Spectral rads Jacob / N N log N ch SOR/SSOR/ILU / N N log N ch Jacob-CG / N N log N SSOR-CG/ILU-CG / N N log N Mltgrd N c < Fg.. where d s the nmber of dmensons of the problem, N represents the sze of the problem, c s a constant whch ares by method, and h=/n (length of each step sze).. Mltgrd Algorthm There est seeral key components of Mltgrd. These are: smoothng, restrcton, and prolongaton. Pror to mplementng the Mltgrd algorthm, t s necessary to dscretze the problem frst. The dscretzaton of ellptc partal dfferental eqatons leads to solng a problem of the form (.). Ths matr problem s what Mltgrd wll be mplemented on. So the ery frst thng we wll dscss s how to dscretze a problem. Dscretzaton: Dscretzaton by defnton s the process of transferrng contnos models and eqatons nto dscrete conterparts. [6] Whle dscretzaton takes away from the contnty of the problem, the dea behnd t s that the ntal problem s well-posed: Condtons to beng well-posed:. A solton ests. The solton s nqe 3. If the data are changed only slghtly, then the resltng solton changes only slghtly (contnos dependence of solton on data). When sng a nmercal algorthm to appromate a solton for a problem t s mportant to determne f a problem s well-posed. Frst, f no solton ests then there s no pont n applyng the algorthm to the problem. Second, f mltple soltons ests, one mst determne whch compted solton s of nterest. Thrd, f the frst two condtons are satsfed bt the solton does not depend contnosly on the data, then the appromaton to the eact solton wll most lkely be of no ale. Ths s becase n appromaton technqes, the comptatons noled do not nole drectly solng the problem, bt nstead a problem that has been slghtly altered. The modfed problem may hae one solton bt that solton may be sgnfcantly dfferent than the tre solton of the orgnal problem f t does not depend contnosly on the data. There are aros methods of dscretzng a PDE. Some of the more common technqes nclde: 4

5 . Fnte dfferences. Fnte olmes 3. Fnte elements It wold be too mch to go nto eery sngle method of dscretzaton, so nstead, below s an eample of how to dscretze a problem sng fnte dfferences. Also nclded are salzatons of a problem sng fnte dscretzaton. Eample: Fnte dfferences dscretzaton We frst ntrodce the followng notaton: Ω s the doman n whch we are workng on. P =, y ) s a collecton of grd ponts for nteger ales of and wth ( = h, y = y k o + o + where ( o, yo ) s a chosen specfc pont and the stepszes h = and k = y are fed mesh wdths. (note: does not denote the Laplacan bt nstead a chosen stepsze for both the and y drecton respectel The dscrete pont set Ω h, k = { P = (, y ) = o + h, y = yo + k for all ntegers, wth P Ω} prodes a dscrete representaton of Ω. Let = (, y ) for (, y ) Ω h, k For a smooth fncton = (, and for any small nmber, take the Taylor epanson wth respect to to get: 3 ( +, = (, + (, + ( ) (, + ( ) (, + ϑ (( ) 3! 4 where ϑ (( ) ) refers to a bonded qantty: ϑ ( h) c h where c s a constant and n ths case, h = ( ). ϑ(h) s termed the trncaton error. By mong term s of the Taylor epanson arond to get the frst derate of wth respect to solated, we get the followng: (, = [ ( +, (, ] (, + ϑ ( ) 4 ) 5

6 or n grd notaton wth h = and replacng h (, y ) = [ +,, ] + ϑ( h) (.) h by we can get h (, y ) = [,, ] + + ϑ( h) (.3) h Sbtractng formlas (.) from (.3) and solatng : (, y ) [,,, ] ( h ) ϑ (.4) h = and sng a common stepsze h=k, a correspondng dscretzaton wth respect to y : yy (, y ) = [,,, ] ( h ) ϑ (.5) h Vsal eample: Fnte dfferences dscretzaton of, y ) + (, y ) ( yy Usng the resltng eqatons (.4) and (.5) and addng them together we can get the followng: (, y ) + yy (, y ) = [ +, +, +, + +, h 4 ] + ϑ(, h ) In the followng fgre, = a +, b =, c =, + d =, = e, 6

7 Fg.. As shown n Fgre., tlzng fnte dscretzaton, n order to get a better appromaton of at pont e for the problem (, y ) + yy (, y ) sng any ntal gess, t s necessary to mltply that pont by -4 and add t to the for srrondng ales arond t. Smoothng/Relaaton Process: Upon dscretzng the ntal problem, the problem then becomes one of solng a qeston of the form (.). Ths can be shown by the followng: Let s eamne From.4, (, y ) = f (, y ) = [ +,, +, ] + ϑ ( h ) = h f ( ) 7

8 For conenence, we wll drop off the h and ϑ ( h ) terms, so the problem now becomes:, y ) [ + ] = f ( ) ( = +,,, Frthermore, n ths problem, we are only workng n one-dmenson () so for frther smplcty, we can drop ot the y terms and ts correspondng ales: ) = [ + + ] = f ( ) (.6) ( (.6) only refers to one solated ale,, on the grd. So to represent ) = [ + + ] = f ( ) where n ( meanng there are n grd ponts, we get the followng system of lnear eqatons (n matr form): n n f f. =. f n f n Notce that for the frst and last eqatons, the frst term and last term respectely are dropped off. Ths s becase data ponts on those correspondng ales are ot of the bonds of the problems. In ths case, n (.) the matr A s the trdagonal matr shown aboe, and the ectors and f correspond to the and f ectors. We begn by talkng abot the frst part of the Mltgrd algorthm termed relaaton. Let s term are crrent appromaton as 0. Let s also pretend that we hae the real solton. These two ales lead to the followng relatonshp: error = 0 (Note: we wll only be sng 0 when dscssng the Mltgrd algorthm, (the eact solton) and the error are only assmed to be known n order to be tlzed as a fondaton for comparson) As a sal eample to help eplan the smoothng process, let s say or error takes on the followng sal form: 8

9 The bg thng that shold be notced s that there are two types of oscllatons n ths error, hgh freqency error and low freqency error. The smoothng process helps get rd of the hgh freqency error sng the followng technqe. Wth 0 (whch we are hopng wll eentally appromate n (.)), smoothng noles the followng terate process: r k Bδ k = b A k = = r k k + δ k k where A and f are from (.) and B s a smplfed factorzaton of A termed the smoother (note: the terms for the smoothng and relaaton are synonymos). The nmber of teratons sed n the smoothng process s p to the ser, bt generally - 4 smoothng processes are adeqate (ths wll be dscssed later). Eamples of aros smoothers: t! B = ( L + D) D ( D + U ) P AP! B = D L,D,U represent the lower tranglar matr, dagonal, and pper tranglar matr of A respectely. P represents a permtaton matr. Vsal eample of the smoothng/relaaton process The followng represents the error before and after smoothng. Fgre.3 s the ntal error, whle Fgre.4 represents the error after the ntal gess has been pdated wthn the smoothng process. 9

10 Fg..3 Notce that most of the hgh freqency oscllatons n the top fgre are gone n bottom fgre (after smoothng). The bottom fgre s essentally smoother. Bt now, the qeston arses as to how to get rd of the low freqency oscllatons. Restrcton: Mltgrd, mch lke ts name, deals wth mltple grds. How are these grds related? The dea behnd Mltgrd s that throgh each sccesse grd, the error s magnfed so yo are able to dentfy and remoe t at a faster rate. Note: Ths wll only work when 0

11 dealng wth low freqency, bt keep n mnd, the smoothng process s etremely effecte n dealng wth the hgh freqency error. Three man qestons arse n dealng wth the mltple grd aspect of Mltgrd:. What are the dfferent types of grds?. How do yo get from one grd to another (.e. what are ther relatonshps)? 3. How does ths get rd of the low freqency error? We wll frst deal wth qestons & and then se sal eamples to eplan qeston 3. Let s begn by defnng certan termnology sed n dealng wth the dfferent classes of grds. In Mltgrd, the dscretzaton grds ether hae more grd ponts or less grd ponts. No two sccesse grds wll hae the same nmber of grd ponts (note: the key word s sccesse). A grd s termed to be more fne f t has more grd ponts. Lkewse, the coarser grds hae less grd ponts. The nterpolaton matr called the restrcton matr helps trn a fne grd nto a coarser grd. The nterpolatng matr that brngs the coarse grd back nto the fne grd agan s called the prolongaton matr. The restrcton process (from fne to coarse) takes on the followng generalzed method (restrcton/prolongaton can be ery dffclt to eplan so the se of eamples, both sally and comptatonally, wll be demonstrated followng ts ntrodcton). Let s say the crrent appromaton to yo hae s termed r, where n ths case, r s a ector. Frst t mst be determned what ponts wll be coarse ponts and what ponts wll be fne ponts. Coarse ponts are data ponts whose crrent ales are ales that yo want to keep n the net grd. The fne ponts are ponts n the crrent grd that yo want to somehow nterpolate nto the coarse ponts so that ther ales are agely represented n the coarse ponts. In other words, to get a coarser grd whle mantanng smlar propertes, fne pont ales wll be combned nto coarse ales. Let r f refer to the determned fne-grd ponts and r c refer to the coarse grd ponts. So, rf r = (.7) rc (Keep n mnd,.7 s not to be taken lterally n that the coarse ponts are the bottom porton of the ector and the fne ponts are st the top part of the ector..7 s sed to represent that ales n can be dded nto coarse ponts and fne ponts.) The restrcton matr takes on the block form: t ( I ) ω (.8)

12 Where t ω s an nterpolant that wll somehow transfer ales of fne-grd ponts nto the coarse grd. Applyng the restrcton matr to the orgnal fne grd r, the problem becomes: ( ) c c f t r r r I ˆ = ω where c rˆ represents the newly created coarse grd that mmedate proceeds the fne grd r. Ths precedng eplanaton may be a bt age, so hopeflly, the followng eamples wll help clarfy the concepts behnd restrcton. Eample: -D restrcton to a generc ector of length 7 Let s say we want to restrct the ector r defned below. r = Restrcton matr = 4 Applyng the restrcton matr: = ˆ ˆ ˆ 4 Notce that now, nstead of hang 7 ponts n or ector, we now hae a coarser 3 pont ector. Prolongaton: Prolongaton s essentally the opposte of restrcton; t brngs the coarse grd back to the fne grd. Snce the prolongaton matr and the restrcton matr are not nerses we do not get back the same grd pont ales, nstead what we are gettng back s the orgnal

13 3 grd ponts. The prolongaton process smply takes the transpose of the restrcton matr mltpled by a constant to get: I c ω If yo are crrently on the coarse grd c û, applyng the coarse grd wth the prolongaton matr gets: = c f c I c ˆ ω where c s a real constant whch s dependent on the restrcton scheme that has been sed. (Mathematcans hae already chosen, for many problems, optmal restrcton matrces and ther correspondng prolongaton matr.) Prolongaton essentally plls ot the fne-pont data from the coarse-grd data whle mantanng the essental ales of the coarse ponts. Eample: -D prolongaton of a length 3 ector Let s say we want to prolongate the ector c û defned below: c û = 3 ˆ ˆ ˆ Prolongaton matr = Applyng the prolongaton matr: = ˆ ˆ ˆ Notce that we started wth only 3 ponts n or ector bt after prolongaton, the reslt was a ector of 7 ponts.

14 The followng fgres ge a pctoral descrpton of the prolongaton and restrcton processes n both -D and -D: -D Fg..5 4

15 -D Fg..6 We hae now answered the qestons of the dfferent types of grds and how to get from one grd to another, bt what s the pont of all ths? The qeston that stll remans s how ths gets rd of the low freqency error. We wll eplan ths sng a erbal eplanaton and a sal eplanaton. Verbal eplanaton: By coarsenng the fne grd, the low freqency error on the fne grd has been strategcally nterpolated nto hgh freqency error on the coarse grd. The key to dealng wth hgh freqency error s tlzng the smoothng process. Snce hgh freqency error wll contnally arse n the followng coarse grd pon nterpolatng each grd, yo need to apply the smoothng process. After smoothng on the fnal coarse grd, prolongaton then takes place n order to get back to the orgnal grd sze. Vsal eplanaton: Referrng to Fgre.5, the top pctre represents some arbtrary error n a fne grd. The bottom pctre represents the correspondng coarse grd after nterpolaton. Notce that 5

16 there are now only half as many ponts n the coarse grd, so the error s now n a hgher freqency, whch can be dealt wth by tlzng the smoothng process. Varos Mltgrd Schemes: There est mltple schemes n whch Mltgrd can be mplemented. These combnatons nole aratons n the nmber of restrcton and prolongaton phases desred and the pattern they take on. What ths means s that yo can choose f yo wanted to restrct, restrct agan, restrct agan, and once yo are at the desred coarse grd, yo prolongate, prolongate agan, prolongate agan ntl yo get back to the orgnal grd sze. There are also other patterns of restrcton and prolongaton. Yo can choose to restrct once and prolongate once, then restrct twce and prolongate twce, (note: Remember that followng each restrcton, smoothng takes place n order to get rd of the hgh freqency error) There are three man types of Mltgrd cycles: V-cycle, W-cycle, and Fll Mltgrd scheme. Whle the nmber of leels s an nddal s preference, the essental patterns le as follows: V-cycle: Fg..8 6

17 W-cycle: Fg.9 FMG-cycle: Fg..0 Now that we e dscssed all the elements of Mltgrd, let s look at some problems. 7

18 3 Problem Upon nderstandng how Mltgrd works, I stded the followng problem: One-dmensonal Posson s eqaton wth Drchlet bondary condtons = f n Ω =(0,n); ( 0) = ( n) = 0 I took on ths problem n two dfferent fashons:. A drect approach eamnng conergence drectly (programmng the algorthm nto Matlab). An analytcal approach eamnng conergence by proof. Approach : Usng Matlab, I programmed a -leel V-cycle sng the fnte dfferences dscretzaton scheme. My ntal gess was a ector of length n made p only of zeros and eact solton s defned as follows (both ntal gess and eact soltons were chosen randoml: ( ) = ( ) π sn( ) n + where =,,n Snce, = f (the problem we are solng), the ale of f sed n the problem can be compted by takng the nd derate of wth respect to. I sed n=300, meanng the problem had 300 steps where each step was of sze. The smoother sed was defned as: B = 4I I dd 4 dfferent eperments. In the frst, I sed one smoothng step per cycle, n the second eperment, I sed two smoothng steps per cycle, n the thrd, three smoothng steps per cycle, and n the forth, for smoothng steps per cycle. I dd 5 cycles for each eperment. The chart on the followng page shows the reslts I receed. Snce I cannot wrte ot the resltng appromate solton for each step of each eperment, I took the -norm of the resltng ector of each cycle. The -norm s a sngle nmber representaton of the oerall error. Net to the error s the conergence rate ( the speed at whch a conergent seqence approaches ts lmt, n ths case, the lmt of the error shold always be 0) of each step. [6] 8

19 Cycle -norm of the error Conergence factor (a) Cycle -norm of the error Conergence factor (b) Cycle -norm of the error Conergence factor (c) Cycle -norm of the error Conergence factor (d) a smoothng step b smoothng steps c 3 smoothng steps d 4 smoothng steps One nterestng obseraton s that for (a), the conergence rate was roghly arond a factor of 0.5. (b) had a conergence rate roghly arond 0.5. (c) had a conergence rate roghly arond 0.5. (d) had a conergence rate roghly arond Approach takes on a more analytcal approach to ths problem and wll proe that those ales are n fact the conergence rates for the correspondng nmber of smoothng steps. 9

20 Approach : Followng the reslts from Approach, I took a more analytcal approach n determnng the conergence of the same problem: One-dmensonal Posson s eqaton wth Drchlet bondary condtons = f n Ω =(0,n); ( 0) = ( n) = 0 (3.) The reason ths problem s sgnfcant s that t can be completely analyzed, meanng that t s able to completely represent how Mltgrd works (barrng comptatonal error). After dscretzaton, let In words, N = ( N + ) for some N and set h ( N + ). N refers to the sze of the dscretzed problem whereas = h represents the correspondng stepsze. We also se an arbtrary and N n order to show that ths problem can be completely analyzed meanng that the reslts that we obtan represent the solton for all (3.) regardless of sze, ntal gess, and tre solton. Net, we get that the matr A n (.) can be represented as: A = h [,, ] and the smoother beng sed s the damped Jacob scheme B = h 4 I We fnd that the egenales and egenectors of A are λ = h ( cos( πh )) and ( ψ ) = (h ) / sn( kπh ) respectely. k Wth respect to the egenector bass, we look for the transformed matrces  (transformed matr representng the dscretzaton), Bˆ (transformed smoothng matr), Rˆ (restrcton matr), Ŝ (error propagaton matr for the smoothng process), and Ĉ (proector for the coarse grd correcton). Here are the followng reslts:  = 4h 0 0 0

21 ˆ = 4h B 0 0 ( ) Rˆ = Sˆ = 0 0 Cˆ = ( ( )) / ( ( )) / S ˆ m / Cˆ Sˆ m / ( )) ( ( )) = m+ / m ( ( )) m ( ) m+ / where = cos( πh )) / ( / / After comptng ˆ m ˆ ˆ m S CS (the matr representng the oerall error of a -leel scheme), we eamne ts spectral rads ˆ m / ( ˆ ˆ m / ρ S CS ) to get an dea of ts conergence rate. m represents the nmber of desred smoothng steps. Nmber of smoothng steps ˆ m / ( ˆ ˆ m / ρ S CS ) ½ ¼ 3 /8 4 /6 4 Algebrac Mltgrd (AMG) 4. Introdcton to AMG One problem that consstently arses from geometrc Mltgrd (the type eplaned n secton ) s that t has certan restrctons when solng ellptc PDEs. The key problem to the geometrc case s that n order to mplement Mltgrd, the grd needs to be known. The qeston then arses, what f the grd s relately nknown? Algebrac Mltgrd (AMG) takes on the same essental concepts as the geometrc case descrbed aboe n regards to the need for ntalzaton, smoothng, prolongaton, and restrcton. The key

22 dfference comes wth knowledge of the grd. In the case of AMG, the grd s relately nknown. Instead of hang a set grd, the data ponts come n a random model as wll be shown later. The relatonshps among the nknowns are smlar to that of the geometrc case, bt the locatons are nknown. Becase of ths araton, there are essentally key components to AMG:. defnng the MG components (what s the restrcton matr, prolongaton matr, ). performng MG cycles (dong the actal Mltgrd) Let s pretend we want to sole an ellptc PDE wth the doman represented n fg. (4.). Notce that the grd s bascally random, bt the relatonshps between ponts are known. Fg. 4.

23 The frst thng we need to do s translate ths grd nto a matr format that can be soled. Fgre 4. defnes the correspondng matr. The way to obtan the matr s to mark the ales tochng the pont n qeston. So for fgre 4., pont s tochng ponts and 0, so on lne (representng pont ) of the matr, ales at,, and 0 are marked. Pont s tochng, 3, and 0, so lne (whch representng pont ) of the matr, ales at,, 3, and 0 are marked. Contne workng on ths process ntl all ponts hae been marked. Correspondng matr: A= Fg. 4. (Note: when dong the real problem, each represents some nmber; are only sed for smplcty of eplanng AMG) There s lttle theory n the feld of Algebrac Mltgrd de to the complety of the grd. The key to Mltgrd as was descrbed n secton, s smoothng, determnng the coarse ponts/coarse grds, determnng how to get to the coarse grds, and then how to get back to the orgnal grd. Intal fne grds, sch as the ones n fgre (.5) & (.6) hae coarse grds that can easly be determned, bt snce the key to AMG s that the grd s relately free n desgn, there s no set way of fndng a proper coarse grd. Determnng the coarse-grd ponts s qte open-ended. One method of determnng the coarse-grd ponts tlzes a concept called strong connectons. A second method s called Mamal Independent Set. There are other methods, all based on the sers preference, bt only these two wll be dscssed. 3

24 Method : Strong Connectons Note: I dd not stdy ths method (I only sed method ). The prpose of pttng ths n s to show that there are mltple methods n determnng the coarse grd bt nether can be proed to be more adantageos than the other (renforcng the reasonng as to why there s lttle theory behnd AMG) A strong connecton s defned as: S = { : a > θ ma a} where 0 < θ When basng the coarse-grd correcton on these strong connectons, there are man crtera:. For each F, each pont S shold ether be n C or shold be strongly connected to at least one pont n C.. C shold be a mamal sbset wth the property that no two C -ponts are strongly connected to each other. C refers to the coarse-grd arables, F refers to the fne-grd arables, and C refers to the set of nterpolatory coarse-grd arables sed to nterpolate fne-grd ales. In ths case, sometmes both enforcng both crtera s mpossble so crtera # s more mportant than crtera #. Method : Mamal Independent Set Mamal Independent Set reqres the satsfacton of the followng crtera:. No two coarse ponts are adacent to each other. The set of coarse ponts are adacent to all ponts n the gen doman. We now se Method (Mamal Independent Set) to determne the coarse ponts on fgre (4.). 4

25 Eample: Usng Mamal Independent Set on fgre (4.) Fg. 4.3 Once coarse-grd ponts are determned the matr A s re-ordered wth permtaton matrces so that all coarse grd ponts are blocked together as shown: the restrcton matr and prolongaton matr are now: A ff A t fc P ˆ AP ˆ = (4.) Acf Acc I 0 ω I, t I ω 0 I respectely. ω acts mch lke ω n (.8). A reqrement s for ω and fc A to hae the same sparsty pattern (note: sparsty means a matr poplated prmarly wth zeros, sch as a dagonal matr, trdagonal matr, ). [6] 5

26 4. Implementng AMG Followng the determnaton of all the reqred components, AMG s essentally the same as the geometrc case of Mltgrd. The smoothng process takes on the same form as the geometrc Mltgrd. Bt, n ths case, A s the permtated matr defned n (4.). r k = b A k = k k + δ k Bδ = r (4.3) k k Agan, B s some knd of factorzaton of A. Snce A s generally sparse, the se of the ncomplete LU factorzaton s poplar. Bt other technqes may sed sch as symmetrc Gass-Sedel. Followng the smoothng step, AMG takes on the same concepts as the geometrc case of Mltgrd, bt nstead t s sng the AMG components dscssed n secton 4.. For most problems nolng AMG, the determnaton of all the components necessary n Mltgrd s what generally takes the most amont of work. Ths s largely n part becase there s no set formla/theory for determnng the coarse grd and the correspondng nterpolatng matrces. 4.3 Epermentaton Prof. Randolph Bank deeloped Mltgraph [], whch comptes the soltons for ellptc PDEs sng AMG. Mltgraph tlzes the Mamal Independent Set for determnng coarse grd ponts. At ths pont, I am crrently sng Mltgraph to stdy aros PDEs wth the goal of tryng to nderstand trends, rates of conergence, accracy, sng AMG combned wth a nmber of aros optons (choosng the factorzaton for the smoother B n (4.3), choosng the dscretzaton method, ) The followng are some eamples of the se of AMG on aros problems, wth bref commentary: 6

27 Fgre 4.4 Fgre 4.5 Fgre 4.4 and 4.5 represent the reslts of the problem:. 00 = wth a doman that looks lke the shape of Teas (bondary condtons). On the left sde, Fgre 4.4 shows the matr solton pror to beng redstrbted to the orgnal Teas grd (the doman of Teas as opposed to the matr solton s analogos to the relatonshp between fg. 4. & 4.). The top rght shows the aros nmercal ales (a legend) for the matr and the bottom rght shows the top-down ew of the matr on the left. Fgre 4.5 s what has more sgnfcance. The left hand fgre represents the norm of the error (the ales on the left of the graph are based on the logarthmc scale). Each teraton s represented by the nddal pont, so n ths case, the problem reqred 3 teratons. The top rght chart represents the sparsty of the restrcton/prolongaton matrces (yellow), the crrent grd (cyan), and ther rato (prple). Ths mplctly represents the nmber of leels beng sed; snce there are 5 sectons, ths means that 5 yy 7

28 leels were sed. (Note: becase there are 5 leels, only 4 restrcton/prolongaton matrces were reqred so notce that the ery left hand sde bar only has the sparsty of the crrent grd.) The bottom rght pe chart represents the amont of tme reqred to assemble all the necessary components (red) and the amont of tme actally needed to compte the solton (ble). Whle ths pe chart s dependent on the compter processor that s beng sed, t s sgnfcant when beng compared to other problems soled on the same compter. Ths problem was soled sng an ncomplete LU-factorzaton for B (the smoother) and sed a 7-pont star dscretzaton scheme (ths s a araton of the fnte dfferences scheme). Fgre 4.6 Fgre 4.7 Fgre 4.6 & 4.7 took on the same problem as 4.4 & 4.5 bt ths tme t was soled n a dfferent manner. The factorzaton for B was the symmetrc Gass-Sedel scheme and the dscretzaton scheme was an absolte ale appled onto the 5-pont star method (another araton of the fnte dfferences scheme). Notce that ths tme, 5 teratons were reqred for conergence bt more teratons were necessary largely n part becase only 3 leels were sed (as opposed to the 5 leels sed 8

29 n the preos eperment). Also notce that n Fgre 4.6, the solton appears to be mch less comple than the solton n Fgre 4.4. Whle they are essentally the same soltons, there are sbtle dfferences (that are magnfed de to the aros colors sed). At ths pont, ths s what I hae been stdyng; I hae been tryng to get acqanted wth all the aratons that can be sed n AMG and n the process, tryng to fgre ot what prodces the optmal solton. 9

30 Acknowledgements Many thanks to Professor Bank for takng the tme to adse me n ths year long proect. The knowledge and eperence that he has gen me wll not only last a lfetme bt has also properly prepared me for the ftre. I trly apprecate the kndness he has demonstrated to me n agreeng to work on ths proect. References [] Mltgraph.0, R.E. Bank, Department of Mathematcs, UC San Dego. [] Wllam Brggs, Van Emden Henson, and Stee McCormck, A Mltgrd Ttoral, SIAM, 3600 Unersty Cty Scence Center, Phladelpha, PA [3] R.E. Bank and R.K. Smth, An algebrac mltleel mltgraph algorthm, SIAM J. On Scentfc Comptng. [4] R.E. Bank and R.K. Smth, Mltgraph algorthms based on sparse gassan elmnaton, n Thrteenth Internatonal Symposm on Doman Decomposton Methods for Partal Dfferental Eqatons, Doman Decomposton Press, Bergen. [5] R.E. Bank and C.G. Doglas, Sharp estmates for mltgrd rates of conergence wth general smoothng and acceleraton, SIAM J., Nmercal Analyss, pg , 985. [6] Internet resorce terate method, dscretzaton, partal dfferental eqatons, rate of conergence, sparse. 30

Numerical Solution of Deformation Equations. in Homotopy Analysis Method

Numerical Solution of Deformation Equations. in Homotopy Analysis Method Appled Mathematcal Scences, Vol. 6, 2012, no. 8, 357 367 Nmercal Solton of Deformaton Eqatons n Homotopy Analyss Method J. Izadan and M. MohammadzadeAttar Department of Mathematcs, Faclty of Scences, Mashhad

More information

An Improved Isogeometric Analysis Using the Lagrange Multiplier Method

An Improved Isogeometric Analysis Using the Lagrange Multiplier Method An Improved Isogeometrc Analyss Usng the Lagrange Mltpler Method N. Valzadeh 1, S. Sh. Ghorash 2, S. Mohammad 3, S. Shojaee 1, H. Ghasemzadeh 2 1 Department of Cvl Engneerng, Unversty of Kerman, Kerman,

More information

Modeling Local Uncertainty accounting for Uncertainty in the Data

Modeling Local Uncertainty accounting for Uncertainty in the Data Modelng Local Uncertanty accontng for Uncertanty n the Data Olena Babak and Clayton V Detsch Consder the problem of estmaton at an nsampled locaton sng srrondng samples The standard approach to ths problem

More information

Μέθοδος Πολυπλέγματoς (Multigrid)

Μέθοδος Πολυπλέγματoς (Multigrid) NATIONAL TECNICAL UNIVERSITY OF ATENS Parallel CFD & Optmzaton Unt Laboratory of Termal Trbomacnes Μέθοδος Πολυπλέγματoς (Mltgrd) Κυριάκος Χ. Γιαννάκογλου, Καθηγητής ΕΜΠ Βαρβάρα Ασούτη, Δρ. Μηχ. Μηχανικός

More information

Complex Numbers. Now we also saw that if a and b were both positive then ab = a b. For a second let s forget that restriction and do the following.

Complex Numbers. Now we also saw that if a and b were both positive then ab = a b. For a second let s forget that restriction and do the following. Complex Numbers The last topc n ths secton s not really related to most of what we ve done n ths chapter, although t s somewhat related to the radcals secton as we wll see. We also won t need the materal

More information

A General Algorithm for Computing Distance Transforms in Linear Time

A General Algorithm for Computing Distance Transforms in Linear Time Ths chapter has been pblshed as: A. Mejster, J. B. T. M. Roerdnk and W. H. Hesselnk, A general algorthm for comptng dstance transforms n lnear tme. In: Mathematcal Morphology and ts Applcatons to Image

More information

Mathematics 256 a course in differential equations for engineering students

Mathematics 256 a course in differential equations for engineering students Mathematcs 56 a course n dfferental equatons for engneerng students Chapter 5. More effcent methods of numercal soluton Euler s method s qute neffcent. Because the error s essentally proportonal to the

More information

For instance, ; the five basic number-sets are increasingly more n A B & B A A = B (1)

For instance, ; the five basic number-sets are increasingly more n A B & B A A = B (1) Secton 1.2 Subsets and the Boolean operatons on sets If every element of the set A s an element of the set B, we say that A s a subset of B, or that A s contaned n B, or that B contans A, and we wrte A

More information

Circuit Analysis I (ENGR 2405) Chapter 3 Method of Analysis Nodal(KCL) and Mesh(KVL)

Circuit Analysis I (ENGR 2405) Chapter 3 Method of Analysis Nodal(KCL) and Mesh(KVL) Crcut Analyss I (ENG 405) Chapter Method of Analyss Nodal(KCL) and Mesh(KVL) Nodal Analyss If nstead of focusng on the oltages of the crcut elements, one looks at the oltages at the nodes of the crcut,

More information

OBJECT TRACKING BY ADAPTIVE MEAN SHIFT WITH KERNEL BASED CENTROID METHOD

OBJECT TRACKING BY ADAPTIVE MEAN SHIFT WITH KERNEL BASED CENTROID METHOD ISSN : 0973-739 Vol. 3, No., Janary-Jne 202, pp. 39-42 OBJECT TRACKING BY ADAPTIVE MEAN SHIFT WITH KERNEL BASED CENTROID METHOD Rahl Mshra, Mahesh K. Chohan 2, and Dhraj Ntnawwre 3,2,3 Department of Electroncs,

More information

Assignment # 2. Farrukh Jabeen Algorithms 510 Assignment #2 Due Date: June 15, 2009.

Assignment # 2. Farrukh Jabeen Algorithms 510 Assignment #2 Due Date: June 15, 2009. Farrukh Jabeen Algorthms 51 Assgnment #2 Due Date: June 15, 29. Assgnment # 2 Chapter 3 Dscrete Fourer Transforms Implement the FFT for the DFT. Descrbed n sectons 3.1 and 3.2. Delverables: 1. Concse descrpton

More information

Very simple computational domains can be discretized using boundary-fitted structured meshes (also called grids)

Very simple computational domains can be discretized using boundary-fitted structured meshes (also called grids) Structured meshes Very smple computatonal domans can be dscretzed usng boundary-ftted structured meshes (also called grds) The grd lnes of a Cartesan mesh are parallel to one another Structured meshes

More information

RESISTIVE CIRCUITS MULTI NODE/LOOP CIRCUIT ANALYSIS

RESISTIVE CIRCUITS MULTI NODE/LOOP CIRCUIT ANALYSIS RESSTE CRCUTS MULT NODE/LOOP CRCUT ANALYSS DEFNNG THE REFERENCE NODE S TAL 4 THESTATEMENT 4 S MEANNGLES UNTL THE REFERENCE PONT S DEFNED BY CONENTON THE GROUND SYMBOL SPECFES THE REFERENCE PONT. ALL NODE

More information

Hybrid Method of Biomedical Image Segmentation

Hybrid Method of Biomedical Image Segmentation Hybrd Method of Bomedcal Image Segmentaton Mng Hng Hng Department of Electrcal Engneerng and Compter Scence, Case Western Reserve Unversty, Cleveland, OH, Emal: mxh8@case.ed Abstract In ths paper we present

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION The crrent I NS as a fncton of the bas oltage V throgh a N/S pont contact nterface can be descrbed by the BTK theory [3] n whch the nterfacal barrer s represented by a fncton wth a dmensonless strength

More information

Machine Learning: Algorithms and Applications

Machine Learning: Algorithms and Applications 14/05/1 Machne Learnng: Algorthms and Applcatons Florano Zn Free Unversty of Bozen-Bolzano Faculty of Computer Scence Academc Year 011-01 Lecture 10: 14 May 01 Unsupervsed Learnng cont Sldes courtesy of

More information

AMath 483/583 Lecture 21 May 13, Notes: Notes: Jacobi iteration. Notes: Jacobi with OpenMP coarse grain

AMath 483/583 Lecture 21 May 13, Notes: Notes: Jacobi iteration. Notes: Jacobi with OpenMP coarse grain AMath 483/583 Lecture 21 May 13, 2011 Today: OpenMP and MPI versons of Jacob teraton Gauss-Sedel and SOR teratve methods Next week: More MPI Debuggng and totalvew GPU computng Read: Class notes and references

More information

GSA Training Notes Raft and Piled-raft Analysis

GSA Training Notes Raft and Piled-raft Analysis GSA Tranng Notes Rat and Pled-rat Analyss 1 Introdcton Rat analyss n GSA provdes a means o lnkng GSA statc analyss and sol settlement analyss, so the sol-strctre nteractons can be consdered n the analyss.

More information

Problem Set 3 Solutions

Problem Set 3 Solutions Introducton to Algorthms October 4, 2002 Massachusetts Insttute of Technology 6046J/18410J Professors Erk Demane and Shaf Goldwasser Handout 14 Problem Set 3 Solutons (Exercses were not to be turned n,

More information

CSCI 104 Sorting Algorithms. Mark Redekopp David Kempe

CSCI 104 Sorting Algorithms. Mark Redekopp David Kempe CSCI 104 Sortng Algorthms Mark Redekopp Davd Kempe Algorthm Effcency SORTING 2 Sortng If we have an unordered lst, sequental search becomes our only choce If we wll perform a lot of searches t may be benefcal

More information

A Linear Time Algorithm for Finding a Maximal Planar Subgraph Based on PC -Trees Abstract 1. Introduction

A Linear Time Algorithm for Finding a Maximal Planar Subgraph Based on PC -Trees Abstract 1. Introduction A Lnear Tme Algorthm for Fndng a Mamal Planar Sbgraph Based on PC-Trees Wen-Lan Hs Insttte of Informaton Scence, Academa Snca, Tape, Tawan, ROC hs@s.snca.ed.tw Abstract In Shh & Hs, a planart test was

More information

CMPS 10 Introduction to Computer Science Lecture Notes

CMPS 10 Introduction to Computer Science Lecture Notes CPS 0 Introducton to Computer Scence Lecture Notes Chapter : Algorthm Desgn How should we present algorthms? Natural languages lke Englsh, Spansh, or French whch are rch n nterpretaton and meanng are not

More information

Chapter 6 Programmng the fnte element method Inow turn to the man subject of ths book: The mplementaton of the fnte element algorthm n computer programs. In order to make my dscusson as straghtforward

More information

Type-2 Fuzzy Non-uniform Rational B-spline Model with Type-2 Fuzzy Data

Type-2 Fuzzy Non-uniform Rational B-spline Model with Type-2 Fuzzy Data Malaysan Journal of Mathematcal Scences 11(S) Aprl : 35 46 (2017) Specal Issue: The 2nd Internatonal Conference and Workshop on Mathematcal Analyss (ICWOMA 2016) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES

More information

R s s f. m y s. SPH3UW Unit 7.3 Spherical Concave Mirrors Page 1 of 12. Notes

R s s f. m y s. SPH3UW Unit 7.3 Spherical Concave Mirrors Page 1 of 12. Notes SPH3UW Unt 7.3 Sphercal Concave Mrrors Page 1 of 1 Notes Physcs Tool box Concave Mrror If the reflectng surface takes place on the nner surface of the sphercal shape so that the centre of the mrror bulges

More information

A large-alphabet oriented scheme for Chinese and English text compression

A large-alphabet oriented scheme for Chinese and English text compression A large-alphabet orented scheme for Chnese and Englsh text compresson Hng-Yan G * Department of Compter Scence and Informaton Engneerng atonal Tawan Unersty of Scence and Technology Tape Tawan SUMMARY

More information

Report #1 Example. Semester

Report #1 Example. Semester Report # Eample Parallel FEM Class n Wnter Semester Kengo aajma Informaton Technology Center Techncal & Scentfc Comptng I (480-07) Semnar on Compter Scence I (480-04) Report-0 D Statc Lnear Elastc Problem

More information

Compiler Design. Spring Register Allocation. Sample Exercises and Solutions. Prof. Pedro C. Diniz

Compiler Design. Spring Register Allocation. Sample Exercises and Solutions. Prof. Pedro C. Diniz Compler Desgn Sprng 2014 Regster Allocaton Sample Exercses and Solutons Prof. Pedro C. Dnz USC / Informaton Scences Insttute 4676 Admralty Way, Sute 1001 Marna del Rey, Calforna 90292 pedro@s.edu Regster

More information

Intra-Parametric Analysis of a Fuzzy MOLP

Intra-Parametric Analysis of a Fuzzy MOLP Intra-Parametrc Analyss of a Fuzzy MOLP a MIAO-LING WANG a Department of Industral Engneerng and Management a Mnghsn Insttute of Technology and Hsnchu Tawan, ROC b HSIAO-FAN WANG b Insttute of Industral

More information

K-means and Hierarchical Clustering

K-means and Hierarchical Clustering Note to other teachers and users of these sldes. Andrew would be delghted f you found ths source materal useful n gvng your own lectures. Feel free to use these sldes verbatm, or to modfy them to ft your

More information

Solving Route Planning Using Euler Path Transform

Solving Route Planning Using Euler Path Transform Solvng Route Plannng Usng Euler Path ransform Y-Chong Zeng Insttute of Informaton Scence Academa Snca awan ychongzeng@s.snca.edu.tw Abstract hs paper presents a method to solve route plannng problem n

More information

Obstacle Avoidance by Using Modified Hopfield Neural Network

Obstacle Avoidance by Using Modified Hopfield Neural Network bstacle Avodance by Usng Modfed Hopfeld Neral Network Panrasee Rtthpravat Center of peraton for Feld Robotcs Development (FIB), Kng Mongkt s Unversty of Technology Thonbr. 91 Sksawas road Tongkr Bangkok

More information

Structure from Motion

Structure from Motion Structure from Moton Structure from Moton For now, statc scene and movng camera Equvalentl, rgdl movng scene and statc camera Lmtng case of stereo wth man cameras Lmtng case of multvew camera calbraton

More information

SLAM Summer School 2006 Practical 2: SLAM using Monocular Vision

SLAM Summer School 2006 Practical 2: SLAM using Monocular Vision SLAM Summer School 2006 Practcal 2: SLAM usng Monocular Vson Javer Cvera, Unversty of Zaragoza Andrew J. Davson, Imperal College London J.M.M Montel, Unversty of Zaragoza. josemar@unzar.es, jcvera@unzar.es,

More information

A fast algorithm for color image segmentation

A fast algorithm for color image segmentation Unersty of Wollongong Research Onlne Faculty of Informatcs - Papers (Arche) Faculty of Engneerng and Informaton Scences 006 A fast algorthm for color mage segmentaton L. Dong Unersty of Wollongong, lju@uow.edu.au

More information

Ordinary Differential Equations and Partial Differential Equations: Solutions and Parallelism

Ordinary Differential Equations and Partial Differential Equations: Solutions and Parallelism Ordnary Dfferental Eqatons and Partal Dfferental Eqatons: Soltons and Parallelsm UCSB CS4A Tao Yang Some sldes are from K. Yalck/Demmel Fnte-Dfference Method for ODE/PDE Dscretze doman of a fncton For

More information

Lecture 08 Multiple View Geometry 2

Lecture 08 Multiple View Geometry 2 Insttte of Informatcs Insttte of Neronformatcs Lectre 8 Mltple Vew Geometry Dade Scaramzza http://rpg.f.zh.ch/ Lab Exercse 6 - Today afternoon Room ETH HG E. from 3:5 to 5: Work descrpton: 8-pont algorthm

More information

Backpropagation: In Search of Performance Parameters

Backpropagation: In Search of Performance Parameters Bacpropagaton: In Search of Performance Parameters ANIL KUMAR ENUMULAPALLY, LINGGUO BU, and KHOSROW KAIKHAH, Ph.D. Computer Scence Department Texas State Unversty-San Marcos San Marcos, TX-78666 USA ae049@txstate.edu,

More information

An Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices

An Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices Internatonal Mathematcal Forum, Vol 7, 2012, no 52, 2549-2554 An Applcaton of the Dulmage-Mendelsohn Decomposton to Sparse Null Space Bases of Full Row Rank Matrces Mostafa Khorramzadeh Department of Mathematcal

More information

Recognizing Periodicities on 3D Scanned Meshes Based on Indexed-ICP Algorithm

Recognizing Periodicities on 3D Scanned Meshes Based on Indexed-ICP Algorithm Orgnal Artcle Proceedngs of IDMME - Vrtal Concept 8 Beng Chna October 8 8 Recognzng Perodctes on 3D Scanned Meshes Based on Indeed-ICP Algorthm Dase Kondo Tomohro Mzogch Satosh Kana Gradate School of Informaton

More information

2x x l. Module 3: Element Properties Lecture 4: Lagrange and Serendipity Elements

2x x l. Module 3: Element Properties Lecture 4: Lagrange and Serendipity Elements Module 3: Element Propertes Lecture : Lagrange and Serendpty Elements 5 In last lecture note, the nterpolaton functons are derved on the bass of assumed polynomal from Pascal s trangle for the fled varable.

More information

Lossless Compression of Map Contours by Context Tree Modeling of Chain Codes

Lossless Compression of Map Contours by Context Tree Modeling of Chain Codes Lossless Compresson of Map Contours by Context Tree Modelng of Chan Codes Alexander Akmo, Alexander Kolesnko, and Pas Fränt Department of Computer Scence, Unersty of Joensuu, P.O. Box 111, 80110 Joensuu,

More information

High level vs Low Level. What is a Computer Program? What does gcc do for you? Program = Instructions + Data. Basic Computer Organization

High level vs Low Level. What is a Computer Program? What does gcc do for you? Program = Instructions + Data. Basic Computer Organization What s a Computer Program? Descrpton of algorthms and data structures to acheve a specfc ojectve Could e done n any language, even a natural language lke Englsh Programmng language: A Standard notaton

More information

User Authentication Based On Behavioral Mouse Dynamics Biometrics

User Authentication Based On Behavioral Mouse Dynamics Biometrics User Authentcaton Based On Behavoral Mouse Dynamcs Bometrcs Chee-Hyung Yoon Danel Donghyun Km Department of Computer Scence Department of Computer Scence Stanford Unversty Stanford Unversty Stanford, CA

More information

Virtual Memory. Background. No. 10. Virtual Memory: concept. Logical Memory Space (review) Demand Paging(1) Virtual Memory

Virtual Memory. Background. No. 10. Virtual Memory: concept. Logical Memory Space (review) Demand Paging(1) Virtual Memory Background EECS. Operatng System Fundamentals No. Vrtual Memory Prof. Hu Jang Department of Electrcal Engneerng and Computer Scence, York Unversty Memory-management methods normally requres the entre process

More information

6.854 Advanced Algorithms Petar Maymounkov Problem Set 11 (November 23, 2005) With: Benjamin Rossman, Oren Weimann, and Pouya Kheradpour

6.854 Advanced Algorithms Petar Maymounkov Problem Set 11 (November 23, 2005) With: Benjamin Rossman, Oren Weimann, and Pouya Kheradpour 6.854 Advanced Algorthms Petar Maymounkov Problem Set 11 (November 23, 2005) Wth: Benjamn Rossman, Oren Wemann, and Pouya Kheradpour Problem 1. We reduce vertex cover to MAX-SAT wth weghts, such that the

More information

Brave New World Pseudocode Reference

Brave New World Pseudocode Reference Brave New World Pseudocode Reference Pseudocode s a way to descrbe how to accomplsh tasks usng basc steps lke those a computer mght perform. In ths week s lab, you'll see how a form of pseudocode can be

More information

ON SOME ENTERTAINING APPLICATIONS OF THE CONCEPT OF SET IN COMPUTER SCIENCE COURSE

ON SOME ENTERTAINING APPLICATIONS OF THE CONCEPT OF SET IN COMPUTER SCIENCE COURSE Yordzhev K., Kostadnova H. Інформаційні технології в освіті ON SOME ENTERTAINING APPLICATIONS OF THE CONCEPT OF SET IN COMPUTER SCIENCE COURSE Yordzhev K., Kostadnova H. Some aspects of programmng educaton

More information

Scheduling with Integer Time Budgeting for Low-Power Optimization

Scheduling with Integer Time Budgeting for Low-Power Optimization Schedlng wth Integer Tme Bdgetng for Low-Power Optmzaton We Jang, Zhr Zhang, Modrag Potkonjak and Jason Cong Compter Scence Department Unversty of Calforna, Los Angeles Spported by NSF, SRC. Otlne Introdcton

More information

On Some Entertaining Applications of the Concept of Set in Computer Science Course

On Some Entertaining Applications of the Concept of Set in Computer Science Course On Some Entertanng Applcatons of the Concept of Set n Computer Scence Course Krasmr Yordzhev *, Hrstna Kostadnova ** * Assocate Professor Krasmr Yordzhev, Ph.D., Faculty of Mathematcs and Natural Scences,

More information

Lecture #15 Lecture Notes

Lecture #15 Lecture Notes Lecture #15 Lecture Notes The ocean water column s very much a 3-D spatal entt and we need to represent that structure n an economcal way to deal wth t n calculatons. We wll dscuss one way to do so, emprcal

More information

Intro. Iterators. 1. Access

Intro. Iterators. 1. Access Intro Ths mornng I d lke to talk a lttle bt about s and s. We wll start out wth smlartes and dfferences, then we wll see how to draw them n envronment dagrams, and we wll fnsh wth some examples. Happy

More information

Storage Binding in RTL synthesis

Storage Binding in RTL synthesis Storage Bndng n RTL synthess Pe Zhang Danel D. Gajsk Techncal Report ICS-0-37 August 0th, 200 Center for Embedded Computer Systems Department of Informaton and Computer Scence Unersty of Calforna, Irne

More information

Feature Reduction and Selection

Feature Reduction and Selection Feature Reducton and Selecton Dr. Shuang LIANG School of Software Engneerng TongJ Unversty Fall, 2012 Today s Topcs Introducton Problems of Dmensonalty Feature Reducton Statstc methods Prncpal Components

More information

Parallelism for Nested Loops with Non-uniform and Flow Dependences

Parallelism for Nested Loops with Non-uniform and Flow Dependences Parallelsm for Nested Loops wth Non-unform and Flow Dependences Sam-Jn Jeong Dept. of Informaton & Communcaton Engneerng, Cheonan Unversty, 5, Anseo-dong, Cheonan, Chungnam, 330-80, Korea. seong@cheonan.ac.kr

More information

3D vector computer graphics

3D vector computer graphics 3D vector computer graphcs Paolo Varagnolo: freelance engneer Padova Aprl 2016 Prvate Practce ----------------------------------- 1. Introducton Vector 3D model representaton n computer graphcs requres

More information

Support Vector Machines

Support Vector Machines /9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.

More information

BFF1303: ELECTRICAL / ELECTRONICS ENGINEERING. Direct Current Circuits : Methods of Analysis

BFF1303: ELECTRICAL / ELECTRONICS ENGINEERING. Direct Current Circuits : Methods of Analysis BFF1303: ELECTRICAL / ELECTRONICS ENGINEERING Drect Current Crcuts : Methods of Analyss Ismal Mohd Kharuddn, Zulkfl Md Yusof Faculty of Manufacturng Engneerng Unerst Malaysa Pahang Drect Current Crcut

More information

Harmonic Coordinates for Character Articulation PIXAR

Harmonic Coordinates for Character Articulation PIXAR Harmonc Coordnates for Character Artculaton PIXAR Pushkar Josh Mark Meyer Tony DeRose Bran Green Tom Sanock We have a complex source mesh nsde of a smpler cage mesh We want vertex deformatons appled to

More information

SIMULATING FLOW AROUND A COMPLEX GEOMETRY

SIMULATING FLOW AROUND A COMPLEX GEOMETRY Unerstet an Amsterdam Facltet der Natretenschappen Wsnde en Informatca SIMULATING FLOW AROUND A COMPLEX GEOMETRY Secton Comptatonal Scence Master Thess Spersors: drs. J. G. Blom * and dr. J. A. Kaandorp

More information

Parallel matrix-vector multiplication

Parallel matrix-vector multiplication Appendx A Parallel matrx-vector multplcaton The reduced transton matrx of the three-dmensonal cage model for gel electrophoress, descrbed n secton 3.2, becomes excessvely large for polymer lengths more

More information

Machine Learning. Support Vector Machines. (contains material adapted from talks by Constantin F. Aliferis & Ioannis Tsamardinos, and Martin Law)

Machine Learning. Support Vector Machines. (contains material adapted from talks by Constantin F. Aliferis & Ioannis Tsamardinos, and Martin Law) Machne Learnng Support Vector Machnes (contans materal adapted from talks by Constantn F. Alfers & Ioanns Tsamardnos, and Martn Law) Bryan Pardo, Machne Learnng: EECS 349 Fall 2014 Support Vector Machnes

More information

LECTURE : MANIFOLD LEARNING

LECTURE : MANIFOLD LEARNING LECTURE : MANIFOLD LEARNING Rta Osadchy Some sldes are due to L.Saul, V. C. Raykar, N. Verma Topcs PCA MDS IsoMap LLE EgenMaps Done! Dmensonalty Reducton Data representaton Inputs are real-valued vectors

More information

Lecture 5: Multilayer Perceptrons

Lecture 5: Multilayer Perceptrons Lecture 5: Multlayer Perceptrons Roger Grosse 1 Introducton So far, we ve only talked about lnear models: lnear regresson and lnear bnary classfers. We noted that there are functons that can t be represented

More information

12/2/2009. Announcements. Parametric / Non-parametric. Case-Based Reasoning. Nearest-Neighbor on Images. Nearest-Neighbor Classification

12/2/2009. Announcements. Parametric / Non-parametric. Case-Based Reasoning. Nearest-Neighbor on Images. Nearest-Neighbor Classification Introducton to Artfcal Intellgence V22.0472-001 Fall 2009 Lecture 24: Nearest-Neghbors & Support Vector Machnes Rob Fergus Dept of Computer Scence, Courant Insttute, NYU Sldes from Danel Yeung, John DeNero

More information

NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS

NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS ARPN Journal of Engneerng and Appled Scences 006-017 Asan Research Publshng Network (ARPN). All rghts reserved. NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS Igor Grgoryev, Svetlana

More information

Learning the Kernel Parameters in Kernel Minimum Distance Classifier

Learning the Kernel Parameters in Kernel Minimum Distance Classifier Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department

More information

Cluster Analysis of Electrical Behavior

Cluster Analysis of Electrical Behavior Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School

More information

Sequential search. Building Java Programs Chapter 13. Sequential search. Sequential search

Sequential search. Building Java Programs Chapter 13. Sequential search. Sequential search Sequental search Buldng Java Programs Chapter 13 Searchng and Sortng sequental search: Locates a target value n an array/lst by examnng each element from start to fnsh. How many elements wll t need to

More information

A Binarization Algorithm specialized on Document Images and Photos

A Binarization Algorithm specialized on Document Images and Photos A Bnarzaton Algorthm specalzed on Document mages and Photos Ergna Kavalleratou Dept. of nformaton and Communcaton Systems Engneerng Unversty of the Aegean kavalleratou@aegean.gr Abstract n ths paper, a

More information

Hermite Splines in Lie Groups as Products of Geodesics

Hermite Splines in Lie Groups as Products of Geodesics Hermte Splnes n Le Groups as Products of Geodescs Ethan Eade Updated May 28, 2017 1 Introducton 1.1 Goal Ths document defnes a curve n the Le group G parametrzed by tme and by structural parameters n the

More information

Reducing Frame Rate for Object Tracking

Reducing Frame Rate for Object Tracking Reducng Frame Rate for Object Trackng Pavel Korshunov 1 and We Tsang Oo 2 1 Natonal Unversty of Sngapore, Sngapore 11977, pavelkor@comp.nus.edu.sg 2 Natonal Unversty of Sngapore, Sngapore 11977, oowt@comp.nus.edu.sg

More information

S1 Note. Basis functions.

S1 Note. Basis functions. S1 Note. Bass functons. Contents Types of bass functons...1 The Fourer bass...2 B-splne bass...3 Power and type I error rates wth dfferent numbers of bass functons...4 Table S1. Smulaton results of type

More information

Improving Low Density Parity Check Codes Over the Erasure Channel. The Nelder Mead Downhill Simplex Method. Scott Stransky

Improving Low Density Parity Check Codes Over the Erasure Channel. The Nelder Mead Downhill Simplex Method. Scott Stransky Improvng Low Densty Party Check Codes Over the Erasure Channel The Nelder Mead Downhll Smplex Method Scott Stransky Programmng n conjuncton wth: Bors Cukalovc 18.413 Fnal Project Sprng 2004 Page 1 Abstract

More information

AN INTEGRATED SEMANTICALLY CORRECT 2,5 DIMENSIONAL OBJECT ORIENTED TIN

AN INTEGRATED SEMANTICALLY CORRECT 2,5 DIMENSIONAL OBJECT ORIENTED TIN AN INTEGRATED SEMANTICAY CORRECT 2,5 DIMENSIONA OBJECT ORIENTED TIN A. Koch Insttte of Photogrammetry and GeoInformaton (IPI), Unersty of Hannoer, Germany Nenbrger Straße 1, 30167 Hannoer koch@p.n-hannoer.de

More information

KFUPM. SE301: Numerical Methods Topic 8 Ordinary Differential Equations (ODEs) Lecture (Term 101) Section 04. Read

KFUPM. SE301: Numerical Methods Topic 8 Ordinary Differential Equations (ODEs) Lecture (Term 101) Section 04. Read SE3: Numercal Metods Topc 8 Ordnar Dfferental Equatons ODEs Lecture 8-36 KFUPM Term Secton 4 Read 5.-5.4 6-7- C ISE3_Topc8L Outlne of Topc 8 Lesson : Introducton to ODEs Lesson : Talor seres metods Lesson

More information

Optimal Workload-based Weighted Wavelet Synopses

Optimal Workload-based Weighted Wavelet Synopses Optmal Workload-based Weghted Wavelet Synopses Yoss Matas School of Computer Scence Tel Avv Unversty Tel Avv 69978, Israel matas@tau.ac.l Danel Urel School of Computer Scence Tel Avv Unversty Tel Avv 69978,

More information

Introduction to Geometric

Introduction to Geometric Manel Ventra Shp Desgn I MSc n Marne Engneerng and Naal Archtectre Smmary. Parametrc Cres 2. Parametrc Srfaces 2 Parametrc Cres. Mathematcal Formlatons Cbc Splnes Bézer B-Splne Beta-Splne NURBS 2. Interpolaton

More information

WATERSHED SEGMENTATION WITH BOUNDARY CURVATURE RATIO BASED MERGING CRITERION

WATERSHED SEGMENTATION WITH BOUNDARY CURVATURE RATIO BASED MERGING CRITERION WATERSHED SEGENTATION WITH BOUNDARY CURVATURE RATIO BASED ERGING CRITERION Xaochen He, Nelson H. C. Yng 2, K.P. Chow, Francs Y.L. Chn, Ronald H. Y. Chng 3, K. Y. K. Wong, Kenneth S.H. Tsang 3 The Department

More information

LOOP ANALYSIS. The second systematic technique to determine all currents and voltages in a circuit

LOOP ANALYSIS. The second systematic technique to determine all currents and voltages in a circuit LOOP ANALYSS The second systematic technique to determine all currents and voltages in a circuit T S DUAL TO NODE ANALYSS - T FRST DETERMNES ALL CURRENTS N A CRCUT AND THEN T USES OHM S LAW TO COMPUTE

More information

Math Homotopy Theory Additional notes

Math Homotopy Theory Additional notes Math 527 - Homotopy Theory Addtonal notes Martn Frankland February 4, 2013 The category Top s not Cartesan closed. problem. In these notes, we explan how to remedy that 1 Compactly generated spaces Ths

More information

GSLM Operations Research II Fall 13/14

GSLM Operations Research II Fall 13/14 GSLM 58 Operatons Research II Fall /4 6. Separable Programmng Consder a general NLP mn f(x) s.t. g j (x) b j j =. m. Defnton 6.. The NLP s a separable program f ts objectve functon and all constrants are

More information

Lecture 4: Principal components

Lecture 4: Principal components /3/6 Lecture 4: Prncpal components 3..6 Multvarate lnear regresson MLR s optmal for the estmaton data...but poor for handlng collnear data Covarance matrx s not nvertble (large condton number) Robustness

More information

Graph-based Clustering

Graph-based Clustering Graphbased Clusterng Transform the data nto a graph representaton ertces are the data ponts to be clustered Edges are eghted based on smlarty beteen data ponts Graph parttonng Þ Each connected component

More information

Parallel Numerics. 1 Preconditioning & Iterative Solvers (From 2016)

Parallel Numerics. 1 Preconditioning & Iterative Solvers (From 2016) Technsche Unverstät München WSe 6/7 Insttut für Informatk Prof. Dr. Thomas Huckle Dpl.-Math. Benjamn Uekermann Parallel Numercs Exercse : Prevous Exam Questons Precondtonng & Iteratve Solvers (From 6)

More information

c 2009 Society for Industrial and Applied Mathematics

c 2009 Society for Industrial and Applied Mathematics SIAM J. MATRIX ANAL. APPL. Vol. 31, No. 3, pp. 1382 1411 c 2009 Socety for Industral and Appled Mathematcs SUPERFAST MULTIFRONTAL METHOD FOR LARGE STRUCTURED LINEAR SYSTEMS OF EQUATIONS JIANLIN XIA, SHIVKUMAR

More information

Active Contours/Snakes

Active Contours/Snakes Actve Contours/Snakes Erkut Erdem Acknowledgement: The sldes are adapted from the sldes prepared by K. Grauman of Unversty of Texas at Austn Fttng: Edges vs. boundares Edges useful sgnal to ndcate occludng

More information

Restaurants Review Star Prediction for Yelp Dataset

Restaurants Review Star Prediction for Yelp Dataset Restarants Revew Star Predcton for Yelp Dataset Mengq Y UC San Dego A53077101 mey004@eng.csd.ed Meng Xe UC San Dego A53070417 m6xe@eng.csd.ed Wenja Oyang UC San Dego A11069530 weoyang@eng.csd.ed ABSTRACT

More information

Skew Angle Estimation and Correction of Hand Written, Textual and Large areas of Non-Textual Document Images: A Novel Approach

Skew Angle Estimation and Correction of Hand Written, Textual and Large areas of Non-Textual Document Images: A Novel Approach Angle Estmaton and Correcton of Hand Wrtten, Textual and Large areas of Non-Textual Document Images: A Novel Approach D.R.Ramesh Babu Pyush M Kumat Mahesh D Dhannawat PES Insttute of Technology Research

More information

Interpolation of the Irregular Curve Network of Ship Hull Form Using Subdivision Surfaces

Interpolation of the Irregular Curve Network of Ship Hull Form Using Subdivision Surfaces 7 Interpolaton of the Irregular Curve Network of Shp Hull Form Usng Subdvson Surfaces Kyu-Yeul Lee, Doo-Yeoun Cho and Tae-Wan Km Seoul Natonal Unversty, kylee@snu.ac.kr,whendus@snu.ac.kr,taewan}@snu.ac.kr

More information

Loop Transformations, Dependences, and Parallelization

Loop Transformations, Dependences, and Parallelization Loop Transformatons, Dependences, and Parallelzaton Announcements Mdterm s Frday from 3-4:15 n ths room Today Semester long project Data dependence recap Parallelsm and storage tradeoff Scalar expanson

More information

FEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur

FEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur FEATURE EXTRACTION Dr. K.Vjayarekha Assocate Dean School of Electrcal and Electroncs Engneerng SASTRA Unversty, Thanjavur613 41 Jont Intatve of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents

More information

Review of approximation techniques

Review of approximation techniques CHAPTER 2 Revew of appromaton technques 2. Introducton Optmzaton problems n engneerng desgn are characterzed by the followng assocated features: the objectve functon and constrants are mplct functons evaluated

More information

An Optimal Algorithm for Prufer Codes *

An Optimal Algorithm for Prufer Codes * J. Software Engneerng & Applcatons, 2009, 2: 111-115 do:10.4236/jsea.2009.22016 Publshed Onlne July 2009 (www.scrp.org/journal/jsea) An Optmal Algorthm for Prufer Codes * Xaodong Wang 1, 2, Le Wang 3,

More information

Scientific Computing Tool

Scientific Computing Tool Scentfc Comptng Tool akmar Poondla Department of Mathematcs and Compter Scence Soth Dakota School of Mnes and Technolog Emal: aakmarpoondla@hotmal.com Hanng L Department of Mathematcs and Compter Scence

More information

Organization-Aware Routing in Mission Critical Networks

Organization-Aware Routing in Mission Critical Networks Organzaton-Aware Rotng n Msson Crtcal Networks Yanzh Peter Chen Department of Compter Scence Memoral Unersty of Newfondland St. John s, NL Canada Emal: yzchen@cs.mn.ca Ljn Qan Department of Electrcal and

More information

Structured Grid Generation Via Constraint on Displacement of Internal Nodes

Structured Grid Generation Via Constraint on Displacement of Internal Nodes Internatonal Journal of Basc & Appled Scences IJBAS-IJENS Vol: 11 No: 4 79 Structured Grd Generaton Va Constrant on Dsplacement of Internal Nodes Al Ashrafzadeh, Razeh Jalalabad Abstract Structured grd

More information

News. Recap: While Loop Example. Reading. Recap: Do Loop Example. Recap: For Loop Example

News. Recap: While Loop Example. Reading. Recap: Do Loop Example. Recap: For Loop Example Unversty of Brtsh Columba CPSC, Intro to Computaton Jan-Apr Tamara Munzner News Assgnment correctons to ASCIIArtste.java posted defntely read WebCT bboards Arrays Lecture, Tue Feb based on sldes by Kurt

More information

The Greedy Method. Outline and Reading. Change Money Problem. Greedy Algorithms. Applications of the Greedy Strategy. The Greedy Method Technique

The Greedy Method. Outline and Reading. Change Money Problem. Greedy Algorithms. Applications of the Greedy Strategy. The Greedy Method Technique //00 :0 AM Outlne and Readng The Greedy Method The Greedy Method Technque (secton.) Fractonal Knapsack Problem (secton..) Task Schedulng (secton..) Mnmum Spannng Trees (secton.) Change Money Problem Greedy

More information

A Clustering Algorithm for Chinese Adjectives and Nouns 1

A Clustering Algorithm for Chinese Adjectives and Nouns 1 Clusterng lgorthm for Chnese dectves and ouns Yang Wen, Chunfa Yuan, Changnng Huang 2 State Key aboratory of Intellgent Technology and System Deptartment of Computer Scence & Technology, Tsnghua Unversty,

More information