DQ Analyzer 9. Cheat Sheets. Read the most up-to-date documentation for the latest Ataccama release online at docs.ataccama.com

Transcription

1 DQ Analyzer 9 Cheat Sheets Copyright by Ataccama. All rights reserved. Read the most up-to-date documentation for the latest Ataccama release online at docs.ataccama.com

2 Table of Contents Table of Contents 1 Functions 2 Regular Expressions 3 6 2

3 1 Functions 1 Functions Basic String Functions left(srcstr, count) Returns a new string that is a substring of srcstr containing count of chars taken from the start of the srcstr. right(srcstr, count) Returns a new string that is a substring of srcstr containing count of chars taken from the end of the srcstr. substr(srcstr, beginindex), substr(srcstr, beginindex, strlen) Returns a new string that is a substring of the string srcstr. transliterate(srcstr, charsfrom, charsto) Transforms characters of the string srcstr. containsword(srcstr, srcword) Searches for the occurrence of the word srcword in the string srcstr. indexof(srcstr, substr), indexof(srcstr, substr, fromindex) Returns the index within the string srcstr of the first occurrence of the specified substring substr. lower(srcstr) Transforms all characters of the string srcstr to lower case. upper(srcstr) Transforms all characters of the string srcstr to upper case. capitalize(srcstr) Transforms the first character of each word to upper case and all following characters to lower case. replicate(srcstr, n) Returns n copies of the string srcstr concatenated together without any separator. replace(srcstr, what, withwhat) Replaces occurrences of the string what with the string withwhat in the string srcstr. Regular Expression Functions find(srcregex, srcstr [, Verifies whether the string srcstr or its parts match the regular expression srcregex. 3

4 1 Functions matches(srcregex, srcstr [, Verifies whether the string srcstr matches exactly the pattern of the regular expression srcregex. substituteall(srcpattern, srcreplacement, srcstr [, caseinsensitiveflag]) Replaces all occurrences of srcpatter in string srcstr with srcreplacement. substitutemany(srcpattern, srcreplacement, srcstr, srcvolume [, caseinsensitiveflag]) Replaces all occurrences of srcpattern in the string srcstr with srcreplacement, the maximum number of replacements is defined by the parameter srcvolume. Conversion Functions todate(expr, dateformat[, datelocale]) Returns the date specified in expression expr converted to date type DAY. tostring(expr, strformat[, strlocale]) Converts the expression expr to a STRING value. Datetime Functions datepart(srcdate, fieldname) This function returns the value of the field fieldname (YEAR, MONTH or DAY) of srcdate. datediff(startdate, enddate, fieldname) Returns the difference between enddate and startdate expressed in fieldname units. today() Returns the current date in type DAY. dateadd(srcdate, srcvalue, fieldname) Adds the specified srcvalue of the type specified by fieldname (YEAR, MONTH or DAY) to the srcdate. String Distance Functions hamming(srcstr1, srcstr2 [, Returns the Hamming distance between strings srcstr1 and srcstr2. levenshtein(srcstr1, srcstr2 [, maxdistance][, Returns the Levenshtein distance between strings srcstr1 and srcstr2. 4

5 1 Functions editdistance(srcstr1, srcstr2 [, maxdistance] [, Returns the edit distance between strings srcstr1 and srcstr2. soundex(srcstr) Returns the soundex value of the srcstr parameter. doublemetaphone(srcstr), doublemetaphone(srcstr, isalternate) Encodes str1 to a double metaphone primary string. Encodes srcstr to a double metaphone secondary string if the parameter isalternate is true. Set Distance Functions intersection(set1, set2, separator [, multiset]) Returns the cardinality of the intersection of sets. difference(set1, set2, separator [, multiset] [, singularity]) Returns the cardinality of the difference of sets (set1 set2). symmetricdifference(set1, set2, separator [, multiset ] [, singularity]) Returns the cardinality of the symmetric difference of sets. union(set1, set2, separator [, multiset]) Returns the cardinality of the union of sets. Conditionals iif(ifexpr, trueexpr, elseexpr) Returns trueexpr if ifexpr is TRUE. case(expr, exprvalue[, expr, exprvalue]...[, defaultexpr]) Returns the value of expression exprvalue immediately following the first expression expr whose value is TRUE. decode(decodeexpr, expr, exprvalue[, expr, exprvalue]...[, defaultexpr]) Returns the value of expression exprvalue immediately following the first expression expr whose value is equal to decodeexpr. nvl(expr[, expr]...) Returns the value of the first expression expr whose value is not NULL. 5

6 2 Regular Expressions 2 Regular Expressions Metacharacters Defined Metacharacter Examples MChar Definition Pattern Sample Matches ^ Start of a string. ^abc abc, abcdefg, abc123,... $ End of a string. abc$ abc, endsinabc, 123abc,.... Any character (except \n newline) a.c abc, aac, acc, adc, aec,... Alternation. bill ted ted, bill {...} Explicit quantifier notation. ab{2}c abbc [...] Explicit set of characters to match. a[bb]c abc, abc (...) Logical grouping of part of an expression. (abc) {2} abcabc * 0 or more of previous expressions. ab*c ac, abc, abbc, abbbc, or more of previous expressions. ab+c abc, abbc, abbbc,...? 0 or 1 of previous expressions; also forces minimal matching when an expression might match several strings within a search string. ab?c ac, abc \ Preceding one of the above, it makes it a literal instead of a special character. Preceding a special matching character, see below. a\sc a c 6

7 2 Regular Expressions Character Escapes Escaped Char Description ordinary characters Characters other than. $ ^ { [ ( ) ] } * +? \ match themselves. \t Matches a tab \u0009. \r Matches a carriage return \u000d. \f Matches a form feed \u000c. \n Matches a new line \u000a. \040 Matches an ASCII character as an octal (up to three digits); numbers with no leading zero are backreferences if they have only one digit or if they correspond to a capturing group number. For example, the character \040 represents a space. \x20 Matches an ASCII character using hexadecimal representation (exactly two digits). \u0020 Matches a Unicode character using a hexadecimal representation (exactly four digits). \* When followed by a character that is not recognized as an escaped character, matches that character. For example, \* is the same as \x2a. Character Classes Char Class Description. Matches any character except \n. [aeiou] Matches any single character included in the specified set of characters. [^aeiou] Matches any single character not in the specified set of characters. [0-9a-fA-F] Use of a hyphen ( ) allows specification of contiguous character ranges. \w Matches any word character. \w is equivalent to [a-za-z_0-9]. 7

8 2 Regular Expressions \W Matches any non-word character. \W is equivalent to [^a- za-z_0-9]. \s Matches any white-space character. \s is equivalent to [\f\n\r\t\v]. \S Matches any non-white-space character. \S is equivalent to [^ \f\n\r\t\v]. \d Matches any decimal digit. \D Matches any non-digit. 8