Teradata FastLoad. Reference

Transcription

1 Teradata FastLoad Reference Release B A April 2009

2 The product or products described in this book are licensed products of Teradata Corporation or its affiliates. Teradata, BYNET, DBC/1012, DecisionCast, DecisionFlow, DecisionPoint, Eye logo design, InfoWise, Meta Warehouse, MyCommerce, SeeChain, SeeCommerce, SeeRisk, Teradata Decision Experts, Teradata Source Experts, WebAnalyst, and You ve Never Seen Your Business Like This Before are trademarks or registered trademarks of Teradata Corporation or its affiliates. Adaptec and SCSISelect are trademarks or registered trademarks of Adaptec, Inc. AMD Opteron and Opteron are trademarks of Advanced Micro Devices, Inc. BakBone and NetVault are trademarks or registered trademarks of BakBone Software, Inc. EMC, PowerPath, SRDF, and Symmetrix are registered trademarks of EMC Corporation. GoldenGate is a trademark of GoldenGate Software, Inc. Hewlett-Packard and HP are registered trademarks of Hewlett-Packard Company. Intel, Pentium, and XEON are registered trademarks of Intel Corporation. IBM, CICS, RACF, Tivoli, and z/os are registered trademarks of International Business Machines Corporation. Linux is a registered trademark of Linus Torvalds. LSI and Engenio are registered trademarks of LSI Corporation. Microsoft, Active Directory, Windows, Windows NT, and Windows Server are registered trademarks of Microsoft Corporation in the United States and other countries. Novell and SUSE are registered trademarks of Novell, Inc., in the United States and other countries. QLogic and SANbox are trademarks or registered trademarks of QLogic Corporation. SAS and SAS/C are trademarks or registered trademarks of SAS Institute Inc. SPARC is a registered trademark of SPARC International, Inc. Sun Microsystems, Solaris, Sun, and Sun Java are trademarks or registered trademarks of Sun Microsystems, Inc., in the United States and other countries. Symantec, NetBackup, and VERITAS are trademarks or registered trademarks of Symantec Corporation or its affiliates in the United States and other countries. Unicode is a collective membership mark and a service mark of Unicode, Inc. UNIX is a registered trademark of The Open Group in the United States and other countries. Other product and company names mentioned herein may be the trademarks of their respective owners. THE INFORMATION CONTAINED IN THIS DOCUMENT IS PROVIDED ON AN AS-IS BASIS, WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF IMPLIED WARRANTIES, SO THE ABOVE EXCLUSION MAY NOT APPLY TO YOU. IN NO EVENT WILL TERADATA CORPORATION BE LIABLE FOR ANY INDIRECT, DIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, INCLUDING LOST PROFITS OR LOST SAVINGS, EVEN IF EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. The information contained in this document may contain references or cross-references to features, functions, products, or services that are not announced or available in your country. Such references do not imply that Teradata Corporation intends to announce such features, functions, products, or services in your country. Please consult your local Teradata Corporation representative for those features, functions, products, or services available in your country. Information contained in this document may contain technical inaccuracies or typographical errors. Information may be changed or updated without notice. Teradata Corporation may also make improvements or changes in the products or services described in this information at any time without notice. To maintain the quality of our products and services, we would like your comments on the accuracy, clarity, organization, and value of this document. Please teradata-books@lists.teradata.com Any comments or materials (collectively referred to as Feedback ) sent to Teradata Corporation will be deemed non-confidential. Teradata Corporation will have no obligation of any kind with respect to Feedback and will be free to use, reproduce, disclose, exhibit, display, transform, create derivative works of, and distribute the Feedback and derivative works thereof without limitation on a royalty-free basis. Further, Teradata Corporation will be free to use any ideas, concepts, know-how, or techniques contained in such Feedback for any purpose whatsoever, including developing, manufacturing, or marketing products or services incorporating Feedback. Copyright by Teradata Corporation. All Rights Reserved.

3 Preface Purpose This book provides information about Teradata FastLoad (FastLoad), which is a Teradata Tools and Utilities product. Teradata Tools and Utilities is a group of products designed to work with Teradata Database. Teradata FastLoad is a command-driven utility that quickly loads large amounts of data to empty tables in a Teradata Database. FastLoad uses multiple sessions to load data; however, it loads data into only one table on a Teradata Database per job. Audience This book is intended for use by: System and application programmers System administrators Supported Releases This book supports the following releases: Teradata Database Teradata Tools and Utilities Teradata FastLoad Note: See SHOW VERSIONS on page 149 to verify the Teradata FastLoad version number. For the most current information about supported releases, do the following: 1 Go to 2 Click General Search under Online Publications. 3 Type 3119 in the Publication Product ID box. 4 Under Sort By, select Date. 5 Click Search. 6 Open the version of the Teradata Tools and Utilities ##.# Supported Platforms and Product Versions spreadsheet associated with this release. Teradata FastLoad Reference 3

4 Preface Prerequisites The spreadsheet includes supported Teradata Database versions, platforms, and product release numbers. Prerequisites The following prerequisite knowledge is required for this product: Familiarity with computer technology, relational database management systems, and utilities that load and retrieve data Teradata SQL Teradata Database Changes to This Book The following changes were made to this book in support of the current release. Changes are marked with change bars. For a complete list of changes to the product, see the Release Definition associated with this release. Date and Release August 2009 Teradata Tools and Utilities Teradata FastLoad Reference August 2008 Teradata Tools and Utilities Teradata FastLoad Reference Description Added information on Loading No Primary Index (NoPI) tables in chapter 2. Updated FastLoad configuration file information. Included information about not using a semicolon in object names Added Appendix E, User-Defined-Types and User-Defined-Methods Updated IBM terminology Updated rules for delimiter characters Corrected compile syntax diagrams Added information Additional Information Additional information that supports this product and Teradata Tools and Utilities is available at the web sites listed in the table that follows. In the table, mmyx represents the publication date of a manual, where mm is the month, y is the last digit of the year, and x is an internal publication code. Match the mmy of a related publication to the date on the cover of this book. This ensures that the publication selected supports the same release. 4 Teradata FastLoad Reference

5 Preface Additional Information Type of Information Description Access to Information Release overview Late information Additional product information CD-ROM images Ordering information for manuals Use the Release Definition for the following information: Overview of all of the products in the release Information received too late to be included in the manuals Operating systems and Teradata Database versions that are certified to work with each product Version numbers of each product and the documentation for each product Information about available training and the support center Use the Teradata Information Products web site to view or download specific manuals that supply related or additional information to this manual. Access a link to a downloadable CD-ROM image of all customer documentation for this release. Customers are authorized to create CD-ROMs for their use from this image. Use the Teradata Information Products web site to order printed versions of manuals. 1 Go to 2 Click General Search under Online Publications. 3 Type 2029 in the Publication Product ID box. 4 Click Search. 5 Select the appropriate Release Definition from the search results. 1 Go to 2 Click Data Warehousing under Online Publications, Browse by Category. 3 Do one of the following: For a list of Teradata Tools and Utilities documents, click Teradata Tools and Utilities, and then select an item under Releases or Products. Select a link to any of the data warehousing publications categories listed. Specific books related to Teradata FastLoad are as follows: Teradata Tools and Utilities Command Summary B mmyx 1 Go to 2 Click Data Warehousing under Online Publications, Browse by Category. 3 Click CD-ROM List and Images. 1 Go to 2 Click How to Order under Print & CD Publications. 3 Follow the ordering instructions. Teradata FastLoad Reference 5

6 Preface Additional Information Type of Information Description Access to Information General information about Teradata The Teradata home page provides links to numerous sources of information about Teradata. Links include: Executive reports, case studies of customer experiences with Teradata, and thought leadership Technical information, solutions, and expert advice Press releases, mentions, and media resources 1 Go to Teradata.com. 2 Select a link. 6 Teradata FastLoad Reference

7 Table of Contents Preface Purpose Audience Supported Releases Prerequisites Changes to This Book Additional Information Chapter 1: Overview Teradata FastLoad Utility Description What It Does How It Works Operating Features and Capabilities Operating Modes Character Sets Data Transfer Capabilities Data Conversion Capabilities Checkpoints Input Data Formats Formatted Data Unformatted Data Binary Data Text Data Variable-length Text Unsupported Data Sets and Tapes Teradata FastLoad Commands Teradata FastLoad Command Summary Teradata SQL Statements Teradata FastLoad Example Teradata FastLoad Reference 7

8 Table of Contents Chapter 2: Teradata FastLoad Invoking Teradata FastLoad File Requirements Interactive Mode Batch Mode Channel-Attached Runtime Parameters Network-Attached Runtime Parameters z/vm Example z/os Example UNIX and Windows Examples Terminating Teradata FastLoad Definition Normal Termination Abort Termination Restart a Paused Teradata FastLoad Job Overview After a Client System or Teradata FastLoad Failure After a Database Overfill Condition After a Teradata Database Failure After an AP Reset Condition After an Unrecoverable Error Condition Restart Procedures Programming Considerations Teradata FastLoad Configuration File Character Set Specification Unicode Character Sets ANSI/SQL DateTime Specifications Checkpoint Tradeoffs Checkpoint Support with Access Modules Comments Concurrent Load Utility Tasks Data Conversion Factors Error Limits Nonunique Index Sorts Duplicate Rows Range Constraints Record Mode Load Anomaly UNIX Signals Restrictions and Limitations Loading No Primary Index Tables Teradata FastLoad Reference

9 Table of Contents Conventions for Quotes INMOD and Notify Exit Routines Overview Programming Considerations for Routines Programming Structure Addressing Mode on z/vm and z/os Systems Teradata FastLoad/INMOD Routine Interface Teradata FastLoad/Notify Exit Routine Interface Teradata FastLoad Sample INMOD Routines Creating Custom INMOD Routines Teradata FastLoad Job Scripts Definition Enter Teradata FastLoad Commands Teradata FastLoad Job Script Example Run Multifile Teradata FastLoad Jobs Initiate the Teradata FastLoad Job and Loading the First Data Source Restart the Teradata FastLoad Job and Loading the Second Data Source Restart the Teradata FastLoad Job and Loading the Third Data Source Terminate the Teradata FastLoad Job Command Functions Handling Teradata FastLoad Errors Teradata FastLoad Error Conditions Error Recording Error Table Formats Correcting Errors Procedure for Correcting Errors in the First Error Table Procedure for Correcting Errors in the Second Error Table Chapter 3: Teradata FastLoad Commands Syntax Notes Object Name Restrictions Geospatial Data Restrictions AXSMOD BEGIN LOADING CLEAR DATEFORM DEFINE END LOADING Teradata FastLoad Reference 9

10 Table of Contents ERRLIMIT HELP HELP TABLE INSERT LOGDATA LOGMECH LOGOFF LOGON NOTIFY OS QUIT Completion Message RECORD Completion Message Completion Message RUN SESSIONS SET RECORD SET SESSION CHARSET SHOW SHOW VERSIONS SLEEP TENACITY Appendix A: How to Read Syntax Diagrams Syntax Diagram Conventions Strings Multiple Legitimate Phrases Sample Syntax Diagram Diagram Identifier Appendix B: Multifile Teradata FastLoad Job Script Examples First Output File Second Output File Teradata FastLoad Reference

11 Table of Contents Third Output File Appendix C: INMOD and Notify Exit Routine Examples z/vm and z/os Assembler INMOD Example COBOL INMOD Example PL/I INMOD Example SAS/C INMOD Example UNIX BLKEXIT.C Sample INMOD BLKEXITR.C Sample INMOD All Platforms Notify Exit Routine Example Appendix D: Compile, Link, and Execute INMOD and Notify Exit Routines z/vm Assembler COBOL PL/I SAS/C z/os Assembler COBOL PL/I SAS/C IBM C or C++ INMODs UNIX Sun Solaris SPARC Sun Solaris Opteron HP-UX PA RISC HP-UX Itanium IBM AIX Linux Windows Teradata FastLoad Reference 11

12 Table of Contents Appendix E: User-Defined-Types and User-Defined-Methods User-Defined-Types and User-Defined-Methods User-Defined-Types (UDTs) User-Defined-Methods (UDMs) Creating UDTs with FastLoad Inserting and Retrieving UDTs with Client Products External Types Inserting UDTs with FastLoad Retrieving UDTs with FastLoad Retrieving UDT Metadata with FastLoad Glossary Index Teradata FastLoad Reference

13 List of Tables Table 1: Formatted Record Field Descriptions Table 2: Unformatted Record Field Descriptions Table 3: Binary Record Field Descriptions Table 4: Teradata FastLoad Commands for Session Control Table 5: Teradata FastLoad Commands for Data Handling Table 6: Teradata SQL Statements Supported in Teradata FastLoad Table 7: FastLoad Data Sets/Files and Input/Output Devices Table 8: Runtime Parameters (Channel-Attached Systems) Table 9: Runtime Parameters (Network-Attached Systems) Table 10: Character Sets Supported by Teradata FastLoad Table 11: Site-Defined Character Sets Table 12: Range Constraint Types Table 13: Programming Languages Supported by Platform and Type of User-Developed Routine Table 14: Programming Structures for Teradata FastLoad/INMOD Communication Table 15: Entry Points for INMOD Routines Table 16: Teradata FastLoad--to--INMOD Interface Status Codes Table 17: INMOD-to-Teradata FastLoad Interface Status Codes Table 18: Events Passed to the Notify Exit Routine Table 19: Sample INMOD Routines Table 20: FastLoad Entering Commands Table 21: Teradata FastLoad Terminating Commands Table 22: Error Conditions that Cause Teradata Database to Reject an Input Data Record Table 23: Error Tables Table 24: errortname1 Columns Table 25: Usage Notes for AXSMOD Table 26: Usage Note for BEGIN LOADING Table 27: Usage Notes for DATEFORM Table 28: Input Length and Field Descriptions Table 29: Limitations by Data Type Table 30: Usage Notes for END LOADING Teradata FastLoad Reference 13

14 List of Tables Table 31: RECORD Completion Message Conditions Table 32: Usage Notes for ERRLIMIT Table 33: Usage Notes for HELP Table 34: Usage Notes for HELP TABLE Table 35: Usage Notes for INSERT Table 36: LOGOFF Command Usage Notes Table 37: LOGOFF Command Completion Messages Table 38: Usage Notes for LOGON Table 39: Events that Create Notifications Table 40: Usage Notes for NOTIFY Table 41: NOTIFY Command Message Examples Table 42: OS Command Examples on a UNIX Client System Table 43: Example OS Command on Windows Client System Table 44: Example OS Command on z/vm Client System Table 45: Example Procedure for OS Command on z/os Client System Table 46: Usage Notes for QUIT Table 47: Usage Notes for RECORD Table 48: Usage Notes for Run Table 49: Usage Notes for SESSIONS Table 50: Usage Notes for SET SESSION CHARSET Table 51: Usage Notes for SLEEP Table 52: Usage Notes for TENACITY Teradata FastLoad Reference

15 CHAPTER 1 Overview This chapter provides an introductory overview of the Teradata FastLoad utility. Topics include: Teradata FastLoad Utility Operating Features and Capabilities Input Data Formats Teradata FastLoad Commands Teradata FastLoad Example Teradata FastLoad Utility This section describes Teradata FastLoad features and operation. Description Teradata FastLoad is a command-driven utility which can be used to quickly load large amounts of data in an empty table on a Teradata Database. Data can be loaded from: Disk or tape files on a channel-attached client system Input files on a network-attached workstation Special input module (INMOD) routines written to select, validate, and preprocess input data Any other device providing properly formatted source data Teradata FastLoad uses multiple sessions to load data. However, it loads data into only one table on a Teradata Database per job. To load data into more than one table in the Teradata Database, multiple Teradata FastLoad jobs must be submitted one for each table. Note: Full tape support is not available for any function in Teradata FastLoad for networkattached client systems. To import data from a tape, write a custom access module that interfaces with the tape device. For information about how to write a custom access module, refer to the Teradata Tools and Utilities Access Module Programmer Guide. Teradata FastLoad Reference 15

16 Chapter 1: Overview Operating Features and Capabilities What It Does How It Works When Teradata FastLoad is invoked, the utility executes the Teradata FastLoad commands and Teradata SQL statements in the Teradata FastLoad job script. These direct Teradata FastLoad to: 1 Log on to the Teradata Database for a specified number of sessions, using username, password, and tdpid/acctid information. 2 Load the input data into the Teradata FastLoad table on the Teradata Database. 3 Log off from the Teradata Database. 4 If the load operation was successful, return the following information about the Teradata FastLoad operation and then terminate: Total number of records read, skipped, and sent to the Teradata Database Number of errors posted to the Teradata FastLoad error tables Number of inserts applied Number of duplicate rows Teradata FastLoad processes a series of Teradata FastLoad commands and Teradata SQL statements entered either interactively or in batch mode. Use the Teradata FastLoad commands for session control and data handling of the data transfers. The Teradata SQL statements create, maintain, and drop tables on the Teradata Database. During a load operation, Teradata FastLoad inserts the data from each record of the data source into one row of the table on a Teradata Database. The table on the Teradata Database receiving the data must be empty and have no defined secondary indexes. Note: Teradata FastLoad does not load duplicate rows from the data source to the Teradata Database. (A duplicate row is one in which every field contains the exact same data as the fields of an existing row.) This is true even for MULTISET tables. To load duplicate rows in a MULTISET table, use MultiLoad. Operating Features and Capabilities This section describes the operating modes and character sets for running Teradata FastLoad. For specific information on supported operating systems, refer to Teradata Tools and Utilities ##.##.## Supported and Certified Versions, B mmyK. This spreadsheet shows version numbers and platform information for all Teradata Tools and Utilities products and is available at Caution: Some system configurations running Teradata FastLoad on a network-attached UNIX workstation with the data set mounted on a Network File System (NFS) can produce errors and failed or incomplete data transfer operations. Do not use Teradata FastLoad with an NFSmounted data set. 16 Teradata FastLoad Reference

17 Chapter 1: Overview Data Transfer Capabilities Operating Modes Character Sets Teradata FastLoad runs in the following operating modes: Interactive Batch Teradata FastLoad supports Latin, Chinese, Japanese, and Korean character sets for networkattached and channel-attached configurations. For additional information about character-set support and definition, see Character Set Specification on page 53. Teradata FastLoad also supports UTF16 (workstation only) and UTF8 character sets. For additional information, see Unicode Character Sets on page 55. Data Transfer Capabilities This section covers Teradata FastLoad s data transfer capabilities. On network-attached workstations, Teradata FastLoad uses the TCP/IP network protocol for all data transfer operations. On channel-attached systems, Teradata FastLoad transfers data as either: A multi-volume data set or file A number of single-volume data sets or files in separate Teradata FastLoad jobs Serial Teradata FastLoad operations can be restarted by loading the next tape in a series instead of beginning with the first tape in a set. In either case, Teradata FastLoad: Uses multiple Teradata sessions, at one session per AMP, to transfer data Transfers multiple rows of data within a single message Also, in either case, until the Teradata FastLoad job is completed and the data loaded into the Teradata FastLoad table: There is no journaling or fallback data The secondary indexes cannot be defined Data Conversion Capabilities Teradata FastLoad can redefine the data type specification of numeric, character, and date input data so it matches the type specification of its destination column in the Teradata FastLoad table on the Teradata Database. If, for example, an input field with numeric type data is targeted for a column with a character data type specification, Teradata FastLoad can change the input data specification to character before inserting it into the table. The types of data conversions which can be specified are: Teradata FastLoad Reference 17

18 Chapter 1: Overview Input Data Formats Numeric-to-numeric (for example integer-to-decimal) Character-to-numeric Character-to-date Date-to-character Note: Redundant conversions, like integer-to-integer, are legal and necessary to support the zoned decimal format. For more information about the zoned decimal format, see the Database Design and SQL Data Types and Literals documentation. Use the datatype specification of the DEFINE command to convert input data to a different type before inserting it into the Teradata FastLoad table on the Teradata Database. For details on data types and data conversions, see SQL Data Types and Literals. Checkpoints Checkpoints are entries posted to a restart log table at regular intervals during the Teradata FastLoad data transfer operation. If processing stops while a Teradata FastLoad job is running, the job can be restarted at the most recent checkpoint. If, for example, 1,000,000 records are being loaded into a table and they have specified checkpoints every 50,000 records, Teradata FastLoad pauses and posts an entry to the restart log table whenever multiples of 50,000 records have been successfully sent to the Teradata Database. If the job stops after record 60,000 has been loaded, the job can be restarted at the record immediately following the last checkpoint record 50,001. Enable the checkpoint function by specifying a checkpoint value in the BEGIN LOADING command. Input Data Formats This section covers the data formats supported by Teradata FastLoad as well as those data sets and tapes not supported by the utility. Input data is the raw data that Teradata FastLoad loads from the client system or workstation to the Teradata Database. The input data can be either formatted, unformatted, variablelength text or of specific file types, depending on the configuration of the client system. For network-attached configurations, Teradata FastLoad supports the following data formats: Formatted Unformatted Binary Text Variable-length text For channel-attached configurations, Teradata FastLoad supports: Data sets and tape files with the following record format (RECFM) attributes: 18 Teradata FastLoad Reference

19 Chapter 1: Overview Input Data Formats F (fixed) FB (fixed block) V (variable) VB (variable block) VBS (variable block, spanned) On z/vm, tapes with the following symbolic names and virtual addresses: Symbolic Name Virtual Address TAP0 TAP1 TAP2 TAP3 TAP4 TAP5 TAP6 TAP7 TAP8 TAP9 TAPA TAPB TAPC TAPD TAPE TAPF A 28B 28C 28D 28E 28F Formatted Data Formatted data on network-attached systems is input data that conforms to the format of data from a Teradata Database source, such as a BTEQ EXPORT file. Each record has: A two-byte data length field Optionally, a variable-length indicator bytes field A variable-length input data field A one-byte end-of-record delimiter field Table 1 lists the formatted record field descriptions. Table 1: Formatted Record Field Descriptions Input Record Field Data length Indicator bytes Input data Description A two-byte field indicating the total length of the record, in bytes, excluding the first two bytes (this field), and the last byte (the end-of-record field) The data length must be specified as an explicit value, not an ASCII value. For a data length of one byte, for example, the specification must be hexadecimal 01. It cannot be hexadecimal 31, or the ASCII equivalent of the number 1. Optional bytes to indicate null data The actual input data for rows in the Teradata FastLoad table. The input data stream always starts at either: The third byte of the record, if there are no optional indicator bytes Immediately after the last optional indicator byte The length of the input data field, less any optional indicator bytes, is as specified in the first two bytes. Teradata FastLoad Reference 19

20 Chapter 1: Overview Input Data Formats Table 1: Formatted Record Field Descriptions (continued) Input Record Field End-of-record Description The end-of-record delimiter field can be either of two hexadecimal values: 0A (carriage return) 0D (line feed) Unformatted Data Unformatted data on network-attached systems is data that does not conform to the format of data from a Teradata Database source. It may, however, originate from a Teradata Database source, or from other sources, such as a dbase III file. Unformatted records include: Optionally, a variable-length indicator bytes field A variable-length data field Unformatted records have no end-of-record delimiter field. Table 2 lists the unformatted record field descriptions. Table 2: Unformatted Record Field Descriptions Input Record Field Indicator bytes Input data Description Optional bytes to indicate null data Raw data to be loaded into the Teradata FastLoad table on the Teradata Database Note: If the network-attached system configuration includes both UNIX and Windows operating system platforms, ensure that the Teradata FastLoad job scripts accommodate the different ways that each platform specifies new lines in ASCII text files. Windows platforms use a two-character sequence to signify a new line carriage return + line feed. UNIX platforms use a single new-line character to perform the same function. When loading unformatted ASCII files from a network-attached system, always ensure that the DEFINE command properly identifies the format of the new-line function for the source platform: One character for UNIX platforms Two characters for Windows platforms Binary Data The binary data format is a 2-byte integer, n, followed by n bytes of data. Binary data format is similar to formatted data format, except that there is no end-of-record marker. Each record has: A two-byte data length field 20 Teradata FastLoad Reference

21 Chapter 1: Overview Input Data Formats Optionally, a variable-length indicator bytes field A variable-length input data field Table 3 lists the unformatted binary record field descriptions. Table 3: Binary Record Field Descriptions Input Record Field Data length Indicator bytes Input data Description A two-byte field indicating the total length of the record, in bytes, excluding the first two bytes (this field) The data length must be specified as an explicit value, not an ASCII value. For a data length of one byte, for example, the specification must be hexadecimal 01. It cannot be hexadecimal 31, or the ASCII equivalent of the number 1. Optional bytes to indicate null data The actual input data for rows in the Teradata FastLoad table. The input data stream always starts at either: The third byte of the record, if there are no optional indicator bytes or Immediately after the last optional indicator byte The length of the input data field, less any optional indicator bytes, is as specified in the first two bytes. Text Data Text data on network-attached systems consists of an arbitrary number of bytes, followed by an end-of-record marker. This marker is a line feed on UNIX platforms and is a carriagereturn/line feed pair on Windows platforms. Text data can be accepted as two types: non-ascii and ASCII. If the data is binary data (not binary record type) that is not printable as ASCII text, then it follows the same rules as formatted data, except that there is not a leading 2-byte length. The text is scanned by the utility until it reaches an end-of-record marker, and that is considered the record. This type of text data can also have indicator bytes. The other type of text data is data contained in ASCII form (for example, a report created with Notepad on a PC). This data is comprised of ASCII text (for instance), with each record ending with an end-of-record marker. With this type of text data, all fields are generally fixed-length fields. Variable-length fields, like VARCHAR, are not allowed because there is no way to specify a 2-byte length for the field. Variable-length Text Variable-length text on a network-attached system is ASCII text data consisting of variablelength fields and records, with each field separated by a delimiter character. When loading variable-length text records from a network-attached system, use the SET RECORD command to specify the delimiter character. Teradata FastLoad Reference 21

22 Chapter 1: Overview Teradata FastLoad Commands Unsupported Data Sets and Tapes Teradata FastLoad does not support the following types of data sets and tapes on channelattached systems: Concatenated data sets Nonlabel (NL) and bypass label (BPL) tapes Teradata FastLoad Commands Teradata FastLoad accepts both Teradata FastLoad commands and a subset of Teradata SQL statements. The Teradata FastLoad commands perform session control and data-handling activities. The Teradata SQL statements define and manipulate the data stored in the Teradata Database. This section provides a summary of the Teradata FastLoad commands and Teradata SQL statements. Teradata FastLoad Command Summary The Teradata FastLoad commands perform two types of activities: Session control Session control commands begin and end Teradata FastLoad sessions and provide online information about a particular Teradata FastLoad operation. and Data handling Data handling commands establish and define a Teradata FastLoad operation. Table 4 and Table 5 summarize the Teradata FastLoad commands that perform these activities. For a detailed description of each Teradata FastLoad command, see Chapter 3: Teradata FastLoad Commands. Table 4: Teradata FastLoad Commands for Session Control Command Name HELP HELP TABLE LOGOFF QUIT LOGON NOTIFY OS SESSIONS Function Lists Teradata FastLoad commands and options Creates a list of field names which can be used with the INSERT statement Ends Teradata FastLoad sessions and terminates Teradata FastLoad Begins one or more Teradata FastLoad sessions Specifies a user exit or action to be performed when certain significant events occur Enters client operating system commands Specifies the number of Teradata FastLoad sessions logged on with a LOGON command and, optionally, the minimum number of sessions required to run the job 22 Teradata FastLoad Reference

23 Chapter 1: Overview Teradata FastLoad Commands Table 4: Teradata FastLoad Commands for Session Control (continued) Command Name SHOW SHOW VERSIONS SLEEP TENACITY Function Shows the current field/file definitions established by DEFINE commands Shows the current level of all Teradata FastLoad software modules Specifies the number of minutes that Teradata FastLoad pauses before retrying a logon operation Specifies the number of hours that Teradata FastLoad continues trying to log on when the maximum number of load jobs is already running on the Teradata Database Table 5: Teradata FastLoad Commands for Data Handling Teradata FastLoad Command AXSMOD BEGIN LOADING CLEAR DATEFORM DEFINE END LOADING ERRLIMIT RECORD RUN SET RECORD Function Specifies the name and initialization string for a shared object file that loads data from a file on network-attached client systems Identifies the tables used in the Teradata FastLoad operation and, optionally, specifies when checkpoints are taken or if the user supplies indicator data Cancels the current DEFINE command specifications Specifies the form of the DATE data type specifications for the Teradata FastLoad job Describes each field of an input data source record and specifies the name of the input data source or INMOD routine Informs the Teradata Database that all input data has been sent Limits the number of errors detected during the loading phase of a Teradata FastLoad job Processing stops when the limit is reached. Specifies the number of a record in an input data source at which Teradata FastLoad begins to read data and/or the number of the last record to be read Invokes the specified external source as the current source of commands and statements Specifies that the input data records are either: Formatted Unformatted Binary Text Variable-length text Note: The SET RECORD command applies only to network-attached systems. Teradata FastLoad Reference 23

24 Chapter 1: Overview Teradata FastLoad Commands Table 5: Teradata FastLoad Commands for Data Handling (continued) Teradata FastLoad Command SET SESSION CHARSET Function Specifies which character set is in effect during a specific Teradata FastLoad invocation Note: The SET SESSION CHARSET command applies only to networkattached systems. Teradata SQL Statements Note: The SET RETRY command is obsolete and ignored by Teradata FastLoad. For a description of the tenacity function, see Invoking Teradata FastLoad on page 31 and TENACITY on page 153. Teradata SQL statements define and manipulate the data stored in the Teradata Database. Table 6 summarizes the Teradata SQL statements supported by Teradata FastLoad Teradata FastLoad supports only the Teradata SQL statements listed in Table 6. To use other Teradata SQL statements, Teradata FastLoad must first be exited, and the statements entered from another application, such as Basic Teradata Query (BTEQ). Table 6: Teradata SQL Statements Supported in Teradata FastLoad Teradata SQL Statement CREATE TABLE DATABASE DELETE DROP TABLE INSERT SET QUERY_BANDING...FOR SESSION Function Defines the columns, index, and other qualities of a table Changes the default database Deletes rows from a table Removes a table and all of its rows from a database Inserts rows into a table Sets query banding at the session level. For syntax and a complete description of each Teradata SQL statement, see SQL Data Definition Language and SQL Data Manipulation Language. The Teradata FastLoad version of the INSERT statement includes a special wildcard table name specification that is not supported by the Teradata Database. For a complete description of the Teradata FastLoad version of the INSERT statement, see INSERT on page Teradata FastLoad Reference

25 Chapter 1: Overview Teradata FastLoad Example Teradata FastLoad Example This section provides an example of a small Teradata FastLoad job which can be quickly set up and run. The example shows how to: Create a data file that will be used as the input source for a Teradata FastLoad job Use a Teradata FastLoad job script to load data into a newly created table Select data from the table to verify the load task Note: This example is for UNIX or Windows on a network-attached client system. Refer to the following appendixes for additional UNIX and Windows examples, and for z/vm and z/os examples on channel-attached systems: Appendix B: Multifile Teradata FastLoad Job Script Examples Appendix C: INMOD and Notify Exit Routine Examples Appendix D: Compile, Link, and Execute INMOD and Notify Exit Routines Dropping the Employee Table The table in this example is named Employee. Use the Teradata SQL DROP TABLE command to delete any existing version of the Employee table from the database: bteq.logon tdpid/username,password DROP TABLE employee;.quit Creating the Source Data File Create and save a six-record text file named insert.input: Brown, Jo Development Jan F M Jones, Bill President Jan M M Smith, Jim Sales Jan M M Lee, Sandra Support Jan F M Berg, Andy Test Jan M M Ayer, John Accounting Jan M M 13 0 Use this file as the input source for a Teradata FastLoad job. Note: The file example uses field delimiter characters ( ) to help visualize each field it is not required to use them in the file. Writing the Teradata FastLoad Job Script Create and save a Teradata FastLoad job script file named flinsert.fastload that loads the sixrecord insert.data file into the Employee table: sessions 2; errlimit 25; logon tdpid/username,password; CREATE TABLE employee ( EmpNo SMALLINT FORMAT 9(5) BETWEEN AND NOT NULL, Name VARCHAR(12), Teradata FastLoad Reference 25