Microsoft SQL Server Integration Services (SSIS) (File) - Import - 7.1

Talend Data Catalog Bridges

author
Talend Documentation Team
EnrichVersion
7.1
EnrichProdName
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Data Catalog

Bridge Specifications

Vendor Microsoft
Tool Name SQL Server Integration Services (SSIS)
Tool Version 9.0 (2005) to 14.x (2017)
Tool Web Site http://msdn2.microsoft.com/en-us/library/ms141026.aspx
Supported Methodology [Data Integration] Multi-Model, ETL (Source and Target Data Stores, Transformation Lineage, Expression Parsing) via DTSX XML File
Remote Repository Browsing for Model Selection
Data Profiling
Multi-Model Harvesting
Incremental Harvesting

BRIDGE INFORMATION
Import tool: Microsoft SQL Server Integration Services (SSIS) 9.0 (2005) to 14.x (2017) (http://msdn2.microsoft.com/en-us/library/ms141026.aspx)
Import interface: [Data Integration] Multi-Model, ETL (Source and Target Data Stores, Transformation Lineage, Expression Parsing) via DTSX XML File from Microsoft SQL Server Integration Services (SSIS) (File)
Import bridge: 'MicrosoftSqlServerIs' 10.1.0

BRIDGE DOCUMENTATION
The bridge imports SSIS Packages from a dtsx file.

FREQUENTLY ASKED QUESTIONS:

SUPPORT:
When experiencing issues with the bridge, you should report the issues in a manner that is reproducible by the support engineers. In order to provide a complete set of source metadata to reproduce the issue, please export and attach the Data Service(dtsx) files. As always, attach the MIMB Log file, as well.


Bridge Parameters

Parameter Name Description Type Values Default Scope
File Specify here the DTSX file path to import from.
All depended external connection files with 'conmg' extension must be in the same directory.
FILE
*.xml
*.dtsx
   
Directory Path to directory containing DTSX files to import. Leave it empty when using the 'File' parameter.
All depended external connection files with 'conmg' extension must be in the same directory.
DIRECTORY      
Variable values file File defines values for SSIS variables. Variables are grouped by their package and task context, and prefixed with namespace:
[Package.Task]
Namespace::Variable=Value

Consider using the file when SSIS employs variables (without reasonable default values) in SQL statements. It should help with understanding lineage through SQL statements.

The file supports SSIS 2005, 2008 and 2012 variables. It does not support SSIS 2012 parameters.

Use the [Package] context to define variables for all tasks in in the Package.
When the same variable is defined multiple times in a context, the latest definition is used. However, when the same variable is defined in [Package] and [Package.Task] contexts the definition in the higher level context, [Package.Task] is used.

Variable names are case sensitive. The file overrides default variable values if any defined in SSIS.
FILE
*.txt
*.ini
*.var
*.properties
   
Encoding Specifies an encoding character set of the source file for 'Execute SQL Task' when property 'SQLSourceType' is set to 'File connection'. ENUMERATED
Central and Eastern European (iso-8859-2)
Central and Eastern European (windows-1250)
Chinese Traditional (big5)
Chinese Simplified (GB18030)
Chinese Simplified (GB2312)
Cyrillic (iso-8859-5)
Cyrillic (windows-1251)
DOS (ibm-850)
Greek (iso-8859-7)
Greek (windows-1253)
Hebrew (iso-8859-8)
Hebrew (windows-1255)
Japanese (shift_jis)
Korean (ks_c_5601-1987)
Thai (TIS620)
Thai (windows-874)
Turkish (iso-8859-9)
Turkish (windows-1254)
UTF 8 (utf-8)
UTF 16 (utf-16)
Western European (iso-8859-1)
Western European (iso-8859-15)
Western European (windows-1252)
Locale encoding
No encoding conversion
windows-1252  
Password The value of the password for the protected package. PASSWORD      
Miscellaneous Specify miscellaneous options identified with a -letter and value.

For example, -l -c -m 4G -j -Dname=value -Xms1G

-s enable specifying mappings between Transformation Script inputs and outputs externally. In this case, the inputs go to a table in '_Script_' database and outputs come from a table in the database. One can specify mapping relationships between inputs and outputs by defining a mapping between their tables.
By default the bridge interconnect all inputs to all outputs in Transformation Scripts.
-v set environment variable(s) (e.g. -v var1=value -v var2='value with spaces').
-m the maximum Java memory size whole number (e.g. -m 4G or -m 2500M ).
-p full path to the dtutil.exe
The dtutil.exe is the Microsoft utility that can decrypt protected files. It is available on Windows only. The utility is SQL Server version specific. When multiple versions of SQL Server are installed use the appropriate utility version.
The application tries to find and use dtutil.exe automatically. It looks for the file in default locations for different SQL Server versions starting from the latest. Use this option when the application cannot find dtutil.exe and reports an error.
Example:
-p 'C:\Program Files\Microsoft SQL Server\120\DTS\Binn\dtutil.exe'

-cd: split or merge file system connections by a directory path.

For example, a connection can have two root folders, a and b. When you imported separate File stores for each root folder you would want to split the connection into two connections that can be resolved using these File stores. It can be achieved with option:
-cd a_con=orig_con:/a
requesting to create 'a_con' connection and move the 'a' folder to it from the 'orig_con' connection. The result will have a_con and orig_con connections. The orig_con connection will have the folder branch 'b' that is left over after splinting the folder branch 'a' out.

Here is a little bit more complex example:
-cd a_con=orig_con:/root/a - create 'a_con' connection for the 'root/a' folder branch in the 'a_con' connection.

You can use the option to merge several connections into one. For example, when you have two file stores C:\a and B:\b you can merge them with the option:
-cd C:\=B:\
that will move all folders from B:\ connection to C:\ that will end up with a and b root folders.

-pppd enables the DI/ETL post-processor processing of DI/ETL designs in order to create the design connections and connection data sets.
-j the last option that is followed by Java command line options (e.g. -j -Dname=value -Xms1G).
STRING      

 

Bridge Mapping

Meta Integration Repository (MIR)
Metamodel
(based on the OMG CWM standard)
"Microsoft SQL Server Integration Services (SSIS) (File)"
Metamodel
Microsoft SQL Server IS (Data Flow Task)
Mapping Comments
     
AggregationTransformation Aggregate  
Description Description  
Name Name  
ConnectionDataAttribute Variable, External Column  
Description Description  
Name Name  
ConnectionDataSet Variables, Table, File  
Description Description  
Name Name  
ConnectionNamespace Directory  
Description Description  
Name Name  
ConnectionPackage Database Schema  
Description Description  
Name Name  
DiModel Data Flow Task  
Description Description  
Name Name  
ExpressionTransformation Character Map, Derived Column, Data Conversion  
Description Description  
Name Name  
FilteringTransformation CDC Splitter, Conditional Split  
Description Description  
Name Name  
GenericConnectedTransformation Script Component, Cache Transform  
ConnectionName Connection Manager  
Description Description  
Name Name  
GenericTransformation Percentage Sampling, Import Column, Fuzzy Grouping, Custom Component, Generic, Export Column, Unpivot, Data Mining Query, Multicast, Row Sampling, Audit, Balanced Data Distributor, Pivot, Row Count, Copy Column, Slowly Changing Dimension @nativeType='Import Column', DataMiningQuery,MultiCast,ExportColumn,CopyColumn,ImportColumn,OleDbCommand
Description Description  
Name Name  
JoinTransformation Merge Join  
Description Description  
Name Name  
LookupTransformation Term Extraction, Lookup, Fuzzy Lookup, Term Lookup  
ConnectionName Connection Manager  
Description Description  
Name Name  
ReaderTransformation ODBC Source, Excel Source, Flat File Source, OLE DB Source, CDC Source, ADO NET Source, Source, XML Source, Raw File Source  
ConnectionName Connection Manager  
Description Description  
Name Name  
SortingTransformation Sort  
Description Description  
Name Name  
StoreConnection Connection  
Description Description  
Name Name  
TransformationDataAttribute Column  
Description Description  
Name Name  
TransformationDataSet Input, Conditional Output, Output  
Description Description  
Name Name  
UnionTransformation Union All, Merge  
Description Description  
Name Name  
WriterTransformation Destination, Data Streaming Destination, Partition Processing  
ConnectionName Connection Manager  
Description Description  
Name Name