Big Data Platform
Data Fabric
Data Management Platform
Data Services Platform
MDM Platform
Real-Time Big Data Platform
Reports are aggregations of analyses. A full report is composed of several rows (as many analyses as the report contains).
TDQ_ANALYSIS
-
AN_PK
: primary key (artificial) -
AN_UUID
: analysis identifier -
AN_LABEL
: analysis name -
AN_CREATION_DATE
: analysis creation date -
AN_AUTHOR
: analysis author -
AN_DATA_FILTER
: the data filter of the analysis -
AN_STATUS
: analysis status -
REP_UUID
: report identifier -
REP_CREATION_DATE
: report creation date -
REP_LABEL
: report name -
REP_AUTHOR
: report author -
REP_STATUS
: report status -
AN_BEGIN_DATE
: the date when the row is created -
AN_END_DATE
: the date indicating a change in the attributes of the pair (report/analysis) -
AN_VERSION
: the version number of the (report, analysis) which is incremented each time the pair's data change -
AN_PURPOSE
: analysis purpose -
AN_DESCRIPTION
: analysis description -
REP_PURPOSE
: report purpose -
REP_DESCRIPTION
: report description -
AN_TYPE
: the type of analysis
TDQ_ANALYZED_ELEMENT
-
ELT_PK
: primary key (artificial) -
ELT_UUID
: identifier of analyzed element -
ELT_CONNECTION_UUID
: connection identifier -
ELT_CONNECTION_NAME
: connection name -
ELT_CATALOG_NAME
: catalog name or Talend default value corresponding to a null value (see SqlConstants.java) -
ELT_SCHEMA_NAME
: schema name or Talend default value corresponding to a null value (see SqlConstants.java) -
ELT_TABLE_NAME
: table name or Talend default value corresponding to a null value (see SqlConstants.java) -
ELT_COLUMN_NAME
: column name or Talend default value corresponding to a null value (see SqlConstants.java) -
ELT_BEGIN_DATE
: historization columns -
ELT_END_DATE
: historization columns -
ELT_VERSION
: historization columns -
ELT_CONNECTION_URL
: connection URL of the database containing the analyzed element -
ELT_SIZE
: analyzed columns size -
ELT_PROJECT_NAME
: current project name -
ELT_PROJECT_DESCRIPTION
: current project description -
ELT_CTX_GROUP_ID
: the context group id -
ELT_CTX_GROUP_NAME
: the context group name -
ELT_CTX_NAME
: the context name
TDQ_BLOCKING_KEY
B_KEY_PK
: primary key (artificial)ANALYSIS_PK
: foreign keys to the analysis dimension tablesB_KEY_NAME
: blocking key nameB_KEY_INPUT_COLUMN
: input column nameB_KEY_PRE_ALGORITHM
: pre-algorithm nameB_KEY_PRE_ALGORITHM_VALUE
: pre-algorithm valueB_KEY_ALGORITHM
: algorithm nameB_KEY_ALGORITHM_VALUE
: algorithm valueB_KEY_POST_ALGORITHM
: post-algorithm nameB_KEY_POST_ALGORITHM_VALUE
: post-algorithm valueREP_RUNTIME
: execution date of the report
TDQ_MATCHING_KEY
M_KEY_PK
: primary key (artificial)ANALYSIS_PK
: foreign keys to the analysis dimension tablesM_KEY_MATCHRULE_NAME
: match rule nameM_KEY_NAME
: matching key nameM_KEY_INPUT_COLUMN
: input column nameM_KEY_MATCHING_FUNCTION
: matching function nameM_KEY_CUSTOM_MATCHER
: custom matcher nameM_KEY_TOKENNIZED_MEASURE
: the set tokenized measureM_KEY_THRESHOLD
: matching key thresholdM_KEY_CONFIDENCE_WEIGHT
: the confidence weight of the matching keyM_KEY_HANDLE_NULL
: the set handle null parameterM_KEY_MATCHRULE_THRESHOLD
: match rule thresholdM_KEY_SURVIVORSHIP_FUNCTION
: survivorship function nameM_KEY_REFERENCE_COLUMN
: reference column nameM_KEY_PARAMETER
: the set survivorship function parameterAN_MATCH_THRESHOLD
: the confident match threshold of the match analysisAN_RECORD_LINKAGE_ALGORITHM
: the record linkage algorithm of the match analysisREP_RUNTIME
: execution date of the report
TDQ_ANALYZED_SET
-
AN_SET_PK
: primary key (artificial) -
MATCH_IND_PK
: matching indicator id for the A and B sets -
ELT_A_PK
: the element belonging to set A of the matching indicator -
ELT_B_PK
: the element belonging to set B of the matching indicator
TDQ_CALENDAR
-
CAL_PK
: primary key -
CAL_DATE
: date -
CAL_DAY_IN_MONTH
: month date -
CAL_DAY_IN_YEAR
: day count in the year -
CAL_LAST_WEEK_DAY
: count of the last day of the current week (CAL_DAY_IN_YEAR
) in the year -
CAL_LAST_MONTH_DAY
: count of the last day of the current month (CAL_DAY_IN_YEAR
) in the year -
CAL_WEEK_DAY
: day count in the week -
CAL_DAY_NAME
: name of the day -
CAL_WEEK_NUM
: week count -
CAL_WEEK_PERIOD
: the period (yyyyww
) where (y
) is year, (w
) is week count -
CAL_MONTH
: month count -
CAL_MONTH_NAME
: month name -
CAL_YEAR
: year -
CAL_MONTH_PERIOD
: string representing the period: (yyyymm
) -
CAL_QUARTER
: quarter 1,2,3 or 4 -
CAL_QUARTER_PERIOD
: the period (yyyyq
) where (y
) is year, (q
) is quarter among 1,2,3,4 -
CAL_SEMESTER
: semester (1 or 2) -
CAL_SEMESTER_PERIOD
: the period (yyyys
) where (y
) is year, (s
) is semester count -
CAL_DAY_OFF
: the flag to indicate days-off -
CAL_SPECIAL_DAY
: the flag to indicate special dates,Y
indicates a special day,N
indicates that the day is not special -
CAL_SPEC_DAY_LABEL
: label of the special day
TDQ_DAY_TIME
The time data is stored in UTC (Coordinated Universal Time).
-
TIME_PK
: primary key (artificial) -
TIME_HOUR
: hour (0-23) -
TIME_MINUTES
: minutes (0-59) -
TIME_LABEL
: time label
TDQ_INDICATOR_DEFINITION
-
IND_PK
: primary key (artificial) -
IND_LABEL
: indicator label -
IND_UUID
: indicator identifier -
IND_CATEGORY
: the category of the indicator.Simple indicators such as count indicators belong to the Simple Statistics category, Count subcategory. Text indicators belong to the Text Statistics category. Mean, Median, Lower quartile, upper quartile, min value, max value belong to the Summary Statistics category. Mode belong to the Advanced Statistics category and Mode subcategory. Frequency table belong to the Advanced Statistics category and Frequencies subcategory.
-
IND_CATEG_UUID
: category identifier -
IND_CRITICAL
: criticality level of the indicator -
IND_PURPOSE
: indicator purpose -
IND_DESCRIPTION
: indicator description
And the 3 historization columns:
-
IND_BEGIN_DATE
-
IND_END_DATE
-
IND_VERSION
TDQ_INDICATOR_OPTIONS
-
INO_PK
: primary key (artificial) -
INO_CASE_SENSITIVE
: case sensitive flagY
,N
,U
-
INO_REGEXP
: regular expression -
INO_COUNT_NULLS
: flag for counting null valuesY
,N
-
INO_COUNT_BLANKS
: flag for counting blank valuesY
,N
TDQ_INDICATOR_VALUE
-
INDV_PK
: primary key (artificial) -
TIME_PK
: foreign keys to time dimension tables -
ELEMENT_PK
: foreign keys to the analyzed element dimension tables -
ANALYSIS_PK
: foreign keys to the analysis dimension table -
VALUE_PK
: foreign keys to the value dimension tables -
OPTION_PK
: foreign keys to the option dimension tables -
INDICATOR_PK
: foreign keys to the indicator definition dimension tables -
CALENDAR_PK
: foreign keys to the date dimension tables -
IND_TYPE
: data mining type -
AN_DURATION
: duration of the analysis -
AN_RUNTIME
: execution date of the analysis -
INDV_REAL_VALUE
: real value of the indicator -
INDV_INT_VALUE
: integer value of the indicator -
INDV_ROW_COUNT
: number of rows when evaluating this indicator -
INDV_VALUE_TYPE_INDICATOR
: flag to tell whether it is a real value indicator -
INDV_DTHRESH_OK
: any of the flagsY
orN
orU
which indicates whether this indicator respects the data threshold.Y
means yes,N
means no,U
means undefined -
INDV_DTHRESH_LOW
: lower value of data threshold -
INDV_DTHRESH_HI
: higher value of data threshold -
INDV_ITHRESH_OK
: any of the flagsY
orN
orU
to indicate whether this indicator respects the indicator threshold.Y
means yes,N
means no,U
means undefined -
INDV_ITHRESH_LOW
: lower value of indicator threshold -
INDV_ITHRESH_HI
: higher value of indicator threshold -
INDV_EXP_VAL_OK
: a flagY
orN
orU
which indicates whether this indicator respects the indicator expected value.Y
means yes,N
means no,U
means undefined -
INDV_EXP_VAL
: expected value of the indicator -
INDV_ITHRESH_PERC_OK
: any of the flagsY
orN
orU
which indicates whether this indicator respects the defined percentage threshold.Y
means yes,N
means no,U
means undefined -
INDV_ITHRESH_PERC_LOW
: lower threshold of indicator value in percentage relative to the total row count -
INDV_ITHRESH_PERC_HI
: higher threshold of indicator value in percentage relative to the total row count -
INDV_DATE_VALUE
: stores the date value of the indicator -
INDV_IDATETHRESH_LO
: stores the lower threshold on date -
INDV_IDATETHRESH_HI
: stores the higher threshold on date -
INDV_IDATETHRESH_OK
: a flagY
orN
orU
to indicate whether this indicator respects the date thresholds."Y" means yes, "N" means no, "U" means undefined -
REP_DURATION
: the duration of the report -
REP_RUNTIME
: execution date of the report
TDQ_MATCH_INDVALUE
-
M_PK
: primary key -
OPTION_PK
: reference to the options -
ANALYSIS_PK
: foreign key to the analysis dimension table -
TABLE_A_PK
: foreign key to the table containing the A set -
TABLE_B_PK
: foreign key to the table containing the B set -
INDICATOR_PK
: foreign key to the indicator definition -
AN_DURATION
: duration of the execution of the analysis -
TIME_PK
: foreign key to the time of the analysis execution -
CALENDAR_PK
: foreign key to the date of the analysis execution -
AN_RUNTIME
: date of the analysis execution -
INDV_MATCH_PERCENT
: percentage of matching values -
INDV_MATCH_COUNT
: count of matching values -
INDV_ROW_COUNT
: total row count -
INDV_DTHRESH_OK
: flagY
orN
orU
which indicates whether this indicator respects the data threshold."Y
" means yes, "N
" means no, "U
" means undefined -
INDV_DTHRESH_LOW
: lower value of data threshold -
INDV_DTHRESH_HI
: higher value of data threshold -
INDV_ITHRESH_OK
: flagY
orN
orU
which indicates whether this indicator respects the indicator threshold.Y
means yes,N
means no,U
means undefined -
INDV_ITHRESH_LOW
: lower value of indicator threshold -
INDV_ITHRESH_HI
: higher value of indicator threshold -
INDV_EXP_VAL_OK
: flagY
orN
orU
which indicates whether this indicator respects the indicator expected value.Y
means yes,N
means no,U
means undefined -
INDV_EXP_VAL
: expected value of the indicator -
REP_DURATION
: the duration of the report -
REP_RUNTIME
: execution date of the report
TDQ_MATCHING_INDVALUE
-
M_PK
: primary key -
ANALYSIS_PK
: foreign key to the analysis dimension table -
TABLE_PK
: foreign key to the analyzed table -
TIME_PK
: foreign key to the time of the analysis execution -
CALENDAR_PK
: foreign key to the date of the analysis execution -
AN_DURATION
: duration of the execution of the analysis -
AN_RUNTIME
: date of the analysis execution -
VERSION
: reference to the version number in the tableTDQ_TABLE_ANALIZED_SET
-
M_ROW_COUNT
: total row count -
M_UNIQUE_COUNT
: count of unique records -
M_SUSPECT_COUNT
: count of suspect records -
M_MATCH_COUNT
: count of matched records -
REP_DURATION
: duration of the report execution -
REP_RUNTIME
: execution date of the report
The dimension tables that relate to this fact table are the same as those of
TDQ_SET_INDVALUE
table except for IND_PK
which does not exist
in the TDQ_MATCHING_INDVALUE
fact table.
TDQ_GROUP_STATISTICS
-
G_PK
: primary key -
M_PK
: foreign key to the matching indicator results (M_PK
ofTDQ_MATCHING_INDVALUE
-
G_SIZE
: group size -
G_GROUP_COUNT
: group count -
G_RECORD_COUNT
: record count -
REP_RUNTIME
: execution date of the report
TDQ_OVERVIEW_INDVALUE
-
TV_PK
: primary key (technical key) -
AN_PK
: foreign key to the analysis -
CAL_PK
: foreign key to the execution date of the analysis -
TIME_PK
: foreign key to the execution time of the analysis -
IND_PK
: foreign key to the indicator definition -
ELT_PK
: foreign key to the analyzed element (for tables, the analyzed element references their parent schema or catalog) -
TV_NAME
: table of View name. Can be empty when the row represents the level of schema or catalog or connection -
TV_CATALOGCOUNT
: number of catalogs -
TV_SCHEMACOUNT
: number of schemas -
TV_TABLECOUNT:
number of tables -
TV_ROWCOUNT
: number of rows in tables -
TV_KEYCOUNT
: number of keys -
TV_INDEXCOUNT
: number of indices -
TV_TRIGGERCOUNT
: number of triggers -
TV_VIEWCOUNT
: number of views (should be 0 or 1) -
TV_TABLE_FILTER
: table filter used in the analysis -
TV_VIEW_FILTER
: view filter used in the analysis -
AN_RUNTIME_TIMESTAMP
: execution date of the analysis -
AN_DURATION
: duration of the analysis (ms) -
REP_DURATION
: the duration of the report -
REP_RUNTIME
: execution date of the report
TDQ_SET_INDVALUE
-
SET_INDV_PK
: primary key (artificial) -
TIME_PK
: foreign key to dimensionalTDQ_DAY_TIME
table -
CAL_PK
: foreign key to dimensional calendar table -
AN_PK
: foreign key to dimensionalTDQ_ANALYSIS
table -
IND_PK
: foreign key toTDQ_INDICATOR_DEFINITION
table -
SIV_INT_VALUE
: indicator count value -
AN_DURATION
: analysis duration -
AN_RUNTIME
: execution date of the analysis -
VERSION
: reference to version number in tableTDQ_TABLE_ANALYZED_SET
-
SIV_ROW_COUNT
: total row count -
SIV_THRESH_OK
: flagY
orN
orU
which indicates whether this indicator respects the indicator threshold.Y
means yes,N
means no,U
means undefined -
SIV_THRESH_LOW
: lower value of indicator threshold -
SIV_THRESH_HI
: higher value of indicator threshold -
SIV_THRESH_PERC_OK
: flagY
orN
orU
which indicates whether this indicator respects the defined percentage threshold.Y
means yes,N
means no,U
means undefined -
SIV_THRESH_PERC_LOW
: lower threshold of indicator value in percentage relative to the total row count -
SIV_THRESH_PERC_HI
: higher threshold of indicator value in percentage relative to the total row count -
TABLE_PK
: reference to the table containing the analyzed elements -
IND_PARENT_PK
: link the child indicator to its parent indicator -
ELT_PK
: link to the column -
REP_DURATION
: the duration of the report -
REP_RUNTIME
: execution date of the report
TDQ_VALUES
-
VAL_PK
: primary key (artificial) -
VAL_STRING
: value (among the possible values in frequency tables)
TDQ_PRODUCT
-
PR_VERSION
: contains the version number of the release of TDQ
TDQ_TABLE_ANALYZED_SET
-
AN_SET_PK
: primary key -
VERSION
: version of analysis determined by column set variations -
ELT_PK
: foreign key to dimensional tableTDQ_ANALYZED_ELEMENT
-
AN_PK
: foreign key to dimensional tableTDQ_ANALYSIS
TDQ_MIGRATION
-
ID
: primary key (artificial) -
MIGRATION_NAME
: the name of migration -
PREVIOUS_VERSION
: the previous product version -
UPDATE_VERSION
: the updated product version -
MIGRATION_DATE
: the migration date