Accessing the semantic concepts stored in the ontology repository

The ontology repository built on the Elasticsearch server can store hundreds of semantic concepts and attributes which you can increase every time you define and run a Semantic-aware analysis in the Profiling perspective of Talend Studio.

You can access the list of the semantic concepts and their attributes stored in the ontology repository and applied on several domains including customer, company, geography, product, finance, etc.

This procedure lets you make the ontology repository, used with Talend Studio, accessible and searchable while maintaining its unique features and strengths.

Before you begin

Download and extract the semantic_repository_content-20201211.zip file.
Talend Administration Center and the Elasticsearch server must be installed.

Initializing the data stored in the ontology repository

Before you begin

Launch Apache Tomcat which embeds your Talend Administration Center.
Launch the Elasticsearch server.

Procedure

Start Talend Studio.
From the top menu bar, select Window > Preferences to open the Preferences window.
From the Preferences window, select Talend > Profiling > Semantic-aware analysis.
If you modified the port or the cluster name, edit the parameters in the corresponding fields.
Click Check Connection to test if you can connect to the repository stored on the Elasticsearch server, and click OK.
Create and run a Semantic-aware analysis from the Profiling perspective of Talend Studio to index and enrich the ontology repository on the Elasticsearch server.

For more information about the Semantic-aware Analysis, see the Semantic-aware analysis.

Configuring Kibana in Talend Administration Center

From Talend Administration Center, you can set up the parameters of the monitoring modules that allow you to display the content of the ontology repository.

Procedure

Open your Talend Administration Center web application.
In the Menu tree view, click Configuration.
Click the Monitoring node to display the parameters.
In the Kibana URL field, type in the URL address of the Kibana application:

http://localhost:8080/kibana

http://localhost:8080/kibana is only given as example. Depending on your configuration, you may have to replace <localhost> with the IP address of the Web server application and <8080> with its actual port.

Creating the index pattern in Kibana

To be able to visualize the concepts and attributes stored in the ontology repository in Kibana, you must create an index pattern.

Procedure

In the Talend Administration Center Menu tree view, click Logging to display the Kibana dashboard, or open a Web browser and go to http://localhost:8080/kibana/#/dashboard/.
From the left panel, click Management > Kibana > Index patterns.
In the Index patterns page, click Create index pattern.
In the Index name or pattern field, enter an index name or pattern that matches the index pattern of the concepts and attributes loaded to Elasticsearch.

If you want to import the semantic_repository_content-20201211.ndjson file, enter tdq*.
Click Create to add the index pattern.

Opening the Kibana dashboard

You can open the Kibana dashboard to visualize the content of the ontology repository.

Procedure

In the Talend Administration Center Menu tree view, click Logging to display the Kibana dashboard, or open a Web browser and go to http://localhost:8080/kibana/#/dashboard/.
From the left menu bar, click Management > Kibana > Saved Objects.
Click Import and browse to the file you downloaded and extracted (semantic_repository_content-20201211.zip).

The semantic_repository_content-20201211.ndjson file is provided as an example of dashboard that displays visualizations related to the ontology repository.

You can define your own dashboards and visualizations.
From the left menu bar, click Dashboard.
Select Semantic Repository Dashboard from the list.

The dashboard displays the most frequent concepts and the attributes stored in the ontology repository.
Use the search field on top of the dashboard to search for a concept, an attribute, and filter the results listed in the dashboard.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here