Project

General

Profile

Feature #85859

Improve SDS tagging for indicators to facilitate import to BISE

Added by Christian-Xavier Prosperini 5 months ago. Updated 4 days ago.

Status:
WIP-debt: Needs clarifications
Priority:
Normal
Assignee:
Category:
BISE - new features
Target version:
Start date:
2017-06-09
Due date:
% Done:

20%

Estimated time:
Keywords:
Complexity:

Description

The other problem in the topic pages is to harvest the indicators from SDS.
The indicators are poorly tagged and their descriptions need to be updated in order to be properly imported in BISE.
In that case we have a turn around: hard code the url of the indicator in the sparql query. Anyway, List here the issues we have with the indicators tagging and how we can solve them.

Edit: After a talk with Antonio, he mentioned that what we need is just to add the sub topics as tags to SDS. This is an easy task that can be done at the EEA by Marie or Bekir.

Tagging objects 20170911.xlsx (16.4 KB) Tagging objects 20170911.xlsx Sabine Roscher, 2017-09-11 17:37
Tagged objects.xlsx (27.6 KB) Tagged objects.xlsx Ben Delbaere, 2017-11-02 10:24

Related issues

related to BISE - Task #85857: Improve SDS tagging for visualizations to facilitate import to BISEWIP-debt: Needs clarifications2017-06-09

History

#1 Updated by Christian-Xavier Prosperini 5 months ago

  • Description updated (diff)

#2 Updated by Antonio De Marinis 5 months ago

@miruna:
This is what I understood.
The issue:we miss "biodiversity sub-topics tagging" on EEA indicators in IMS that are specific and useful for categorising indicators in BISE.

Than I proposed the following.

1. EDW with Content experts creates an excel list of EEA indicators with specific biodiversity tags needed.

2. This list is then delivered to me, I can then ask a member of the COM or IMS team to help out tagging the Indicators as needed by BISE.

3. After all indicators are tagged, the last step is for me to update SDS with the news tag. Requires a ping sds for all indicators.

Another alternative solution, which may be easier to maintain is the following :

Each indicator has a unique product ID, which does not change over versions and time. BISE can keep a local mapping between each indicator and some specific tags or categories needed in BISE. This info could also be pushed to SDS in RDF.

I don't know what exact issue we are solving but I hope the above helps so far I understood.

#3 Updated by Christian-Xavier Prosperini 3 months ago

The indicators will be edited at the EEA by me or someone in COM with editor rights.
So the best thing, is to write in this ticket the link of the indicators and the new tags and assign the ticket to me.
After talking with Antonio, we propose the following way: For editor:
  • Put new tags on all versions (all states)
  • Edit using "base_edit"->categorizations
  • Once done, send the ticket to Antonio to ping SDS.

#4 Updated by Christian-Xavier Prosperini 3 months ago

  • Assignee changed from Miruna Badescu to Sabine Roscher

#5 Updated by Sabine Roscher 3 months ago

  • Assignee changed from Sabine Roscher to Christian-Xavier Prosperini

Christian-Xavier Prosperini wrote:

The indicators will be edited at the EEA by me or someone in COM with editor rights.
So the best thing, is to write in this ticket the link of the indicators and the new tags and assign the ticket to me.
After talking with Antonio, we propose the following way:

For editor:

I don't have sufficient rights to see the wiki page with the general rules
https://taskman.eionet.europa.eu/projects/content/wiki/Tagging

Can you pls assign the necessary rights for user roschsab.

#6 Updated by Antonio De Marinis 3 months ago

@sabine

I copy and paste the guidelines below:

General rules for keywords/tags:

If possible please choose tags which are already in the list. If you need to create a new tag:

  • always lower caps, except for proper nouns. For acronyms, use the most common way of capitalizing them. If in doubt, please refer to the EEA writing manual: http://intranet/Communication/editing/Document%20Library/EEA%20writing%20manual.pdf
  • keep as short as possible: never more than 3 words for each tag
  • use nouns, not adjective or verbs
  • use acronyms only if they are well known
  • use UK English spelling
  • use words as precise as possible, not too general concepts (for example, tag with "brackish water," not "water" )
  • tags should be meaningful by themselves: tag with "energy efficiency", not with "efficiency" and "energy"
  • use plural for things that can be counted, and singular for uncountable (ex: "greenhouse gases", "cars", "air", "energy"). Singular or plural can have different meanings, use the form most appropriate depending on the context (ex: "water" vs "international water*s*")
  • do not tag with geographical information in the "keywords" field. Geographical tags should go in the dedicated field.
  • make use of thesauri like GEMET to find synonym and related broader terms

In general, try to use words that the users would use when looking for the item you are tagging, and add synonyms.

For more information:

http://www.willpowerinfo.co.uk/thesprin.htm

http://publish.uwo.ca/~craven/677/thesaur/main01.htm

#7 Updated by Sabine Roscher 2 months ago

We have prepared a first example of the list with tagged indicators/graphs (see file "tagging objects 20170911.xlsx"). While doing so we came across some questions that need to be clarified before we continue to go through all indicators/graphs in the BDC.

1. What is the best format for the EEA to receive the data? As currently done with x-marks in separate columns; as single column with comma-separated multiple entries per cell; other?
2. If we want objects to appear under respective BISE topics (precooked search), do topics and tags need to be separate columns in the table or can they be mixed? Is the current correspondence table (tags vs topics) of help here?
3.Do the terms on the bottom of objects in the BDC (called 'Filed under') represent keywords/tags? If yes, what is the origin of these? If no, how can we see the tags of the current objects?

The work was done by Ben Delbaere, can he be added to this ticket? The email account is "", Ben does not EIONET account.

#8 Updated by Miruna Badescu 2 months ago

  • Status changed from New to In Progress
  • Assignee changed from Christian-Xavier Prosperini to Miruna Badescu
  • % Done changed from 0 to 10

I'm first going to respond to the last two question. I'll come back with more answers.

Sabine Roscher wrote:

3.Do the terms on the bottom of objects in the BDC (called 'Filed under') represent keywords/tags? If yes, what is the origin of these? If no, how can we see the tags of the current objects?

Yes, they do. When editing content, the EEA website offers its content providers an autocomplete of terms from the existing glossary. But other terms can be added, even if they are not in the list.

The work was done by Ben Delbaere, can he be added to this ticket? The email account is "", Ben does not EIONET account.

Turns out that Ben has an Eionet account, so I added him as watcher in this ticket and Reporter for BISE issues.

#9 Updated by Sabine Roscher 2 months ago

Miruna Badescu wrote:

I'm first going to respond to the last two question. I'll come back with more answers.

Sabine Roscher wrote:

3.Do the terms on the bottom of objects in the BDC (called 'Filed under') represent keywords/tags? If yes, what is the origin of these? If no, how can we see the tags of the current objects?

Yes, they do. When editing content, the EEA website offers its content providers an autocomplete of terms from the existing glossary. But other terms can be added, even if they are not in the list.

The work was done by Ben Delbaere, can he be added to this ticket? The email account is "", Ben does not EIONET account.

Turns out that Ben has an Eionet account, so I added him as watcher in this ticket and Reporter for BISE issues.

Hi Miruna, this is an outdated Eionet account for Ben. The email and institution is not valid anymore.

#10 Updated by Christian-Xavier Prosperini 2 months ago

@Mette came to see me about it. We will give him a new account and disabled the old one.

#11 Updated by Mette Palitzsch Lund 2 months ago

Christian-Xavier Prosperini wrote:

We will give him a new account and disabled the old one.

Thank you @Christian :)

#12 Updated by Sabine Roscher about 2 months ago

Dear Miruna

can you response to the other questions, so that we know how to delivery the results.

Thanks
Sabine

Miruna Badescu wrote:

I'm first going to respond to the last two question. I'll come back with more answers.

Sabine Roscher wrote:

3.Do the terms on the bottom of objects in the BDC (called 'Filed under') represent keywords/tags? If yes, what is the origin of these? If no, how can we see the tags of the current objects?

Yes, they do. When editing content, the EEA website offers its content providers an autocomplete of terms from the existing glossary. But other terms can be added, even if they are not in the list.

The work was done by Ben Delbaere, can he be added to this ticket? The email account is "", Ben does not EIONET account.

Turns out that Ben has an Eionet account, so I added him as watcher in this ticket and Reporter for BISE issues.

#13 Updated by Miruna Badescu about 2 months ago

@Sabine, sorry for the delay, I was waiting for Ben to have his new Eionet account and be able to follow the discussion. In any case:

1. What is the best format for the EEA to receive the data? As currently done with x-marks in separate columns; as single column with comma-separated multiple entries per cell; other?

The import is not going to be automatic for a while, so the current format will do for now, since it's comprehensible.

2. If we want objects to appear under respective BISE topics (precooked search), do topics and tags need to be separate columns in the table or can they be mixed? Is the current correspondence table (tags vs topics) of help here?

The current correspondence will be useful in the future for two reasons: we could improve the linking of the terms and content in the EEA portal and it can show how far we are from coming up with a unified tagging approach from BISE and the EEA portal.

#14 Updated by Miruna Badescu about 2 months ago

  • Assignee changed from Miruna Badescu to Sabine Roscher

#15 Updated by Antonio De Marinis about 2 months ago

@sabine, @miruna
A possible solution I see is like this.
I can give editing rights in IMS to one ETC member and instruction in the form of a simple video/wiki on how to add new tags to indicators.
Then you can go and tag each indicator according to your needs.

If so, let me know the Eionet account of the ETC member that will tag indicators.

#16 Updated by Miruna Badescu about 2 months ago

@Antonio, fine by me for the indicators. The question remains what to do for the visualizations - in addition to existing visualizations in the EEA portal, Sabine wants to create some visualizations in Tableau and link them in the EEA portal. Should she send the list visualizations and their tags on the ticket or can they be created directly by her/the ETC?

#17 Updated by Antonio De Marinis about 2 months ago

Miruna Badescu wrote:

@Antonio, fine by me for the indicators. The question remains what to do for the visualizations - in addition to existing visualizations in the EEA portal, Sabine wants to create some visualizations in Tableau and link them in the EEA portal. Should she send the list visualizations and their tags on the ticket or can they be created directly by her/the ETC?

@miruna:
easiest and quickest is that they create the Tableau Dashboard themselves into the EEA CMS, however the final approving and publishing must be done by an EEA staff.
I will come back with instructions (in 1-2 days) once I have double checked this here at EEA. ok?

#18 Updated by Miruna Badescu about 2 months ago

Ok from my side, now it's for Sabine to confirm.

#19 Updated by Sabine Roscher about 2 months ago

  • Assignee changed from Sabine Roscher to Antonio De Marinis

We think it is possible form our side to do the tagging directly in user interface you provide (IMS). Therefore please give us instructions as proposed via video.

#20 Updated by Ben Delbaere about 1 month ago

Please may I remind you to provide the video/wiki referred to, for me to be able to use the IMS. For now I continue tagging indicators with the Excel sheet.

#21 Updated by Miruna Badescu about 1 month ago

@Antonio, this is becoming more relevant these days, since the final BISE meeting for this year's contract is approaching and it would be nice to show this part with real data then.

#22 Updated by Antonio De Marinis about 1 month ago

@ben, @miruna

Very good that you are using the excel for now. I have been too busy, well it is the time of the year where everything has to be done at the same time.

So, next week I should be able to set aside some time for the instructions.

Antonio

#23 Updated by Antonio De Marinis about 1 month ago

  • Assignee changed from Antonio De Marinis to Sabine Roscher
  • % Done changed from 10 to 20

@miruna, @sabine, @ben:

as promised, here the instructions as video:
https://youtu.be/jIWP09i_xyk

please note, forgot to add in the video. only the latest version of an indicator needs to be tagged. When a new version of the indicator is made, the keywords from previous versions are carried over, so keywords need to be added only once.

both Sabine and Ben from ETC have editing rights in IMS.
therefore I reassign this ticket to Sabine for the actual tagging excercise.

#24 Updated by Ben Delbaere about 1 month ago

  • Assignee changed from Sabine Roscher to Antonio De Marinis

Thanks a lot @Antonio. I tried it and it all works and seems straightforward. Only the step in which I replace the last part of the URL by 'base_edit' takes a long time to load. I'll start tagging tomorrow.

#25 Updated by Antonio De Marinis 25 days ago

  • Assignee changed from Antonio De Marinis to Ben Delbaere

Ben Delbaere wrote:

Thanks a lot @Antonio. I tried it and it all works and seems straightforward. Only the step in which I replace the last part of the URL by 'base_edit' takes a long time to load. I'll start tagging tomorrow.

@ben
very good, thanks!
Yes adding the "base_edit" takes long time, sorry for that, but it works.
Please, keep the ticket assigned to you as long as the task is running and not completed. Assignee is used to indicate who is in acting on the ticket righ now. Once this task is completed you can re-assign the ticket back to us (Christian or Miruna) and change the status to "Acceptance/demo" and we can then do the other technical parts in BISE.

Kind regards

#26 Updated by Ben Delbaere 19 days ago

@Antonio: I cannot edit certain objects, they only give options such as contents, view, syndication, aliases, cache. How come, and can this be changed?

#27 Updated by Antonio De Marinis 19 days ago

Ben Delbaere wrote:

@Antonio: I cannot edit certain objects, they only give options such as contents, view, syndication, aliases, cache. How come, and can this be changed?

@ben
Please give me a link of one of those that you cannot edit. Thanks

#29 Updated by Ichim Tiberiu 17 days ago

Would it be possible to have a list of objects that have been edited? I'd like to start working with "real data", to query the SDS for real tags and to organize a sample topic page.

#30 Updated by Ben Delbaere 17 days ago

I attach an overview of those objects that have been tagged so far and those that I for some technical reason cannot tag. Can I no longer edit any of these as from now?

#31 Updated by Ichim Tiberiu 16 days ago

You can edit those, no worries. I just needed some "real data" to be able to do tests. But as it's just tests, no worries if you change something, nothing will break.

#32 Updated by Antonio De Marinis 13 days ago

  • Status changed from In Progress to WIP-debt: Needs clarifications

Ben Delbaere wrote:

@Antonio: https://www.eea.europa.eu/data-and-maps/daviz/annual-land-take-by-several-1#tab-chart_1

The above link is not an Indicator in IMS. The above is "just" a figure/data visualisation object, which cannot be edited once has reached the final published state.

this ticket was about how to tag "Indicators", all the indicators are in this location https://www.eea.europa.eu/data-and-maps/indicators/

@ben
could you please clarify why you wanted to tag a Data visualisation object? Is this a new requirement?
I do know that the definition of indicators varies among many users, and often just one Chart is seen as an indicator. However at EEA we define Indicators specifically as those found under https://www.eea.europa.eu/data-and-maps/indicators/ which containes the assessment part as well, it is not just about figures. Maybe this definition is the cause of confusion on what to tag?

#33 Updated by Ben Delbaere 13 days ago

@Antonio

Thanks for the clarification. Indeed the confusion relates to terminology. I'm familiar with the indicators and they can easily be tagged. The task was to tag all objects that reside in the BDC, which includes a variety of things. Clearly this is not possible for data visualisations or publications. During the BISE technical meeting this Wednesday we'll clarify the scope of the task.

#34 Updated by Ichim Tiberiu 9 days ago

  • related to Task #85857: Improve SDS tagging for visualizations to facilitate import to BISE added

#35 Updated by Antonio De Marinis 4 days ago

Ben Delbaere wrote:

@Antonio

Thanks for the clarification. Indeed the confusion relates to terminology. I'm familiar with the indicators and they can easily be tagged. The task was to tag all objects that reside in the BDC, which includes a variety of things. Clearly this is not possible for data visualisations or publications. During the BISE technical meeting this Wednesday we'll clarify the scope of the task.

@Ben
we have also discussed it here. things are more clear now. So, for DaViz and hopefully publications we decided to give you elevated rights to edit tags on published content of the site. I'll come back when this is done (today).

#36 Updated by Antonio De Marinis 4 days ago

Antonio De Marinis wrote:

@Ben
we have also discussed it here. things are more clear now. So, for DaViz and hopefully publications we decided to give you elevated rights to edit tags on published content of the site. I'll come back when this is done (today).

it requires that I create a new group and change the permissions accordingly. This will take some days.

Also available in: Atom PDF