Software » EEA website systems

Steps for Dataservice 2.0 migration and deployment:

[[Image(http://www.allianceit.ca/images/data_migration.jpg)]]

1. '''Pre Dataservice migration'''
    1. ~ Mount SAN on Sardine for file dump (100GB needed)~
    1. ~'''1 day'''[Peter] Make file dump~
    1. ~ Make XML dump~
    1. ~ Mount SAN on production (100GB needed)~
    1. ~ Add path of files dump to eea.dataservicemigration config~
    1. ~ Update/install Ghostscript to version 8.64 #2786~
    1. ~ Add "eea_data_workflow" workflow defined on Whiteshark on eea.dataservice product~
    1. ~ Configure buildout for dataservice and cop15design~
    1. ~ add the configuration for the blob files partition~
    1. ~ Add production blob path to buildout cfg~
    1. ~ Udate 'live data maps' content (remove duplicates) and rewrite ruls~
    1. ~ Add rewrite rules as in #2613~
       1. ~''rewrite rules are in place on both redsquirrel and graysquirrel - latest version is committed into the svn''~
    1. ~ release eggs~
    1. ~ final tests on pre-production (whiteshark) with latest data.fs~
  1. '''[1 day] Dataservice migration'''
    1. ~ follow HA update procedure [wiki:UpgradeHASteps] and do only svn up and buildout (Remove products/jquery products/EEAContentTypes and any products/*.OLD if they exist)~
    1. ~ restart memcached~
    1. ~ follow HA procedure once more, for migration dataservice on service instance~
    1. ~ restart memcached on second machine~
    1. ~ Create main "data-and-maps" folder struture on production based on the existing one from whiteshark~
    1. ~ customize javascript or reduce number of news to ONE.~
    1. ~ install eea.design~
       1. ~ add https://svn.eionet.europa.eu/projects/Zope/changeset/14960 changes in custom ~
       1. ~ customize frontpage_view and add a condition "python:request.get('LANGUAGE','en')  'en'" around the campaing/promotions code~
       1. ~ add campaign promo and graphic as https://svn.eionet.europa.eu/projects/Zope/ticket/2729, graphic from Marie COM1. (http://www.webdev.eea.europa.eu/?force_campaign) ~
       1. ~ move eea_design layer for CMS skin above eeadesign2006_green~
       1. ~ customize footer.pt, remove second line "Our task is..."~
    1. ~ Follow [https://svn.eionet.europa.eu/repositories/Zope/trunk/eea.dataservicemigration/eea/dataservicemigration/README.txt README.txt] ~
  1. '''After dataservice migration'''
    1. ~ Create faceted search by exporting the existing one from whiteshark, import any other zexp.~
    1. [Antonio] Add cron job for convert all figures ( see [https://svn.eionet.europa.eu/repositories/Zope/trunk/eea.dataservice/trunk/eea/dataservice/doc/convert_figures.txt convert_figures.txt] )
    1. [Alec and Antonio] Set google analitic script(s) for "Top downloaded" porlet(s)
       1.  ~install eea.google~
       1. set scripts
    1. [Alec] Fix imported content exceptions after import (check Zope log)
    1. [Alec] Check ghostscript
    1. [Antonio] Move templates figures and datasets under /templates folder
    1. ~ Change "navigation settings" to hide EEAFigure and Data~
    1. [Antonio] Enable emails sent by workflow
    1. [Antonio] Add data service content managers users
  1. '''Final release: Make data service live'''
    1. [Antonio] configured new top navigation, add "networks", unpublish other structure
    1. [Thanh] enable generic dataservice rewrite rules #2613
    1. [Antonio] Update on IMS queries to images #2772
    1. [Antonio] Unpublish products and quicklinks folder, keep networks folder, and education. 
    1. [Peter] enable 404 redirect based on GID #2785
    1. [Peter] remove/adjust left navigation for pivotapp in dataservice, adjust also the breadcrumbs to contain "data and maps" as top level instead of "products" 
  1. '''Mission Completed'''

remaining issues/todos == 1. in figures, faceted "quick links" on "Europe's environment - The fourth assessment (0)" while on tags it gives result: http://www.eea.europa.eu/data-and-maps/figures#c15=all&c14=State+of+the+environment+report+1-2007&b_start=0
1. ~_{use same header on frontpage as for subpages = search in top green bar, on the right}~
1. ~_{'''HIGHEST''' [alec] no original image source file for around 150 figures, see example http://www.eea.europa.eu/data-and-maps/figures/household-consumption-expenditure-eu15, only a folder found with images in filedump, instead of only original file.}~ only 12 remaining fro Peter to check
1. '''HIGHEST''' [alec] no-images files must not show as album_view, rather showing as downloadable file: see example http://www.eea.europa.eu/data-and-maps/figures/emission-trends-of-ammonia-eea-member-countries-eu-27-member-states. same issue here http://www.eea.europa.eu/data-and-maps/figures/term28-modelled-specific-emissions-of-voc-per-passenger-km-or-tonne-km-and-per-mode-of-transport-2
1. '''HIGHEST''' [alin or sasha] @faceted_counter and @tagscloud_counter don't have cache headers under data-and-maps/data and data-and-maps/figures, there is a rule for dataservice and for publications that are the same.
1. [sasha or marinis] cache should be more then 1 hour for most dataservice file when squid cache is larger
1. [alec] second zoom on figures in IE8 is not working
1. ~<sub>'''BLOCKER''' [adrian/sasha] plenty of proxy errors on [http://www.eea.europa.eu/data-and-maps/figures figures] but not on [http://www.eea.europa.eu/data-and-maps/data data], both faceted query and each figure gets proxy errors. both as anonymous or authenticated, '''we never got proxy errors on test environment whiteshark (http://www.webdev.eea.europa.eu/data-service/figures) either as anonymous or authethicated''' and it is using blob on SAN. So the issue are the difference between production server side and whitshark server side, this could be:
1. SAN vs NFS
1. file storage strategy BUSHY vs. LAWN</sub>~