Changeset 35093 for main/trunk/model-sites-dev/eurovision-lod/collect/eurovision/transform/pages/about.xsl

Timestamp:

2021-04-22T14:50:00+12:00 (3 years ago)

Author:

davidb

Message:

General text update; auto-focus param added into ssv_execute()

File:

• main/trunk/model-sites-dev/eurovision-lod/collect/eurovision/transform/pages/about.xsl (modified) (4 diffs)

main/trunk/model-sites-dev/eurovision-lod/collect/eurovision/transform/pages/about.xsl

@@ -18 +18 @@
     <gsf:script src="sites/{$site_name}/collect/{$collName}/js/jquery.show-more.js"/>
 
+    
       <div id="about-desc">
       <h2>Introduction</h2>
@@ -23 +24 @@
       <p style="padding-bottom: 10px;">
         The <a href="https://eurovision.tv">Eurovision Song
-        Content</a> is a live-broadcast televised event that
+        Contest</a> is a live-broadcast televised event that
         was first held in 1956 featuring artists singing original songs from
         7 countries.  Since then it has grown into an event involving
@@ -43 +44 @@
         The contest has grown significantly from
         that modest start with 7 countries (and one cameraman),
-        with over 40 countries competing these days—even
-        Australia takes part now, through a specially
+        with over 40 countries competing these days—Australia
+        even takes part now, through a specially
         arranged invitation. It's an annual celebration of
         European culture and the highlight of many people's
@@ -507 +508 @@
 
         <p>
-          Access to and the analysis of how countries have voted over the years
+          To fulfill our vision of developing this DL collection
+          as a rich resource through which people can explore the
+          phenomenon we went looking for voting data that was
+          available in a machine-readable format.
+          We found data compiled through a manual curation process
+          about how countries have voted going back to 1975 is available through the
+          <a href="https://www.kaggle.com/datagraver/eurovision-song-contest-scores-19752019">Kaggle website as an Excel spreadsheet</a>.
+        </p>
+        <p>
+          To incorporate this as metadata into the DL, we wrote
+          some Python code to transform the data into the internal
+          serialized metadata format used by Greenstone.  Prior to
+          this project, the only serialized form for this was XML,
+          which is processed by the MetadataXML plugin.  As it was
+          more convenient to generate JSON from our Python code,
+          we took the step of adding in a new plugin to
+          Greenstone3: MetadataJSON.
+        </p>
+
+        <h3>Page Scraping</h3>
+
+        <p>
+              Despite our best intentions work soley with
+              machine-readable data—primarily as you have seen in the
+              form of Linked Open Data, but also utilizing a
+              spreadsheet of voting data—to form the Eurovision DL,
+          in looking to expand the metadata in the DL to cover
+          details concerning the draw position of acts, and their
+          overall placing, we have resorted to page-scraping
+          content from Wikipedia itself.  This was because such
+          information was not part of the entity extraction
+          process that occurs when Wikipedia is mapped to DBpedia.
+        </p>
+
+        <p>
+          A review of Wikipedia article pages about the event in
+          any given year showed these pages to be especially well
+          curated, and included a table in each that listed the
+          information we sought.  While there was some variation
+          in how this table was expressed in HTML, with a
+          considerably portion of the heavy lifting being done by
+          the Python library BeautifulSoup4, it was not too
+          complex a task to develop a program that extracted this
+          information and turned it into the newly developed
+          Greenstone JSON metadata format.
+        </p>
           
-          To fulfill our vision of developing this DL collection as a rich resource to
-          through which people can explore the phenomenon.
-          
-        </p>
+        <h3>Patching in Missing Data</h3>
+
         
-        <h3>Patching in Missing Data: Page Scraping</h3>
-
-        
-        <p>
-          Despite our best intentions to work solely with ....
-          .. missing categories ...
-
-          totting up how many entrie per year ...
-          thousands of entries
-          
+        <p>
+          Another difficulty we have encountered is that
+          not every country who had an entry in Eurovision
+          in a given year has its own standalone article page.
+          This leads to missing entries in the category
+          page for the contest in a given year, which is
+          problematic to us, because it is this category
+          information that we draw upon in our SPARQL query
+          to populate the DL with all the acts.
+        </p>
+        <p>
+          The information about all the countries competing
+          in a given year does, however, appear in the
+          article page for the contest in that year.  In fact
+          it's in the same table we targetted to extract out
+          draw position and placement.  We therefore
+          wrote a further page-scraping program to compare
+          the countries in that table with the countries
+          listed on the category page for the contest in
+          that year.  For any entries we find in the
+          table, but not in the Category page, we
+          produce a metadata record for the DL
+          with basic information about the entry:
+          country, year, song title, artist,
+          draw-position, placement, and (where available)
+          their total score.
+        </p>
+        <p>
+          Comparable with the problem titles and artist/entrants,
+          we have formulated a SPARQL query that enumerates
+          these missing category entrants:
+          <!--
           We took the opportunity to add in further fields: Performing Position, Placement, Voting Total, thumbnail flag image.
+
+
+          An unintended side-affect of this is that we have also been able to expand
+          -->
+
           
           <ul>