|
|
@34097
|
4 years |
ak19 |
Open office version of similarly named spreadsheet, just with columns …
|
|
|
@34089
|
4 years |
ak19 |
So far accumulated URLs to docs on Google scholar about or somewhat …
|
|
|
@34011
|
4 years |
ak19 |
Piechart data for sites prepared for crawling and the piecharts for these
|
|
|
@34007
|
4 years |
ak19 |
Prepared more data for the piecharts. This time for empty web pages vs …
|
|
|
@34006
|
4 years |
ak19 |
Committing more data I've collected for generating pie charts and the …
|
|
|
@34004
|
4 years |
ak19 |
Renaming csv file to have csv extension
|
|
|
@34003
|
4 years |
ak19 |
Redid the file with info on empty URL web pages as a csv file with …
|
|
|
@34001
|
4 years |
ak19 |
Tentative total urls from common crawl 12 month cral data.
|
|
|
@33999
|
4 years |
ak19 |
Common crawl 12 month urls and CC provided stats
|
|
|
@33987
|
4 years |
ak19 |
Output of re-running NutchTextDumpToMongoDB to print out which web …
|
|
|
@33986
|
4 years |
ak19 |
Dr Bainbridge investigated the original data set more
|
|
|
@33985
|
4 years |
ak19 |
Data to back the piechart I need to make that will illustrate how we …
|
|
|
@33980
|
4 years |
ak19 |
Additional comments
|
|
|
@33979
|
4 years |
ak19 |
Clearly stating that counts are of unique domains
|
|
|
@33977
|
4 years |
ak19 |
Added something on precision vs recall being applicable to our …
|
|
|
@33976
|
4 years |
ak19 |
Adding in what I could remember of Dr Bainbridge's statement about the …
|
|
|
@33966
|
4 years |
ak19 |
Added the origSequence and basicDomain columns to the random 260 web …
|
|
|
@33964
|
4 years |
ak19 |
2 records were missing a value for the qualityLevel column.
|
|
|
@33962
|
4 years |
ak19 |
2 fields changed, as one was missed out and the other incorrectly …
|
|
|
@33960
|
4 years |
ak19 |
Reviewed all the random sample web page URLs marked …
|
|
|
@33951
|
4 years |
ak19 |
Reviewed the qualityLevel column where LITTLE_TEXT was assigned.
|
|
|
@33950
|
4 years |
ak19 |
Reviewed the qualityLevel column where MIXED_TEXT was assigned.
|
|
|
@33949
|
4 years |
ak19 |
Reviewed the qualityLevel column where NAV was assigned.
|
|
|
@33948
|
4 years |
ak19 |
Reviewed the random sampled web page URLs marked as …
|
|
|
@33947
|
4 years |
ak19 |
Some more questionmarked field values assigned.
|
|
|
@33945
|
4 years |
ak19 |
Added a 4th column for all 260 sample web page URLs and have used the …
|
|
|
@33944
|
4 years |
ak19 |
Added the isReallyInMRI column after manually inspecting the remaining …
|
|
|
@33940
|
4 years |
ak19 |
1. In order to make it easier to do the manual work of inspecting 260 …
|
|
|
@33939
|
4 years |
ak19 |
1. Old random samples file doesn't apply as we're not sampling by …
|
|
|
@33937
|
4 years |
ak19 |
New counts of manual sites after reingesting into MongoDB. Forgot to …
|
|
|
@33936
|
4 years |
ak19 |
Renaming old file to place with new counts after reingesting into MongoDB.
|
|
|
@33918
|
4 years |
ak19 |
Country codes added to each domain's URL of the manual site/domain …
|
|
|
@33916
|
4 years |
ak19 |
Updated the rest of the file after reingest
|
|
|
@33915
|
4 years |
ak19 |
Forgot to add a (manual) counts file created last week, and am now …
|
|
|
@33914
|
4 years |
ak19 |
Shortlisted just the domain sites by country into ManualShortlist2.txt …
|
|
|
@33913
|
4 years |
ak19 |
1. Adjusted table mongodb query statements to be more exact, but same …
|
|
|
@33907
|
4 years |
ak19 |
See previous commit message. This will be the file with the results …
|
|
|
@33895
|
4 years |
ak19 |
Minor rename
|
|
|
@33894
|
4 years |
ak19 |
1. Adding map, counts.json and geo-json files for 5b count of sites by …
|
|
|
@33893
|
4 years |
ak19 |
1. Left out region code column. 2. Two more sheets of work in progress …
|
|
|
@33892
|
4 years |
ak19 |
Sheets renamed and spreadsheet renamed
|
|
|
@33891
|
4 years |
ak19 |
Site level detected vs manual inspected data: working shown in file …
|
|
|
@33890
|
4 years |
ak19 |
Finished going through NZ sites listing of numPagesContainingMRI > 0 …
|
|
|
@33889
|
4 years |
ak19 |
1. Additional column: totalPagesAcrossMatchingSites. 2. Screengrab of …
|
|
|
@33886
|
4 years |
ak19 |
Minor. File rename
|
|
|
@33884
|
4 years |
ak19 |
0. Previous commit had lots of modifications, and only 2 files matched …
|
|
|
@33883
|
4 years |
ak19 |
Clarifications
|
|
|
@33878
|
4 years |
ak19 |
Better comment
|
|
|
@33877
|
4 years |
ak19 |
Reordering to have proper descending order of counts
|
|
|
@33875
|
4 years |
ak19 |
Renaming 2 more files correctly
|
|
|
@33874
|
4 years |
ak19 |
Renaming 2 files correctly
|
|
|
@33872
|
4 years |
ak19 |
1. Added the file containing the 255 random NZ page URLs to sample. 2. …
|
|
|
@33868
|
4 years |
ak19 |
With the updated code for generating the maps from 6a and 6b manual …
|
|
|
@33854
|
4 years |
ak19 |
Manually gone over around 150 webpages of sample size of 255 webpages …
|
|
|
@33851
|
4 years |
ak19 |
Deleting faulty maps. NZ numPages inMRI and containingMRI count is …
|
|
|
@33850
|
4 years |
ak19 |
Renames before deleting faulty maps. NZ numPages inMRI and …
|
|
|
@33848
|
4 years |
ak19 |
Tables of mongodb counts (1-5 table) and manual counts (6table). …
|
|
|
@33847
|
4 years |
ak19 |
indigenousblogs.com did have one page actually in Maori (an XML feed). …
|
|
|
@33846
|
4 years |
ak19 |
Cropped out the json portion
|
|
|
@33845
|
4 years |
ak19 |
Cropped out the json portion
|
|
|
@33844
|
4 years |
ak19 |
Regenerated
|
|
|
@33823
|
4 years |
ak19 |
Recommitting mongo-data folder with renamed files with numbering.
|