Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
2001	40	40	39	39	32	38	1842	98989	100831	98.173	97.500	97.835	39	0	0
2004	64	64	56	56	49	55	2507	151230	153737	98.369	87.500	92.617	56	0	0
2007	110	110	109	109	100	109	4171	292425	296596	98.594	99.091	98.842	109	0	0
2010	100	100	100	100	98	99	4720	274846	279566	98.312	100.000	99.149	100	0	0
2012	109	109	109	109	107	109	7766	411751	419517	98.149	100.000	99.066	109	0	0
2013	158	158	158	158	153	157	11163	547981	559144	98.004	100.000	98.992	158	0	0
2014	170	170	170	170	168	170	10117	576323	586440	98.275	100.000	99.130	170	0	0
2015	198	198	198	198	197	198	12411	684548	696959	98.219	100.000	99.102	198	0	0
total	949	949	939	939	904	935	54697	3038093	3092790	98.231	98.946	98.588	939	0	0

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 1.5348666666666666 minutes with 8 cores

computed on: Sun Sep 25 19:35:26 CEST 2016 from: METADONNEES_SEM_140514.txt