Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1988	6	6	4	4	2	2	1165	19626	20791	94.397	66.667	78.145	0	4	0
1989	10	10	10	10	7	6	2609	48440	51049	94.889	100.000	97.378	0	9	1
1990	3	3	3	3	2	2	974	18071	19045	94.886	100.000	97.376	0	3	0
1991	11	11	8	8	3	4	3540	47612	51152	93.079	72.727	81.654	0	8	0
1992	6	6	6	6	4	3	2906	38551	41457	92.990	100.000	96.368	0	6	0
1993	11	11	11	11	3	7	2864	46091	48955	94.150	100.000	96.987	0	10	1
1994	7	7	6	6	1	2	4024	55469	59493	93.236	85.714	89.317	0	6	0
1995	6	6	6	6	2	5	1534	26280	27814	94.485	100.000	97.164	0	5	1
1996	4	4	4	4	1	2	517	11842	12359	95.817	100.000	97.864	0	4	0
1997	9	9	9	9	3	8	2334	56623	58957	96.041	100.000	97.981	0	9	0
1998	3	3	3	3	1	3	880	17870	18750	95.307	100.000	97.597	0	3	0
1999	13	13	12	12	4	6	5417	78263	83680	93.527	92.308	92.913	0	12	0
2000	5	5	5	5	3	2	570	9174	9744	94.150	100.000	96.987	0	5	0
2001	14	14	13	13	3	9	5291	82967	88258	94.005	92.857	93.428	0	13	0
2002	3	3	3	3	1	2	549	19821	20370	97.305	100.000	98.634	0	3	0
2003	4	4	4	4	3	1	621	18240	18861	96.707	100.000	98.326	0	4	0
2004	6	6	6	6	4	5	1445	42652	44097	96.723	100.000	98.334	1	5	0
2005	18	18	15	15	14	12	2062	71965	74027	97.215	83.333	89.740	1	14	0
2006	18	18	18	18	7	10	5796	117896	123692	95.314	100.000	97.601	1	17	0
2007	29	29	19	19	8	8	1895	41710	43605	95.654	65.517	77.768	5	6	8
2008	21	21	19	19	15	16	3455	145926	149381	97.687	90.476	93.943	0	19	0
2009	9	9	9	9	4	1	4982	72061	77043	93.533	100.000	96.659	0	9	0
2010	16	16	14	14	7	8	2053	56285	58338	96.481	87.500	91.771	1	13	0
total	232	232	207	207	102	124	57483	1143435	1200918	95.213	89.224	92.122	9	187	11

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 0.8095666666666667 minutes with 8 cores

computed on: Sun Sep 25 19:25:56 CEST 2016 from: METADONNEES_MODULAD_150413.txt