Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1996	14	14	14	14	3	10	2477	102293	104770	97.636	100.000	98.804	14	0	0
1997	23	23	23	23	5	18	2797	144666	147463	98.103	100.000	99.043	23	0	0
1998	12	12	11	11	8	11	2158	69395	71553	96.984	91.667	94.250	11	0	0
1999	35	35	35	35	11	27	4194	180676	184870	97.731	100.000	98.853	35	0	0
2000	27	27	26	26	9	22	3705	136158	139863	97.351	96.296	96.821	26	0	0
2001	21	21	10	10	10	10	1092	49353	50445	97.835	47.619	64.059	10	0	0
2002	41	41	33	33	31	32	3816	181547	185363	97.941	80.488	88.361	33	0	0
2003	28	28	25	25	25	25	1724	123060	124784	98.618	89.286	93.720	25	0	0
2004	56	56	53	53	53	53	4008	283776	287784	98.607	94.643	96.584	53	0	0
2005	127	127	126	126	123	126	9624	681205	690829	98.607	99.213	98.909	126	0	0
2006	73	73	72	72	71	72	7024	403859	410883	98.291	98.630	98.460	72	0	0
2007	131	131	130	130	128	129	12664	709398	722062	98.246	99.237	98.739	130	0	0
2008	114	114	114	114	114	114	11829	679748	691577	98.290	100.000	99.137	114	0	0
2009	163	163	163	163	161	163	18006	1032556	1050562	98.286	100.000	99.136	163	0	0
2010	125	125	124	124	122	124	14139	800005	814144	98.263	99.200	98.729	124	0	0
2011	149	149	148	148	148	148	18244	990581	1008825	98.192	99.329	98.757	148	0	0
2012	139	139	139	139	137	139	16654	936413	953067	98.253	100.000	99.119	139	0	0
2013	205	205	205	205	203	205	23926	1187966	1211892	98.026	100.000	99.003	205	0	0
2014	225	225	225	225	223	224	26534	1296916	1323450	97.995	100.000	98.987	225	0	0
2015	312	312	312	312	311	312	33278	1547331	1580609	97.895	100.000	98.936	312	0	0
total	2020	2020	1988	1988	1896	1964	217893	11536902	11754795	98.146	98.416	98.281	1988	0	0

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 5.9311 minutes with 8 cores

computed on: Sun Sep 25 18:22:02 CEST 2016 from: METADONNEES_EMNLP_140410.txt