Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1992	28	28	28	28	10	24	3996	145213	149209	97.322	100.000	98.643	28	0	0
1993	29	29	29	29	13	22	4491	166263	170754	97.370	100.000	98.667	29	0	0
1994	28	28	27	27	14	25	2677	132112	134789	98.014	96.429	97.215	26	0	1
1995	30	30	28	28	16	25	3696	144981	148677	97.514	93.333	95.378	28	0	0
1996	45	45	45	45	17	39	4101	167910	172011	97.616	100.000	98.794	44	0	1
1997	58	58	57	57	28	49	5498	220283	225781	97.565	98.276	97.919	57	0	0
1998	61	61	61	61	28	55	4837	266532	271369	98.218	100.000	99.101	61	0	0
1999	75	75	72	72	38	65	5199	312887	318086	98.366	96.000	97.168	72	0	0
2000	73	73	39	39	27	38	2378	169374	171752	98.615	53.425	69.304	39	0	0
2001	85	85	60	60	32	58	3059	249852	252911	98.790	70.588	82.341	60	0	0
2002	100	100	86	86	46	83	4461	364615	369076	98.791	86.000	91.953	86	0	0
2003	99	99	94	94	45	86	6406	411949	418355	98.469	94.949	96.677	94	0	0
2004	105	105	101	101	53	94	6078	449794	455872	98.667	96.190	97.413	101	0	0
2005	131	131	128	128	78	123	7775	511465	519240	98.503	97.710	98.105	128	0	0
2006	121	121	121	121	83	118	6553	488075	494628	98.675	100.000	99.333	121	0	0
2007	106	106	106	106	71	98	7037	416907	423944	98.340	100.000	99.163	106	0	0
2008	61	61	61	61	41	55	5293	266548	271841	98.053	100.000	99.017	60	0	1
2009	77	77	77	77	58	69	5479	320302	325781	98.318	100.000	99.152	76	0	1
2010	67	67	67	67	55	63	3881	259469	263350	98.526	100.000	99.258	67	0	0
2011	125	125	124	124	91	116	7470	404551	412021	98.187	99.200	98.691	124	0	0
2012	96	96	96	96	64	83	6415	318333	324748	98.025	100.000	99.002	96	0	0
2013	72	72	72	72	59	67	4065	216240	220305	98.155	100.000	99.069	72	0	0
2014	84	84	84	84	64	81	5055	258386	263441	98.081	100.000	99.031	84	0	0
2015	91	91	91	91	66	83	4711	268169	272880	98.274	100.000	99.129	90	0	1
total	1847	1847	1754	1754	1097	1619	120611	6930210	7050821	98.289	94.965	96.599	1749	0	5

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 3.453733333333333 minutes with 8 cores

computed on: Sun Sep 25 20:06:43 CEST 2016 from: METADONNEES_TREC_140901.txt