Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1975	110	110	109	109	26	89	5147	291792	296939	98.267	99.091	98.677	100	0	9
1976	110	110	110	110	17	99	4808	312567	317375	98.485	100.000	99.237	103	0	7
1977	113	113	113	113	24	100	4546	287754	292300	98.445	100.000	99.216	103	0	10
1978	123	122	122	122	42	107	5158	357184	362342	98.576	100.000	99.283	113	0	9
1979	137	137	137	137	43	115	7021	440349	447370	98.431	100.000	99.209	131	0	6
1980	139	139	139	139	51	123	7593	455638	463231	98.361	100.000	99.174	133	0	6
1981	206	206	206	206	63	181	11886	707923	719809	98.349	100.000	99.167	184	0	22
1982	145	145	145	145	38	136	9360	499055	508415	98.159	100.000	99.071	133	0	12
1983	230	230	230	230	70	206	15612	879640	895252	98.256	100.000	99.120	218	0	12
1984	194	194	194	194	69	161	14180	771638	785818	98.196	100.000	99.090	182	0	12
1985	257	257	257	257	101	224	20369	1095181	1115550	98.174	100.000	99.079	240	0	17
1986	219	219	219	219	141	205	20380	1185488	1205868	98.310	100.000	99.148	214	0	5
1987	251	251	251	251	142	243	17562	1239452	1257014	98.603	100.000	99.297	243	0	8
1988	243	243	243	243	150	231	19886	1390118	1410004	98.590	100.000	99.290	237	0	6
1989	271	271	271	271	128	258	23922	1585311	1609233	98.513	100.000	99.251	263	0	8
1990	264	264	264	264	162	252	23556	1608761	1632317	98.557	100.000	99.273	253	0	11
1991	382	382	382	382	160	373	42829	2204895	2247724	98.095	100.000	99.038	358	0	24
1992	369	369	369	369	209	360	46838	2377275	2424113	98.068	100.000	99.024	357	0	12
1993	48	48	48	48	26	46	5616	357293	362909	98.453	100.000	99.220	48	0	0
1994	73	73	73	73	36	70	6309	488777	495086	98.726	100.000	99.359	68	0	5
1995	53	53	53	53	27	50	5202	368677	373879	98.609	100.000	99.299	51	0	2
1996	51	51	51	51	27	48	4656	302653	307309	98.485	100.000	99.237	50	0	1
1997	60	60	60	60	50	60	3156	346463	349619	99.097	100.000	99.547	60	0	0
1998	57	57	57	57	46	57	2720	348929	351649	99.227	100.000	99.612	57	0	0
1999	74	74	74	74	67	74	3559	451691	455250	99.218	100.000	99.608	74	0	0
2000	80	80	80	80	74	79	6004	508060	514064	98.832	100.000	99.413	80	0	0
2001	90	90	90	90	88	89	7346	604839	612185	98.800	100.000	99.396	90	0	0
2002	61	61	61	61	59	59	4053	406532	410585	99.013	100.000	99.504	60	0	1
2003	76	76	76	76	75	75	5343	525068	530411	98.993	100.000	99.494	76	0	0
2004	55	55	55	55	52	52	3657	368257	371914	99.017	100.000	99.506	55	0	0
2005	112	112	112	112	110	110	8895	784394	793289	98.879	100.000	99.436	112	0	0
2006	205	205	205	205	199	200	16909	1535014	1551923	98.910	100.000	99.452	204	0	1
2007	224	224	224	224	221	222	18991	1716351	1735342	98.906	100.000	99.450	224	0	0
2008	145	145	145	145	144	144	13270	1167313	1180583	98.876	100.000	99.435	145	0	0
2009	137	137	137	137	134	134	12780	1084131	1096911	98.835	100.000	99.414	137	0	0
2010	186	186	186	186	176	181	15694	1473423	1489117	98.946	100.000	99.470	186	0	0
2011	222	222	222	222	221	222	22643	1818437	1841080	98.770	100.000	99.381	222	0	0
2012	230	230	230	230	224	225	20619	1860660	1881279	98.904	100.000	99.449	229	0	1
2013	222	222	222	222	221	221	20638	1795624	1816262	98.864	100.000	99.429	222	0	0
2014	182	182	182	182	179	181	20554	1508607	1529161	98.656	100.000	99.323	181	0	1
2015	198	198	198	198	196	198	21175	1688405	1709580	98.761	100.000	99.377	198	0	0
total	6604	6603	6602	6602	4288	6260	550442	39199619	39750061	98.615	99.985	99.295	6394	0	208

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 20.656616666666665 minutes with 8 cores

computed on: Sun Sep 25 20:03:00 CEST 2016 from: METADONNEES_TASLP_20150209.txt