Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1986	24	24	24	24	7	12	5077	167927	173004	97.065	100.000	98.511	24	0	0
1989	128	128	128	128	44	64	4379	302367	306746	98.572	100.000	99.281	97	0	31
1990	102	102	101	101	19	54	4247	286957	291204	98.542	99.020	98.780	92	0	9
1991	104	104	104	104	44	57	4563	281021	285584	98.402	100.000	99.195	103	0	1
1992	124	124	123	123	54	67	4889	320904	325793	98.499	99.194	98.845	123	0	0
1993	115	115	115	115	43	57	4358	272266	276624	98.425	100.000	99.206	114	0	1
1994	121	121	121	121	50	62	5470	310056	315526	98.266	100.000	99.126	120	0	1
2001	75	75	71	71	52	68	3782	236670	240452	98.427	94.667	96.510	71	0	0
2003	75	75	70	70	65	69	3856	259838	263694	98.538	93.333	95.865	70	0	0
2004	82	82	78	78	78	78	4513	342620	347133	98.700	95.122	96.878	78	0	0
2005	127	127	127	127	124	127	9774	687858	697632	98.599	100.000	99.295	127	0	0
2006	113	113	112	112	111	111	6935	431982	438917	98.420	99.115	98.766	112	0	0
2007	127	127	127	127	126	126	7775	527300	535075	98.547	100.000	99.268	127	0	0
2008	187	187	187	187	183	187	12516	839433	851949	98.531	100.000	99.260	187	0	0
2009	146	146	143	143	142	142	10258	591331	601589	98.295	97.945	98.120	143	0	0
2010	146	146	146	146	143	145	10837	648725	659562	98.357	100.000	99.172	146	0	0
2012	97	97	97	97	95	97	8669	492478	501147	98.270	100.000	99.128	97	0	0
2013	140	140	140	140	140	140	12894	704289	717183	98.202	100.000	99.093	140	0	0
2015	186	186	186	186	185	186	18903	940314	959217	98.029	100.000	99.005	186	0	0
total	2219	2219	2200	2200	1705	1849	143695	8644336	8788031	98.365	99.144	98.753	2157	0	43

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 4.693733333333333 minutes with 8 cores

computed on: Sun Sep 25 18:26:44 CEST 2016 from: METADONNEES_HLT_140428.txt