Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1995	37	37	37	37	23	36	2680	126688	129368	97.928	100.000	98.953	37	0	0
1996	51	51	51	51	41	49	5978	216092	222070	97.308	100.000	98.636	51	0	0
1998	37	37	36	36	9	36	4140	200457	204597	97.977	97.297	97.636	36	0	0
1999	36	36	36	36	31	33	4162	159323	163485	97.454	100.000	98.711	36	0	0
2000	41	41	41	41	28	39	5778	210885	216663	97.333	100.000	98.649	40	0	1
2001	32	32	32	32	19	32	3882	171680	175562	97.789	100.000	98.882	32	0	0
2002	44	44	44	44	13	43	6077	211680	217757	97.209	100.000	98.585	44	0	0
2003	51	51	50	50	22	49	6966	221075	228041	96.945	98.039	97.489	50	0	0
2004	32	32	30	30	27	29	3871	131553	135424	97.142	93.750	95.416	30	0	0
2005	35	35	34	34	29	33	3465	148204	151669	97.715	97.143	97.428	34	0	0
2006	71	71	70	70	68	70	3717	210821	214538	98.267	98.592	98.429	70	0	0
2007	56	56	55	55	55	55	6016	225039	231055	97.396	98.214	97.804	55	0	0
2008	51	51	51	51	49	50	5072	242867	247939	97.954	100.000	98.967	51	0	0
2009	98	98	98	98	97	98	8151	443372	451523	98.195	100.000	99.089	98	0	0
2010	102	102	102	102	98	100	10328	418437	428765	97.591	100.000	98.781	100	0	2
2011	67	67	67	67	66	67	7146	307174	314320	97.727	100.000	98.850	67	0	0
2012	70	70	70	70	64	68	9373	363898	373271	97.489	100.000	98.729	70	0	0
2013	54	54	54	54	51	54	6792	281404	288196	97.643	100.000	98.808	54	0	0
2014	74	74	74	74	71	72	8610	385529	394139	97.815	100.000	98.896	74	0	0
total	1039	1039	1032	1032	861	1013	112204	4676178	4788382	97.657	99.326	98.484	1029	0	3

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 2.5151 minutes with 8 cores

computed on: Sun Sep 25 19:33:05 CEST 2016 from: METADONNEES_PACLIC_140429.txt