Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1987	23	23	23	23	0	8	401	44501	44902	99.107	100.000	99.551	22	0	1
1989	25	25	25	25	0	7	435	47060	47495	99.084	100.000	99.540	25	0	0
1991	21	21	21	21	17	17	1039	80710	81749	98.729	100.000	99.360	21	0	0
1993	23	23	23	23	1	12	509	61743	62252	99.182	100.000	99.589	23	0	0
1995	26	26	26	26	5	9	872	85088	85960	98.986	100.000	99.490	26	0	0
1997	36	36	35	35	16	22	1175	111939	113114	98.961	97.222	98.084	35	0	0
1999	86	86	86	86	75	75	4655	298655	303310	98.465	100.000	99.227	84	0	2
2001	68	68	63	63	63	57	4245	214092	218337	98.056	92.647	95.275	63	0	0
2003	72	72	71	71	66	67	5142	285809	290951	98.233	98.611	98.422	71	0	0
2005	105	105	102	102	96	99	8673	430069	438742	98.023	97.143	97.581	102	0	0
2007	73	73	73	73	67	71	6602	386924	393526	98.322	100.000	99.154	73	0	0
2009	73	73	71	71	58	59	4583	271969	276552	98.343	97.260	97.799	71	0	0
2011	73	73	72	72	71	71	5457	313206	318663	98.288	98.630	98.459	72	0	0
2013	51	51	51	51	46	47	4183	215942	220125	98.100	100.000	99.041	50	0	1
2015	40	40	40	40	34	33	3024	186010	189034	98.400	100.000	99.194	39	0	1
total	795	795	782	782	615	654	50995	3033717	3084712	98.347	98.365	98.356	777	0	5

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 1.6102833333333335 minutes with 8 cores

computed on: Sun Sep 25 19:27:33 CEST 2016 from: METADONNEES_MTS_150802.txt