Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1980	13	13	13	13	0	7	3807	117702	121509	96.867	100.000	98.409	13	0	0
1981	17	17	17	17	0	7	5470	142809	148279	96.311	100.000	98.121	17	0	0
1982	14	14	14	14	0	6	4066	102144	106210	96.172	100.000	98.049	14	0	0
1983	11	11	11	11	0	7	4511	108658	113169	96.014	100.000	97.966	11	0	0
1984	9	9	9	9	0	8	1665	90899	92564	98.201	100.000	99.092	9	0	0
1985	12	12	12	12	0	12	2351	115416	117767	98.004	100.000	98.992	12	0	0
1986	17	17	17	17	0	11	2252	144337	146589	98.464	100.000	99.226	17	0	0
1987	16	16	16	16	0	16	3362	158750	162112	97.926	100.000	98.952	16	0	0
1988	28	28	28	28	0	26	3824	238881	242705	98.424	100.000	99.206	28	0	0
1989	23	23	23	23	0	21	3913	192428	196341	98.007	100.000	98.993	23	0	0
1990	21	21	21	21	0	20	4003	161638	165641	97.583	100.000	98.777	21	0	0
1991	25	25	25	25	0	23	3320	192467	195787	98.304	100.000	99.145	25	0	0
1992	25	25	25	25	0	24	4106	208209	212315	98.066	100.000	99.024	25	0	0
1993	26	26	26	26	1	26	6194	301308	307502	97.986	100.000	98.983	26	0	0
1994	29	29	29	29	0	24	7291	293934	301225	97.580	100.000	98.775	27	0	2
1995	21	21	21	21	0	21	6221	251334	257555	97.585	100.000	98.778	21	0	0
1996	21	21	21	21	0	20	5372	209572	214944	97.501	100.000	98.735	21	0	0
1997	23	23	23	23	0	22	6021	286443	292464	97.941	100.000	98.960	23	0	0
1998	23	23	23	23	0	22	6815	296585	303400	97.754	100.000	98.864	23	0	0
1999	21	21	21	21	0	20	8164	300269	308433	97.353	100.000	98.659	21	0	0
2000	21	21	21	21	0	21	6626	280528	287154	97.693	100.000	98.833	21	0	0
2001	21	21	21	21	0	21	8017	271166	279183	97.128	100.000	98.543	21	0	0
2002	21	21	21	21	1	20	4621	228532	233153	98.018	100.000	98.999	21	0	0
2003	21	21	21	21	0	21	5024	309756	314780	98.404	100.000	99.196	21	0	0
2004	17	17	17	17	0	17	4152	214244	218396	98.099	100.000	99.040	17	0	0
2005	22	22	22	22	0	21	5006	254560	259566	98.071	100.000	99.026	22	0	0
2006	19	19	19	19	0	19	4343	237848	242191	98.207	100.000	99.095	19	0	0
2007	24	24	24	24	0	22	5393	246743	252136	97.861	100.000	98.919	23	0	1
2008	22	22	22	22	0	21	4780	279781	284561	98.320	100.000	99.153	22	0	0
2009	23	23	23	23	0	23	5498	293849	299347	98.163	100.000	99.073	23	0	0
2010	33	33	33	33	0	30	5860	368521	374381	98.435	100.000	99.211	33	0	0
2011	28	28	28	28	0	28	5975	376717	382692	98.439	100.000	99.213	28	0	0
2012	25	25	25	25	0	25	8168	438475	446643	98.171	100.000	99.077	25	0	0
2013	30	30	30	30	0	30	10099	523905	534004	98.109	100.000	99.045	30	0	0
2014	29	29	29	29	0	29	8531	443910	452441	98.114	100.000	99.048	29	0	0
total	751	751	751	751	2	691	184821	8682318	8867139	97.916	100.000	98.947	748	0	3

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 4.610716666666666 minutes with 8 cores

computed on: Sun Sep 25 17:58:12 CEST 2016 from: METADONNEES_CL_140523.txt