Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1965	24	24	24	24	6	15	5942	152112	158054	96.241	100.000	98.084	22	2	0
1967	37	37	28	28	0	9	6817	145679	152496	95.530	75.676	84.451	24	4	0
1973	62	62	51	51	0	15	7317	184702	192019	96.189	82.258	88.680	46	5	0
1980	92	92	89	89	16	73	13808	400838	414646	96.670	96.739	96.705	87	2	0
1982	141	141	107	107	2	56	9140	253218	262358	96.516	75.887	84.967	98	3	6
1984	116	116	112	112	41	79	15638	458816	474454	96.704	96.552	96.628	111	0	1
1986	156	156	134	134	31	89	26016	596226	622242	95.819	85.897	90.587	131	2	1
1988	166	166	146	146	34	86	33103	694734	727837	95.452	87.952	91.548	146	0	0
1990	195	195	189	189	45	128	26446	691155	717601	96.315	96.923	96.618	188	1	0
1992	206	206	176	176	39	109	43600	837709	881309	95.053	85.437	89.989	172	4	0
1994	212	212	142	142	46	77	39486	624726	664212	94.055	66.981	78.242	142	0	0
1996	213	213	196	196	62	111	51706	905211	956917	94.597	92.019	93.290	194	1	1
1998	245	245	243	243	74	191	24592	1009137	1033729	97.621	99.184	98.396	242	1	0
2000	175	175	166	166	150	162	17254	691548	708802	97.566	94.857	96.192	165	1	0
2002	198	198	155	155	140	144	12833	632063	644896	98.010	78.283	87.043	155	0	0
2004	204	204	183	183	174	178	14862	821541	836403	98.223	89.706	93.771	182	0	1
2006	272	272	270	270	267	269	24118	1398064	1422182	98.304	99.265	98.782	270	0	0
2008	195	195	193	193	187	191	16215	902539	918754	98.235	98.974	98.603	193	0	0
2010	350	350	350	350	340	348	32776	1793043	1825819	98.205	100.000	99.094	350	0	0
2012	332	332	329	329	327	327	38048	1933615	1971663	98.070	99.096	98.581	329	0	0
2014	221	221	221	221	216	218	26441	1295185	1321626	97.999	100.000	98.990	221	0	0
total	3812	3812	3504	3504	2197	2875	486158	16421861	16908019	97.125	91.920	94.451	3468	26	10

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 9.230916666666667 minutes with 8 cores

computed on: Sun Sep 25 18:07:25 CEST 2016 from: METADONNEES_COLING_140407.txt