Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1987	252	252	250	250	159	190	7599	419933	427532	98.223	99.206	98.712	245	0	5
1989	360	360	360	360	257	304	16136	951674	967810	98.333	100.000	99.159	360	0	0
1990	349	349	349	349	303	315	17633	998509	1016142	98.265	100.000	99.125	349	0	0
1991	335	335	335	335	301	318	15764	972030	987794	98.404	100.000	99.196	335	0	0
1992	413	413	412	412	370	387	22751	1305298	1328049	98.287	99.758	99.017	412	0	0
1993	527	527	526	526	510	498	22476	1491057	1513533	98.515	99.810	99.158	526	0	0
1994	560	560	559	559	509	526	25561	1650082	1675643	98.475	99.821	99.143	559	0	0
1995	518	518	514	514	474	493	21807	1400293	1422100	98.467	99.228	98.846	514	0	0
1996	635	635	628	628	589	605	28787	1724620	1753407	98.358	98.898	98.627	627	0	1
1997	722	722	715	715	669	692	29247	1927472	1956719	98.505	99.030	98.767	715	0	0
1998	850	850	836	836	784	822	34821	2375046	2409867	98.555	98.353	98.454	836	0	0
1999	722	722	686	686	651	666	32326	1896937	1929263	98.324	95.014	96.641	686	0	0
2000	922	922	879	879	811	829	37771	2487327	2525098	98.504	95.336	96.894	879	0	0
2001	672	672	653	653	607	613	27886	1984101	2011987	98.614	97.173	97.888	653	0	0
2002	674	674	672	672	649	630	72559	2078547	2151106	96.627	99.703	98.141	672	0	0
2003	798	798	797	797	783	762	87765	2534563	2622328	96.653	99.875	98.238	797	0	0
2004	775	775	772	772	755	760	33555	2335583	2369138	98.584	99.613	99.096	772	0	0
2005	869	869	869	869	858	835	97872	2864680	2962552	96.696	100.000	98.320	869	0	0
2006	659	659	659	659	659	632	61783	2161072	2222855	97.221	100.000	98.591	659	0	0
2007	751	751	747	747	746	746	36886	2498362	2535248	98.545	99.467	99.004	747	0	0
2008	762	762	760	760	755	753	36407	2400777	2437184	98.506	99.738	99.118	760	0	0
2009	765	765	765	765	765	765	39100	2638698	2677798	98.540	100.000	99.265	765	0	0
2010	781	781	781	781	780	779	39309	2699078	2738387	98.565	100.000	99.277	781	0	0
2011	846	846	846	846	845	846	45264	2923421	2968685	98.475	100.000	99.232	846	0	0
2012	679	679	678	678	676	677	36500	2215552	2252052	98.379	99.853	99.111	678	0	0
2013	756	756	756	756	756	756	46488	2809819	2856307	98.372	100.000	99.180	756	0	0
2014	634	634	634	634	629	631	38986	2334683	2373669	98.358	100.000	99.172	634	0	0
2015	777	777	777	777	775	776	50303	2867558	2917861	98.276	100.000	99.131	777	0	0
total	18363	18363	18215	18215	17425	17606	1063342	56946772	58010114	98.167	99.194	98.678	18209	0	6

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 29.562483333333333 minutes with 8 cores

computed on: Sun Sep 25 19:12:47 CEST 2016 from: METADONNEES_ISCA_140509.txt