Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1997	4	4	3	3	2	3	372	14056	14428	97.422	75.000	84.753	0	3	0
1998	14	14	13	13	8	10	1614	56297	57911	97.213	92.857	94.985	0	13	0
1999	44	44	42	42	25	28	6109	187822	193931	96.850	95.455	96.147	10	32	0
2000	21	20	20	20	14	17	1766	89582	91348	98.067	100.000	99.024	10	10	0
2001	42	42	40	40	13	14	6099	147088	153187	96.019	95.238	95.627	14	25	1
2002	41	41	41	41	26	35	4575	167078	171653	97.335	100.000	98.649	3	38	0
2003	46	46	45	45	22	43	3784	171449	175233	97.841	97.826	97.833	5	40	0
2004	60	60	58	58	53	55	3689	226974	230663	98.401	96.667	97.526	7	51	0
2005	61	61	60	60	2	57	3998	232857	236855	98.312	98.361	98.336	7	53	0
2006	62	62	62	62	62	62	5467	286769	292236	98.129	100.000	99.056	7	55	0
2007	68	68	68	68	68	67	6460	319073	325533	98.016	100.000	98.998	4	64	0
2008	52	52	52	52	52	51	4943	251768	256711	98.074	100.000	99.028	2	50	0
2009	78	78	78	78	78	78	5990	349453	355443	98.315	100.000	99.150	2	76	0
2010	76	76	76	76	75	72	6083	306536	312619	98.054	100.000	99.018	8	68	0
2011	85	85	85	85	85	83	7355	442415	449770	98.365	100.000	99.176	6	79	0
2012	53	53	53	53	53	48	4708	251960	256668	98.166	100.000	99.074	0	53	0
2013	71	71	61	61	52	52	7883	353567	361450	97.819	85.915	91.482	9	50	2
2014	69	69	69	69	69	68	7907	379691	387598	97.960	100.000	98.969	4	65	0
2015	72	72	72	72	72	72	7416	377913	385329	98.075	100.000	99.028	4	68	0
total	1019	1018	998	998	831	915	96218	4612348	4708566	97.957	98.035	97.996	102	893	3

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 2.768333333333333 minutes with 8 cores

computed on: Sun Sep 25 19:42:21 CEST 2016 from: METADONNEES_TALN_140402.txt