Estimation of the quality based on absence/presence of words in the TagParser lexicon.

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references (from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1966	7	7	7	7	0	1	299	23051	23350	98.719	100.000	99.356	7	0	0
1967	17	17	17	17	0	3	713	41732	42445	98.320	100.000	99.153	17	0	0
1968	17	17	15	15	0	2	852	48489	49341	98.273	88.235	92.984	15	0	0
1969	24	24	24	24	1	3	1055	81388	82443	98.720	100.000	99.356	24	0	0
1970	18	18	18	18	0	8	1429	61749	63178	97.738	100.000	98.856	17	0	1
1971	20	20	20	20	0	9	1496	68196	69692	97.853	100.000	98.915	20	0	0
1972	19	19	19	19	0	9	1838	89971	91809	97.998	100.000	98.989	19	0	0
1973	18	18	18	18	0	8	3255	89410	92665	96.487	100.000	98.212	18	0	0
1974	25	25	23	23	0	11	2663	122048	124711	97.865	92.000	94.842	23	0	0
1975	21	21	21	21	0	11	1292	100792	102084	98.734	100.000	99.363	21	0	0
1976	25	25	24	24	0	11	2469	126046	128515	98.079	96.000	97.028	24	0	0
1977	26	26	26	26	0	14	5013	157860	162873	96.922	100.000	98.437	25	1	0
1978	32	32	30	30	1	6	5872	159514	165386	96.450	93.750	95.081	28	2	0
1979	14	14	13	13	0	5	1472	81376	82848	98.223	92.857	95.465	13	0	0
1980	19	19	17	17	0	9	2373	95776	98149	97.582	89.474	93.352	17	0	0
1981	15	15	15	15	0	6	3954	122551	126505	96.874	100.000	98.412	15	0	0
1982	17	17	17	17	0	4	3552	109367	112919	96.854	100.000	98.402	15	2	0
1983	12	12	12	12	0	6	2949	90575	93524	96.847	100.000	98.398	11	1	0
1984	22	22	21	21	0	9	2749	118987	121736	97.742	95.455	96.585	21	0	0
1985	24	24	21	21	0	15	1858	105432	107290	98.268	87.500	92.572	21	0	0
1986	37	37	28	28	0	13	2743	78956	81699	96.643	75.676	84.884	22	6	0
1987	14	14	14	14	0	8	1261	85789	87050	98.551	100.000	99.270	14	0	0
1988	22	22	22	22	21	17	3237	144852	148089	97.814	100.000	98.895	21	1	0
1989	34	34	34	34	33	20	5529	210901	216430	97.445	100.000	98.706	34	0	0
1990	34	34	33	33	30	13	5967	214406	220373	97.292	97.059	97.175	33	0	0
1991	29	29	29	29	29	17	4412	215435	219847	97.993	100.000	98.986	29	0	0
1992	29	29	29	29	27	21	4889	227507	232396	97.896	100.000	98.937	29	0	0
1993	35	35	35	35	27	26	4607	188856	193463	97.619	100.000	98.795	35	0	0
1994	31	31	31	31	8	20	4539	213410	217949	97.917	100.000	98.948	31	0	0
1995	30	30	30	30	0	23	4880	259187	264067	98.152	100.000	99.067	30	0	0
1996	34	34	34	34	0	28	4838	252965	257803	98.123	100.000	99.053	33	0	1
1997	27	27	27	27	4	26	3555	192171	195726	98.184	100.000	99.084	27	0	0
1998	23	23	23	23	1	18	2862	204604	207466	98.620	100.000	99.305	23	0	0
1999	29	29	29	29	24	21	3073	163164	166237	98.151	100.000	99.067	29	0	0
2000	29	29	29	29	21	27	1462	128599	130061	98.876	100.000	99.435	29	0	0
2001	24	24	23	23	21	23	2062	150850	152912	98.652	95.833	97.222	23	0	0
2002	24	24	24	24	17	19	3118	179814	182932	98.296	100.000	99.140	24	0	0
2003	27	27	27	27	22	24	2197	174169	176366	98.754	100.000	99.373	27	0	0
2004	23	23	23	23	22	23	3209	173753	176962	98.187	100.000	99.085	23	0	0
total	927	927	902	902	309	537	115593	5353698	5469291	97.887	97.303	97.594	887	13	2

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 3.4494 minutes with 8 cores

computed on: Sun Sep 25 17:53:35 CEST 2016 from: METADONNEES_CATH_150112.txt