Estimation of the quality based on absence/presence of words in the TagParser lexicon.

Note: a document belonging to two joint conferences is counted once

year	nb of papers from the metadata	nb of papers in PDF	nb of papers in XML (= output of PDFBox)	nb of non empty papers as extraction result	nb of papers with an abstract (from extraction)	nb of papers with references(from extraction)	nb of unknown words	nb of known words	nb of words of the content	evaluation of noise = pourcentage of nb of known words / nb of words of the content	evaluation of silence = pourcentage of non empty papers as extraction result / PDF docs	combined evaluation of noise and silence	nb of English papers	nb of French papers	nb of papers in another language (es+de+ru)
1965	24	24	24	22	6	15	4973	141187	146160	96.598	91.667	94.068	22	0	0
1966	7	7	7	7	0	1	299	23052	23351	98.720	100.000	99.356	7	0	0
1967	54	54	45	41	0	11	4926	160700	165626	97.026	75.926	85.189	41	0	0
1968	17	17	15	15	0	2	847	48451	49298	98.282	88.235	92.988	15	0	0
1969	24	24	24	24	1	3	1049	81304	82353	98.726	100.000	99.359	24	0	0
1970	18	18	18	17	0	8	1425	61568	62993	97.738	94.444	96.063	17	0	0
1971	20	20	20	20	0	9	1493	67739	69232	97.843	100.000	98.910	20	0	0
1972	19	19	19	19	0	9	1835	89749	91584	97.996	100.000	98.988	19	0	0
1973	80	80	69	64	0	22	9104	258037	267141	96.592	80.000	87.517	64	0	0
1974	25	25	23	23	0	11	2654	121883	124537	97.869	92.000	94.844	23	0	0
1975	131	131	130	121	26	91	6399	391858	398257	98.393	92.366	95.285	121	0	0
1976	135	135	134	127	17	103	7267	438235	445502	98.369	94.074	96.174	127	0	0
1977	139	139	139	128	24	104	8044	436782	444826	98.192	92.086	95.041	128	0	0
1978	155	154	152	141	43	103	10292	507018	517310	98.010	91.558	94.675	141	0	0
1979	179	179	176	170	43	124	13726	625635	639361	97.853	94.972	96.391	170	0	0
1980	307	307	299	290	67	231	30927	1171287	1202214	97.427	94.463	95.922	290	0	0
1981	274	274	272	250	67	193	27085	1139323	1166408	97.678	91.241	94.350	250	0	0
1982	363	363	328	305	56	220	27818	1119322	1147140	97.575	84.022	90.293	305	0	0
1983	350	350	345	331	111	273	40662	1584998	1625660	97.499	94.571	96.013	331	0	0
1984	464	464	455	330	117	255	35310	1500420	1535730	97.701	71.121	82.318	330	0	0
1985	378	378	367	350	140	294	43349	1792329	1835678	97.639	92.593	95.049	350	0	0
1986	510	510	479	464	211	369	62093	2488728	2550821	97.566	90.980	94.158	464	0	0
1987	669	669	665	652	367	557	45872	2534776	2580648	98.222	97.459	97.839	651	0	1
1988	545	545	520	513	251	421	72291	2893370	2965661	97.562	94.128	95.815	509	4	0
1989	955	955	955	915	536	765	72625	3945613	4018238	98.193	95.812	96.987	906	9	0
1990	1277	1277	1260	1239	843	841	92614	4494212	4586826	97.981	97.024	97.500	1236	3	0
1991	1378	1378	1366	1341	915	922	94934	4833016	4927950	98.074	97.315	97.693	1333	8	0
1992	1611	1611	1571	1555	1012	1106	147249	6220267	6367516	97.687	96.524	97.102	1549	6	0
1993	1239	1239	1237	1233	913	851	79435	4073480	4152915	98.087	99.516	98.796	1223	10	0
1994	1454	1454	1375	1366	986	916	109211	4498664	4607875	97.630	93.948	95.753	1360	6	0
1995	1208	1208	1202	1199	891	1041	79257	4298211	4377468	98.189	99.255	98.719	1194	5	0
1996	1536	1536	1511	1505	1073	1296	137556	5492043	5629599	97.557	97.982	97.769	1501	4	0
1997	1603	1603	1591	1516	1199	1319	95319	5103315	5198634	98.166	94.573	96.336	1504	12	0
1998	2197	2197	2170	1926	1487	1747	136881	7025442	7162323	98.089	87.665	92.584	1910	16	0
1999	1602	1602	1557	1543	1286	1411	112464	5747100	5859564	98.081	96.317	97.191	1499	44	0
2000	2271	2270	2106	2067	1778	1902	142660	7655753	7798413	98.171	91.057	94.480	2052	15	0
2001	1644	1644	1538	1509	1345	1390	99439	5664102	5763541	98.275	91.788	94.921	1471	38	0
2002	2169	2169	2065	2036	1841	1888	183995	7894630	8078625	97.722	93.868	95.757	1904	132	0
2003	2059	2059	2029	1951	1767	1843	171813	7497378	7669191	97.760	94.755	96.234	1908	43	0
2004	2793	2793	2730	2637	2433	2501	164667	9802005	9966672	98.348	94.415	96.341	2463	172	2
2005	2482	2482	2456	2323	2081	2201	211652	9549988	9761640	97.832	93.594	95.666	2256	67	0
2006	3179	3179	3167	2766	2598	2676	226648	11914652	12141300	98.133	87.008	92.237	2673	93	0
2007	2747	2747	2728	2447	2296	2397	180778	10795311	10976089	98.353	89.079	93.487	2360	87	0
2008	3265	3265	3252	3058	2902	2952	231879	13022771	13254650	98.251	93.660	95.900	2866	192	0
2009	2994	2994	2982	2611	2482	2503	200348	11684821	11885169	98.314	87.208	92.429	2507	104	0
2010	3616	3616	3608	3445	3260	3381	276973	15693378	15970351	98.266	95.271	96.745	3352	93	0
2011	2956	2956	2953	2941	2829	2910	245022	13884546	14129568	98.266	99.493	98.875	2846	95	0
2012	3655	3655	3649	3402	3280	3314	290446	16072825	16363271	98.225	93.078	95.582	3237	165	0
2013	3476	3476	3465	3311	3168	3251	310922	16345371	16656293	98.133	95.253	96.672	3250	61	0
2014	3816	3816	3810	3805	3615	3708	375559	18694104	19069663	98.031	99.712	98.864	3651	154	0
2015	3818	3818	3807	3291	3144	3205	331054	15524880	15855934	97.912	86.197	91.682	3215	76	0
total	67887	67885	66865	63362	53507	57666	5261140	267105629	272366769	98.068	93.337	95.644	61645	1714	3

Note#1: the unknowns with initiale lower-case letter denote some full-size unknown words but often words which have been cut due to bad interpreation of PDF multi-columns by PDFBox.

Note#2: a paper without any content (i.e. without any body) is not taken in the pipeline. This situation may be the consequence of a processing problem or may be it is an invited presentation without any text.In constrast, a paper without abstract is taken.

Note#3: a paper without any content holds an entry in the metadata, and normally, each paper has an entry in the metadata.

Note#4: the combined evaluation is computed as: 2*EvalNoise*EvalSilence / EvalNoise+EvalSilence

total elapsed time (read and display included)= 146.90675000000002 minutes with 8 cores

computed on: Wed Sep 28 22:24:12 CEST 2016