first commit

This commit is contained in:
didier amyot committed 2018-08-19 12:36:08 -04:00
commit 6202bbfdd5
13 files changed
+1352

No files matched your search

@@ -0,0 +1,342 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Let's load some data. The electoral results of the 2014 election are located in a file at `resources/data/election-2014.edn`. We can use the [slurp](https://clojuredocs.org/clojure.core/slurp) function for that."
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"#'user/raw-data-str"
]
},
"execution_count": 2,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"(def raw-data-str (slurp \"resources/data/election-2014.edn\"))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Let's print that string!"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"{:statistiques {:nbVoteValide 4232262, :isResultatsFinaux true, :nbBureauVote 21617, :partisPolitiques [{:numeroPartiPolitique 6, :nomPartiPolitique \"Parti libéral du Québec/Quebec Liberal Party\", :abreviationPartiPolitique \"P.L.Q./Q.L.P.\", :nbVoteTotal 1757071, :tauxVoteTotal 41.5161, :nbCirconscriptionsEnAvance 70, :tauxCirconscriptionsEnAvance 56.0} {:numeroPartiPolitique 8, :nomPartiPolitique \"Parti québécois\", :abreviationPartiPolitique \"P.Q.\", :nbVoteTotal 1074120, :tauxVoteTotal 25.3793, :nbCirconscriptionsEnAvance 30, :tauxCirconscriptionsEnAvance 24.0} {:numeroPartiPolitique 27, :nomPartiPolitique \"Coalition avenir Québec - L'équipe François Legault\", :abreviationPartiPolitique \"C.A.Q.-É.F.L.\", :nbVoteTotal 975607, :tauxVoteTotal 23.0517, :nbCirconscriptionsEnAvance 22, :tauxCirconscriptionsEnAvance 17.6} {:numeroPartiPolitique 11, :nomPartiPolitique \"Québec solidaire\", :abreviationPartiPolitique \"Q.S.\", :nbVoteTotal 323124, :tauxVoteTotal 7.6348, :nbCirconscriptionsEnAvance 3, :tauxCirconscriptionsEnAvance 2.4} {:numeroPartiPolitique 26, :nomPartiPolitique \"Option nationale - Pour l'indépendance du Québec\", :abreviationPartiPolitique \"O.N. - P.I.Q.\", :nbVoteTotal 30697, :tauxVoteTotal 0.7253, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 10, :nomPartiPolitique \"Parti vert du Québec/Green Party of Québec\", :abreviationPartiPolitique \"P.V.Q./G.P.Q.\", :nbVoteTotal 23163, :tauxVoteTotal 0.5473, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 22, :nomPartiPolitique \"Équipe Adrien Pouliot - Parti conservateur du Québec\", :abreviationPartiPolitique \"É.A.P. - P.C.Q.\", :nbVoteTotal 16429, :tauxVoteTotal 0.3882, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 0, :nomPartiPolitique \"Candidats indépendants/Independent candidates\", :abreviationPartiPolitique \"Ind.\", :nbVoteTotal 15361, :tauxVoteTotal 0.363, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 23, :nomPartiPolitique \"Parti nul\", :abreviationPartiPolitique \"P.N.\", :nbVoteTotal 7539, :tauxVoteTotal 0.1781, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 2, :nomPartiPolitique \"Bloc pot\", :abreviationPartiPolitique \"B.P.\", :nbVoteTotal 2690, :tauxVoteTotal 0.0636, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 7, :nomPartiPolitique \"Parti marxiste-léniniste du Québec\", :abreviationPartiPolitique \"P.M.L.Q.\", :nbVoteTotal 2016, :tauxVoteTotal 0.0476, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 28, :nomPartiPolitique \"Parti équitable\", :abreviationPartiPolitique \"P.Éq.\", :nbVoteTotal 1645, :tauxVoteTotal 0.0389, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 31, :nomPartiPolitique \"Parti des sans parti\", :abreviationPartiPolitique \"P.S.P.\", :nbVoteTotal 1291, :tauxVoteTotal 0.0305, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 33, :nomPartiPolitique \"Mon pays le Québec\", :abreviationPartiPolitique \"M.P.Q.\", :nbVoteTotal 521, :tauxVoteTotal 0.0123, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 29, :nomPartiPolitique \"Équipe autonomiste\", :abreviationPartiPolitique \"É.A.\", :nbVoteTotal 400, :tauxVoteTotal 0.0095, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 4, :nomPartiPolitique \"Parti unité nationale\", :abreviationPartiPolitique \"P.U.N.\", :nbVoteTotal 241, :tauxVoteTotal 0.0057, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 25, :nomPartiPolitique \"Québec - Révolution démocratique\", :abreviationPartiPolitique \"Q.R.D.\", :nbVoteTotal 163, :tauxVoteTotal 0.0039, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 16, :nomPartiPolitique \"Parti indépendantiste\", :abreviationPartiPolitique \"P.I.\", :nbVoteTotal 126, :tauxVoteTotal 0.003, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 32, :nomPartiPolitique \"Union citoyenne du Québec / Québec Citizens' Union\", :abreviationPartiPolitique \"U.C.Q./Q.C.U.\", :nbVoteTotal 58, :tauxVoteTotal 0.0014, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0}], :nbElecteurInscrit 6012440, :nbCirconscription 125, :nbCirconscriptionSansResultat 0, :iso8601DateMAJ \"2014-04-15T02:24:38,000-04:00\", :nbCirconscriptionAvecResultat 125, :nbVoteExerce 4295055, :tauxParticipationTotal 71.4326, :nbBureauVoteRempli 21617, :nbVoteRejete 62793, :tauxBureauVoteRempli 100.0, :tauxCirconscriptionSansResultat 0.0}, :circonscriptions [{:nbVoteValide 20626, :isResultatsFinaux true, :nbElecteurInscrit 33638, :nbBureauComplete 143, :candidats [{:nuLine truncated
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
}
],
"source": [
"(println raw-data-str)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Now, we need to load the data as clojure code. Clojure data format is call [edn](https://github.com/edn-format/edn). \n",
"\n",
"To load edn data, there is the [read-string function of the clojure.edn module](https://clojuredocs.org/clojure.edn/read-string)."
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"#'user/election-result"
]
},
"execution_count": 4,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"(def election-result (read-string raw-data-str))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Let's print it"
]
},
{
"cell_type": "code",
"execution_count": 6,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"{:statistiques {:nbVoteValide 4232262, :isResultatsFinaux true, :nbBureauVote 21617, :partisPolitiques [{:numeroPartiPolitique 6, :nomPartiPolitique \"Parti libéral du Québec/Quebec Liberal Party\", :abreviationPartiPolitique \"P.L.Q./Q.L.P.\", :nbVoteTotal 1757071, :tauxVoteTotal 41.5161, :nbCirconscriptionsEnAvance 70, :tauxCirconscriptionsEnAvance 56.0} {:numeroPartiPolitique 8, :nomPartiPolitique \"Parti québécois\", :abreviationPartiPolitique \"P.Q.\", :nbVoteTotal 1074120, :tauxVoteTotal 25.3793, :nbCirconscriptionsEnAvance 30, :tauxCirconscriptionsEnAvance 24.0} {:numeroPartiPolitique 27, :nomPartiPolitique \"Coalition avenir Québec - L'équipe François Legault\", :abreviationPartiPolitique \"C.A.Q.-É.F.L.\", :nbVoteTotal 975607, :tauxVoteTotal 23.0517, :nbCirconscriptionsEnAvance 22, :tauxCirconscriptionsEnAvance 17.6} {:numeroPartiPolitique 11, :nomPartiPolitique \"Québec solidaire\", :abreviationPartiPolitique \"Q.S.\", :nbVoteTotal 323124, :tauxVoteTotal 7.6348, :nbCirconscriptionsEnAvance 3, :tauxCirconscriptionsEnAvance 2.4} {:numeroPartiPolitique 26, :nomPartiPolitique \"Option nationale - Pour l'indépendance du Québec\", :abreviationPartiPolitique \"O.N. - P.I.Q.\", :nbVoteTotal 30697, :tauxVoteTotal 0.7253, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 10, :nomPartiPolitique \"Parti vert du Québec/Green Party of Québec\", :abreviationPartiPolitique \"P.V.Q./G.P.Q.\", :nbVoteTotal 23163, :tauxVoteTotal 0.5473, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 22, :nomPartiPolitique \"Équipe Adrien Pouliot - Parti conservateur du Québec\", :abreviationPartiPolitique \"É.A.P. - P.C.Q.\", :nbVoteTotal 16429, :tauxVoteTotal 0.3882, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 0, :nomPartiPolitique \"Candidats indépendants/Independent candidates\", :abreviationPartiPolitique \"Ind.\", :nbVoteTotal 15361, :tauxVoteTotal 0.363, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 23, :nomPartiPolitique \"Parti nul\", :abreviationPartiPolitique \"P.N.\", :nbVoteTotal 7539, :tauxVoteTotal 0.1781, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 2, :nomPartiPolitique \"Bloc pot\", :abreviationPartiPolitique \"B.P.\", :nbVoteTotal 2690, :tauxVoteTotal 0.0636, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 7, :nomPartiPolitique \"Parti marxiste-léniniste du Québec\", :abreviationPartiPolitique \"P.M.L.Q.\", :nbVoteTotal 2016, :tauxVoteTotal 0.0476, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 28, :nomPartiPolitique \"Parti équitable\", :abreviationPartiPolitique \"P.Éq.\", :nbVoteTotal 1645, :tauxVoteTotal 0.0389, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 31, :nomPartiPolitique \"Parti des sans parti\", :abreviationPartiPolitique \"P.S.P.\", :nbVoteTotal 1291, :tauxVoteTotal 0.0305, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 33, :nomPartiPolitique \"Mon pays le Québec\", :abreviationPartiPolitique \"M.P.Q.\", :nbVoteTotal 521, :tauxVoteTotal 0.0123, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 29, :nomPartiPolitique \"Équipe autonomiste\", :abreviationPartiPolitique \"É.A.\", :nbVoteTotal 400, :tauxVoteTotal 0.0095, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 4, :nomPartiPolitique \"Parti unité nationale\", :abreviationPartiPolitique \"P.U.N.\", :nbVoteTotal 241, :tauxVoteTotal 0.0057, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 25, :nomPartiPolitique \"Québec - Révolution démocratique\", :abreviationPartiPolitique \"Q.R.D.\", :nbVoteTotal 163, :tauxVoteTotal 0.0039, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 16, :nomPartiPolitique \"Parti indépendantiste\", :abreviationPartiPolitique \"P.I.\", :nbVoteTotal 126, :tauxVoteTotal 0.003, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0} {:numeroPartiPolitique 32, :nomPartiPolitique \"Union citoyenne du Québec / Québec Citizens' Union\", :abreviationPartiPolitique \"U.C.Q./Q.C.U.\", :nbVoteTotal 58, :tauxVoteTotal 0.0014, :nbCirconscriptionsEnAvance 0, :tauxCirconscriptionsEnAvance 0.0}], :nbElecteurInscrit 6012440, :nbCirconscription 125, :nbCirconscriptionSansResultat 0, :iso8601DateMAJ \"2014-04-15T02:24:38,000-04:00\", :nbCirconscriptionAvecResultat 125, :nbVoteExerce 4295055, :tauxParticipationTotal 71.4326, :nbBureauVoteRempli 21617, :nbVoteRejete 62793, :tauxBureauVoteRempli 100.0, :tauxCirconscriptionSansResultat 0.0}, :circonscriptions [{:nbVoteValide 20626, :isResultatsFinaux true, :nbElecteurInscrit 33638, :nbBureauComplete 143, :candidats [{:nLine truncated
]
},
"execution_count": 6,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"election-result"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Let's print it but with pretty print."
]
},
{
"cell_type": "code",
"execution_count": 31,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"{:nbVoteValide 20626,\n",
" :isResultatsFinaux true,\n",
" :nbElecteurInscrit 33638,\n",
" :nbBureauComplete 143,\n",
" :candidats\n",
" [{:numeroCandidat 436,\n",
" :nom \"Bourgeois\",\n",
" :prenom \"Guy\",\n",
" :numeroPartiPolitique 6,\n",
" :abreviationPartiPolitique \"P.L.Q./Q.L.P.\",\n",
" :nbVoteTotal 8476,\n",
" :tauxVote 41.09,\n",
" :nbVoteAvance 2159}\n",
" {:numeroCandidat 694,\n",
" :nom \"Larouche\",\n",
" :prenom \"Élizabeth\",\n",
" :numeroPartiPolitique 8,\n",
" :abreviationPartiPolitique \"P.Q.\",\n",
" :nbVoteTotal 6317,\n",
" :tauxVote 30.63,\n",
" :nbVoteAvance 0}\n",
" {:numeroCandidat 690,\n",
" :nom \"Martel\",\n",
" :prenom \"Sylvain\",\n",
" :numeroPartiPolitique 27,\n",
" :abreviationPartiPolitique \"C.A.Q.-É.F.L.\",\n",
" :nbVoteTotal 3927,\n",
" :tauxVote 19.04,\n",
" :nbVoteAvance 0}\n",
" {:numeroCandidat 582,\n",
" :nom \"Dufour\",\n",
" :prenom \"Valérie\",\n",
" :numeroPartiPolitique 11,\n",
" :abreviationPartiPolitique \"Q.S.\",\n",
" :nbVoteTotal 1469,\n",
" :tauxVote 7.12,\n",
" :nbVoteAvance 0}\n",
" {:numeroCandidat 786,\n",
" :nom \"Trudel\",\n",
" :prenom \"Richard\",\n",
" :numeroPartiPolitique 26,\n",
" :abreviationPartiPolitique \"O.N. - P.I.Q.\",\n",
" :nbVoteTotal 235,\n",
" :tauxVote 1.14,\n",
" :nbVoteAvance 0}\n",
" {:numeroCandidat 616,\n",
" :nom \"Perron-Tellier\",\n",
" :prenom \"Maxym\",\n",
" :numeroPartiPolitique 22,\n",
" :abreviationPartiPolitique \"É.A.P. - P.C.Q.\",\n",
" :nbVoteTotal 202,\n",
" :tauxVote 0.98,\n",
" :nbVoteAvance 0}],\n",
" :iso8601DateMAJ \"2014-04-15T02:24:38,653-04:00\",\n",
" :tauxVoteRejete 2.48,\n",
" :nbVoteExerce 21151,\n",
" :nbBureauTotal 143,\n",
" :numeroCirconscription 579,\n",
" :nbVoteRejete 525,\n",
" :tauxParticipation 62.88,\n",
" :tauxVoteValide 97.52,\n",
" :nomCirconscription \"Abitibi-Est\"}\n"
]
}
],
"source": [
"(clojure.pprint/pprint (first (:circonscriptions election-result)))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Having fun with the data"
]
},
{
"cell_type": "code",
"execution_count": 22,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"all keys (:statistiques :circonscriptions)\n",
"statistiques keys (:nbVoteValide :isResultatsFinaux :nbBureauVote :partisPolitiques :nbElecteurInscrit :nbCirconscription :nbCirconscriptionSansResultat :iso8601DateMAJ :nbCirconscriptionAvecResultat :nbVoteExerce :tauxParticipationTotal :nbBureauVoteRempli :nbVoteRejete :tauxBureauVoteRempli :tauxCirconscriptionSansResultat)\n",
"statistiques keys (:nbVoteValide :isResultatsFinaux :nbBureauVote :partisPolitiques :nbElecteurInscrit :nbCirconscription :nbCirconscriptionSansResultat :iso8601DateMAJ :nbCirconscriptionAvecResultat :nbVoteExerce :tauxParticipationTotal :nbBureauVoteRempli :nbVoteRejete :tauxBureauVoteRempli :tauxCirconscriptionSansResultat)\n"
]
}
],
"source": [
"(println \"all keys\" (keys election-result))\n",
"(println \"statistiques keys \" (keys (:statistiques election-result)))\n",
"(println \"statistiques keys \" (keys (:statistiques election-result)))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Let's validate that the statistics sums up."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Let's get the number of votes for each political party in a list"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Let get all the votes and drop any other information"
]
},
{
"cell_type": "code",
"execution_count": 32,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"(1757071 1074120 975607 323124 30697 23163 16429 15361 7539 2690 2016 1645 1291 521 400 241 163 126 58)"
]
},
"execution_count": 32,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"(def all-votes (map :nbVoteTotal (:partisPolitiques (:statistiques election-result))))\n",
"all-votes"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Now, let's sum this list.."
]
},
{
"cell_type": "code",
"execution_count": 33,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"4232262"
]
},
"execution_count": 33,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"(reduce + 0 all-votes)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Lets create a map of candidates by county"
]
},
{
"cell_type": "code",
"execution_count": 34,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"#'user/county"
]
},
"execution_count": 34,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"(def county (map :candidats (:circonscriptions election-result)))"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Lein-Clojure",
"language": "clojure",
"name": "lein-clojure"
},
"language_info": {
"file_extension": ".clj",
"mimetype": "text/x-clojure",
"name": "clojure",
"version": "1.9.0"
}
},
"nbformat": 4,
"nbformat_minor": 2
}