{"id":595,"date":"2024-10-17T03:29:04","date_gmt":"2024-10-17T03:29:04","guid":{"rendered":"http:\/\/dev.aduku.fr\/?post_type=portfolio&#038;p=595"},"modified":"2025-06-04T21:32:16","modified_gmt":"2025-06-04T21:32:16","slug":"pipelines-elt-evolutifs","status":"publish","type":"portfolio","link":"https:\/\/www.aduku.fr\/fr\/portfolio\/ingenierie-de-donnees\/pipelines-elt-evolutifs\/","title":{"rendered":"Pipelines ELT \u00e9volutifs"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"595\" class=\"elementor elementor-595\">\n\t\t\t\t<div class=\"elementor-element elementor-element-307fb95f e-flex e-con-boxed e-con e-parent\" data-id=\"307fb95f\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-60159e6f e-con-full e-flex e-con e-child\" data-id=\"60159e6f\" data-element_type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-1903eec1 e-con-full e-flex e-con e-child\" data-id=\"1903eec1\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-615e96a3 elementor-widget elementor-widget-heading\" data-id=\"615e96a3\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Pipelines ELT \u00e9volutifs pour une agence allemande de premier plan, optimis\u00e9s avec Snowflake.<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t \t\t<div class=\"elementor-element elementor-element-20a24af9 elementor-widget elementor-widget-text-editor\" data-id=\"20a24af9\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Ce projet a consist\u00e9 \u00e0 concevoir et d\u00e9ployer des pipelines ELT (Extract, Load, Transform) robustes et \u00e9volutifs pour une agence allemande de premier plan. L&rsquo;objectif \u00e9tait de centraliser et d&rsquo;automatiser l&rsquo;ingestion, la transformation et l&rsquo;analyse des donn\u00e9es en utilisant Snowflake comme entrep\u00f4t de donn\u00e9es.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-6b9105a0 e-con-full e-flex e-con e-child\" data-id=\"6b9105a0\" data-element_type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-3a1f03a0 e-con-full e-flex e-con e-child\" data-id=\"3a1f03a0\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1806bc1e elementor-widget elementor-widget-image\" data-id=\"1806bc1e\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"2560\" height=\"2547\" src=\"https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-scaled.jpg\" class=\"attachment-full size-full wp-image-5287\" alt=\"M\u00e9thode d&#039;extraction de donn\u00e9es en action\" srcset=\"https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-scaled.jpg 2560w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-1024x1019.jpg 1024w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-150x150.jpg 150w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-768x764.jpg 768w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-1536x1528.jpg 1536w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-2048x2038.jpg 2048w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-12x12.jpg 12w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-523x520.jpg 523w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-1000x995.jpg 1000w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/extraction-method-110x110.jpg 110w\" sizes=\"(max-width: 2560px) 100vw, 2560px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3d116916 e-con-full e-flex e-con e-child\" data-id=\"3d116916\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-16545087 elementor-widget elementor-widget-image\" data-id=\"16545087\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"1024\" height=\"562\" src=\"https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/partition-donnees.png\" class=\"attachment-full size-full wp-image-5288\" alt=\"Gestion de la partition des donn\u00e9es\" srcset=\"https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/partition-donnees.png 1024w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/partition-donnees-300x165.png 300w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/partition-donnees-768x422.png 768w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/partition-donnees-18x10.png 18w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/partition-donnees-850x467.png 850w, https:\/\/www.aduku.fr\/wp-content\/uploads\/2024\/10\/partition-donnees-1000x549.png 1000w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6e222173 elementor-widget elementor-widget-heading\" data-id=\"6e222173\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h4 class=\"elementor-heading-title elementor-size-default\">Etapes cl\u00e9s<\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6c499fc elementor-mobile-align-center elementor-icon-list--layout-traditional elementor-list-item-link-full_width elementor-widget elementor-widget-icon-list\" data-id=\"6c499fc\" data-element_type=\"widget\" data-widget_type=\"icon-list.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul class=\"elementor-icon-list-items\">\n\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item\">\n\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-icon\">\n\t\t\t\t\t\t\t<i aria-hidden=\"true\" class=\"neotech-icon- neotech-icon-flower\"><\/i>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text\">Extraction des donn\u00e9es depuis diverses sources (bases de donn\u00e9es, API et syst\u00e8mes internes).<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item\">\n\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-icon\">\n\t\t\t\t\t\t\t<i aria-hidden=\"true\" class=\"neotech-icon- neotech-icon-flower\"><\/i>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text\">Chargement des donn\u00e9es brutes dans Snowflake pour un stockage centralis\u00e9.<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item\">\n\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-icon\">\n\t\t\t\t\t\t\t<i aria-hidden=\"true\" class=\"neotech-icon- neotech-icon-flower\"><\/i>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text\">Transformation des donn\u00e9es \u00e0 l'aide de requ\u00eates SQL et de traitements par lots pour g\u00e9n\u00e9rer des vues analytiques et des rapports.<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item\">\n\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-icon\">\n\t\t\t\t\t\t\t<i aria-hidden=\"true\" class=\"neotech-icon- neotech-icon-flower\"><\/i>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text\">Optimisation des performances par la mise en cache et la partition des donn\u00e9es.<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t<\/ul>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4499845 e-con-full e-flex e-con e-child\" data-id=\"4499845\" data-element_type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-434b5d1c e-con-full e-flex e-con e-child\" data-id=\"434b5d1c\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1e7d2fa2 elementor-widget elementor-widget-heading\" data-id=\"1e7d2fa2\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">D\u00e9tails du projet<\/h5>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-325fd77 e-grid e-con-full e-con e-child\" data-id=\"325fd77\" data-element_type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-62a0a387 e-con-full e-flex e-con e-child\" data-id=\"62a0a387\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1b194ece elementor-widget elementor-widget-heading\" data-id=\"1b194ece\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Date d'ex\u00e9cution<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-258f625b elementor-widget elementor-widget-text-editor\" data-id=\"258f625b\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>25 F\u00e9vrier 2024<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-41b3cb95 e-con-full e-flex e-con e-child\" data-id=\"41b3cb95\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-5ad43b42 elementor-widget elementor-widget-heading\" data-id=\"5ad43b42\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Client<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-722dfe69 elementor-widget elementor-widget-text-editor\" data-id=\"722dfe69\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Entreprise allemande<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5019f8be e-con-full e-flex e-con e-child\" data-id=\"5019f8be\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-58c14c51 elementor-widget elementor-widget-heading\" data-id=\"58c14c51\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Localisation<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-229d0c0d elementor-widget elementor-widget-text-editor\" data-id=\"229d0c0d\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Berlin, Allemand<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-717d20a4 e-con-full e-flex e-con e-child\" data-id=\"717d20a4\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3220a5bf elementor-widget elementor-widget-heading\" data-id=\"3220a5bf\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Categorie<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-79afc42 hfe-post-info-layout-inline elementor-widget elementor-widget-post-info-widget\" data-id=\"79afc42\" data-element_type=\"widget\" data-widget_type=\"post-info-widget.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul class=\"hfe-post-info-inline hfe-post-info-items hfe-post-info\">\n\t\t\t\t\t<li class=\"hfe-post-info-item elementor-repeater-item-f84e5f5 hfe-post-info-inline-item\" itemprop=\"about\"> \n\t\t\t\n\t\t\t\t\t<span class=\"hfe-post-info-text hfe-post-info__item hfe-post-info__item--type-terms\">\n\t\t\t\n\t\t\t\t\t\t\t<span class=\"hfe-post-info__terms-list\">\n\t\t\t\t\t<a href=\"https:\/\/www.aduku.fr\/fr\/portfolio-category\/ingenierie-de-donnees\/\" class=\"hfe-post-info__terms-list-item\">Ing\u00e9nierie de donn\u00e9es<\/a>\t\t\t\t<\/span>\n\t\t\t\t\t<\/span>\n\t\t\n\t\t\t\t\t<\/li>\n\t\t\t\t<\/ul>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e9edb31 elementor-widget__width-initial elementor-absolute e-transform divider-gradient-color-yes elementor-widget-divider--view-line elementor-widget elementor-widget-divider\" data-id=\"e9edb31\" data-element_type=\"widget\" data-settings=\"{&quot;_position&quot;:&quot;absolute&quot;,&quot;_transform_rotateZ_effect&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:90,&quot;sizes&quot;:[]},&quot;_transform_rotateZ_effect_laptop&quot;:{&quot;unit&quot;:&quot;deg&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;_transform_rotateZ_effect_tablet_extra&quot;:{&quot;unit&quot;:&quot;deg&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;_transform_rotateZ_effect_tablet&quot;:{&quot;unit&quot;:&quot;deg&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;_transform_rotateZ_effect_mobile_extra&quot;:{&quot;unit&quot;:&quot;deg&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;_transform_rotateZ_effect_mobile&quot;:{&quot;unit&quot;:&quot;deg&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"divider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-divider\">\n\t\t\t<span class=\"elementor-divider-separator\">\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Pipelines ELT \u00e9volutifs pour une agence allemande de premier plan, optimis\u00e9s avec Snowflake. Ce projet a consist\u00e9 \u00e0 concevoir et d\u00e9ployer des pipelines ELT (Extract, Load, Transform) robustes et \u00e9volutifs pour une agence allemande de premier plan. L&rsquo;objectif \u00e9tait de centraliser et d&rsquo;automatiser l&rsquo;ingestion, la transformation et l&rsquo;analyse des donn\u00e9es en utilisant Snowflake comme entrep\u00f4t [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":5274,"template":"","class_list":["post-595","portfolio","type-portfolio","status-publish","has-post-thumbnail","hentry","portfolio-category-ingenierie-de-donnees"],"_links":{"self":[{"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/portfolio\/595"}],"collection":[{"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/portfolio"}],"about":[{"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/types\/portfolio"}],"author":[{"embeddable":true,"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":26,"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/portfolio\/595\/revisions"}],"predecessor-version":[{"id":5820,"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/portfolio\/595\/revisions\/5820"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/media\/5274"}],"wp:attachment":[{"href":"https:\/\/www.aduku.fr\/fr\/wp-json\/wp\/v2\/media?parent=595"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}