ESG data migration and integration: 20% reduction in operational costs

Innowise built a solid cloud-based solution for a climate innovation organization, making data migration and integration smoother, and leveling up ESG reporting.

Cliente

Industria

Medio ambiente

Región

Cliente desde

2024

Our client is one of the leading European organizations that provide consulting services to help businesses implement sustainability policies and integrate sustainable practices into their operations.

La información detallada sobre el cliente no puede divulgarse en virtud de las disposiciones del acuerdo de confidencialidad.

Desafío

Migrating legacy systems to scalable cloud-native ESG reporting

The client faced several hurdles with their legacy data systems, mostly managed through Talend. This setup limited flexibility and fell short in supporting their sustainability reporting goals. To tackle these issues, they needed a scalable, cloud-native architecture to improve data management, cut costs, and support both internal reporting and advanced analytics for sustainability and ESG (Environmental, Social, and Governance) metrics. That’s when they reached out to the Innowise team for help. The main project challenges included:

Data migration and integration: Moving their data workflows from Talend to Azure Functions needed a smooth data ingestion pipeline that could handle various sources like SFTP servers and external APIs.
ESG and sustainability reporting support: The client needed a data infrastructure built for accurate and reliable reporting on sustainability metrics.
Cost efficiency and scalability: With data volume and complexity on the rise, the client needed a solution that would minimize maintenance costs and optimize resource usage. A scalable architecture was essential — one that could automate data workflows, sharpen resource usage, and support future growth without heavy rework.

Solución

Upgrading legacy data systems to streamline ESG reporting and lower costs

Innowise put together a complete data migration and integration solution that covered all the client’s needs. We moved key data workflows from Talend to Azure Functions, linked up with Snowflake for advanced data processing, and upgraded their ESG reporting — providing everything required for smooth data management and keeping tabs on sustainability.

Requirements analysis and planning

Our business analyst and ESG analyst worked closely with the client’s team to dig deep into their requirements. We focused on understanding exactly what data needed to be migrated from their legacy Talend system and which workflows were a priority. By getting a clear picture of their ESG reporting needs, we made sure the solution would capture all key metrics for accurate, transparent reporting.

Our team also set long-term scalability goals to handle future growing volume of data for tracking analysis, designing a flexible architecture from the start.

Azure functions setup

Innowise’s team developed custom Azure Functions that automatically pull data from the client’s legacy system via SFTP and APIs. We set up scheduled triggers to keep data transfers on track with their ESG reporting cycles. To make sure the entire process goes as smoothly as possible and all errors are resolved quickly, our experts integrated Azure Application Insights.

Thanks to the serverless architecture, costs stayed low as resources were only used during data processing. Unlike traditional setups, there were no idle servers running up expenses.

Snowflake integration and data processing

We used Snowflake as the core platform for data storage and analytics and created staging tables to manage and organize incoming data before it underwent deeper processing. Azure Functions handled the first round of data transformations. On other hand, Snowflake took on the more complex processing with SQL scripts, shaping the data to match ESG and sustainability metrics and ensuring it met reporting standards. Additionally, we built data pipelines to store historical data, which supported trend analysis and provided the client with a clear view of their sustainability impact over time.

Integración con sistemas de terceros

To facilitate smooth exchange of data, we integrated several third-party systems into the data migration setup:

Cezanne HR: the client’s go-to for tracking employee timesheets, Cezanne served as a centralized time management tool across their organization.
HSBC SFTP Service: this secure service handles financial data transfers, providing both compliance and data security for transactions.
Unit4 ERP: while the client primarily used Unit4 as their ERP, they were in the process of moving to a new platform. Our integration approach supported both the current and future ERP systems, allowing for an easy transition without interrupting daily operations.

Sustainability and EGS reporting

To support the client’s sustainability goals, our team put together a solid data architecture that makes sure their ESG reporting is clear and accurate. Our solution included a few crucial parts:

Carbon emissions tracking: we set up data pipelines to pull in carbon emissions data from all sorts of sources like energy use records and transportation logs. Everything was centralized in Snowflake, making it easy for the client to get a clear, streamlined view of their carbon footprint. With all these data streams in one place, they could effectively track and manage emissions across their operations.
Social impact data collection: by integrating data from client’s HR systems like Cezanne, we made it easy to collect social impact metrics. This setup lets the company report on key metrics — like diversity, training time, and community projects — without the hassle.. Automated data flows provide a clear view of their social performance, guarantee compliance and help the company fine-tune their ESG strategies.
Governance metrics: The system processed key financial and operational data from HSBC’s SFTP services to hit all the client’s governance reporting goals, including things like ethical sourcing, compliance, and audit trails. With these metrics accurately reported, the client could keep their operations transparent and accountable.
Real-time dashboards: to give stakeholders quick, actionable insights, we connected Snowflake to Power BI and built real-time ESG dashboards. These dashboards brought key sustainability metrics — like energy use, waste reduction, and diversity — into focus. With real-time updates, the client could keep a close eye on their progress toward climate goals, making informed decisions and promoting accountability.

Seguridad y conformidad de los datos

We kept your data safe by using encrypted SFTP connections and Snowflake’s rock-solid security features. Every data transfer to and from Snowflake was fully GDPR-compliant, which is crucial for handling sensitive HR and ESG information. Plus, our security experts set up role-based access control (RBAC) in Snowflake, so only the right people could access or update ESG metrics.

Tecnologías

Programming Languages and Frameworks

.NET, SQL

Servicios en cloud

Azure Functions, Azure Application Insights

Data Warehousing

Snowflake

Data Transfer Protocols

SFTP

Supervisión y registro

Azure Monitor

Visualization Tools

Power BI

VCS

Git, GitHub

Pruebas

NUnit

Proceso

We managed the project using Agile, breaking it down into clear, manageable phases to stay efficient and in sync with client goals. Each phase was carefully planned, executed, and reviewed with the client. Thanks to regular sprints and continuous integration, we kept things moving and quickly adjusted to feedback. Our project manager held weekly check-ins to share updates, answer questions, and get approvals at key milestones. This structured approach kept us on track, reduced risks, and helped us deliver high-quality results right on time, hitting the client’s expectations perfectly.

Equipo

Jefe de proyecto

ESG Analyst

Analista de
negocio

Ingenieros de datos

Arquitecto de la nube

ESG Consultant

Ingeniero de QA

Resultados

Improved data accuracy and reduced reporting costs

The project has already delivered significant results, putting the client on the fast track to hit their sustainability goals. By switching to Azure Functions, the client boosted data processing efficiency by 30%, sped up data flows and reduced time-to-insight. The Snowflake integration provided real-time access to critical ESG metrics, which increased reporting accuracy by 25% and improved compliance and transparency.

The serverless setup also slashed operational costs by 20%, giving the client a scalable, budget-friendly solution ready to grow with future needs. Now, they’re set up to make smarter, data-driven decisions and continue advancing their climate innovation efforts.

In the next phase, the client plans to add predictive analytics with machine learning for ESG forecasting, integrate IoT for sharper data collection, and adopt AI-powered compliance monitoring to stay on top of evolving ESG rules.

Duración del proyecto

June 2024 — Ongoing

30%

boost in data processing efficiency

20%

reduction in operational costs

Casos relacionados

Contáctenos

Reservar una llamada o rellene el siguiente formulario y nos pondremos en contacto con usted cuando hayamos procesado su solicitud.

Nombre

Empresa

Correo electrónico

Teléfono

Mensaje Por favor, facilítenos detalles del proyecto, duración, tecnologías, especialistas informáticos necesarios y otra información relevante.

Grabe un mensaje de voz sobre su proyecto
para ayudarnos a comprenderlo mejor.

Adjunte los documentos adicionales si es necesario

Cargar archivo

Puede adjuntar hasta 1 archivo de 2 MB en total. Archivos válidos: pdf, jpg, jpeg, png

Le informamos de que cuando haga clic en el botón Enviar, Innowise procesará sus datos personales de acuerdo con nuestra Política de privacidad con el fin de proporcionarle la información adecuada.

¿Qué pasa después?

Una vez recibida y procesada su solicitud, nos pondremos en contacto con usted para detallar las necesidades de su proyecto y firmar un acuerdo de confidencialidad que garantice la confidencialidad de la información.

Después de examinar los requisitos, nuestros analistas y desarrolladores elaboran una propuesta de proyecto con el alcance de las obras, el tamaño del equipo, el tiempo y las estimaciones de costos.

Concertamos una reunión con usted para discutir la oferta y llegar a un acuerdo.

Firmamos un contrato y comenzamos a trabajar en su proyecto lo más rápido posible.