Compliance & Data Pipeline
Case Study
We partnered with a U.S. based renewable energy company to improve their Apprenticeship Program. We developed tools to track work hours, ensure fair compensation, and meet complex compliance requirements. The solution improved data management, streamlined operations, and supported better decision-making across the organization.
CLIENT OVERVIEW
U.S. Based Renewable Energy Company
A U.S.-based renewable energy company specializing in the maintenance, re-powering, and operation of wind farms. The client aimed to improve the overall experience for apprentices and stakeholders by developing a suite of applications and algorithms to monitor and execute processes, visualize data, and streamline operations related to work hour classification and compliance.
THE CHALLENGE
Tackling Wage Fairness and Complex Compliance
The client faced multiple challenges in tracking and managing apprenticeship hours while ensuring fair compensation.
The main objectives included:
- Developing a comprehensive data suite while understanding complex compliance logic.
- Aligning all stakeholders to define the
Apprenticeship Program and its requirements. - Accurately differentiating and classifying Apprentices, Journey Workers, and Other Workers.
- Implementing a fair method for daily apprentice selection to avoid wage reduction biases.
- Providing a dashboard to monitor program
compliance and flag projects below compliance limits.
- Incorporating Prevailing Wage calculations to comply with state regulations regarding regular time, overtime, and double time.
Additionally, the project required a serverless architecture to minimize costs and a no-code/low-code solution to avoid expensive frontend development.
OUR STRATEGY
Agile delivery for evolving program needs
Since the client had evolving requirements and limited business rule definitions, our team followed an iterative approach, continuously refining the solution. A key challenge was adapting to scope changes, limited feedback,
and the client’s lack of prior technical knowledge.
How we did it:
Team Alignment and Planning:
Established regular check-ins and meetings to ensure alignment with priorities.
Maintained clear communication channels for efficient collaboration.
Data Model Development:
Designed a flexible data model to accommodate future modifications and additional entities.
Utilized DBT Cloud to transform raw data into a structured model.
Data Pipeline Implementation:
Leveraged Azure Data Factory to orchestrate data movement and processing.
Created a pipeline to transfer data into a PostgreSQL database, execute DBT transformations, and trigger Python analysis scripts hosted on Azure.
Azure Function App Development:
Implemented business logic through scheduled Azure Functions, ensuring daily processing of compliance data without maintaining a live server, reducing costs.
Results Visualization:
Developed a Power BI dashboard to provide stakeholders with clear insights into compliance and project status.
Enabled data interaction through PowerApps, eliminating the need for a custom frontend.
BENEFITS
Clearer data, Better decisions, Bigger scope
- Made previously unmapped data visible, allowing precise classification of work hours based on worker type, expertise, and job site.
- Facilitated internal discussions, leading the client to uncover gaps in their understanding of their own processes.
- Demonstrated the team’s capabilities, leading the client to extend the project scope beyond
Apprenticeship Program tracking to Prevailing Wage calculations and system integrations, where other vendors had failed.
Key Learnings
- Managing highly dynamic requirements with minimal business rule definitions.
- Adapting to limited feedback and stakeholder involvement.
- Gaining expertise in Microsoft Azure technologies, including Data Factory, Function Apps, Power BI, and PowerApps.
Through this project, we successfully delivered a scalable, cost-effective solution that not only met the client’s needs but also paved the way for broader digital transformation within their organization.
BUILD WITH
If you are looking for a Tech Partner to help your startup reach the next level, contact us below, and let’s get started!
Compliance & Data Pipeline
Case Study
We partnered with a U.S. based renewable energy company to improve their Apprenticeship Program. We developed tools to track work hours, ensure fair compensation, and meet complex compliance requirements. The solution improved data management, streamlined operations, and supported better decision-making across the organization.
CLIENT OVERVIEW
U.S. Based
Renewable Energy Company
A U.S.-based renewable energy company specializing in the maintenance, re-powering, and operation of wind farms. The client aimed to improve the overall experience for apprentices and stakeholders by developing a suite of applications and algorithms to monitor and execute processes, visualize data, and streamline operations related to work hour classification and compliance.
THE CHALLENGE
Tackling Wage
Fairness and Complex Compliance
The client faced multiple challenges in tracking and managing apprenticeship hours while ensuring fair compensation. The main objectives included:
- Developing a comprehensive data suite while understanding complex compliance logic.
- Aligning all stakeholders to define the Apprenticeship Program and its requirements.
- Accurately differentiating and classifying Apprentices, Journey Workers, and Other Workers.
- Implementing a fair method for daily apprentice selection to avoid wage reduction biases.
- Providing a dashboard to monitor program compliance and flag projects below compliance limits.
- Incorporating Prevailing Wage calculations to comply with state regulations regarding regular time, overtime, and double time.
OUR STRATEGY
Agile delivery for evolving program
needs
Since the client had evolving requirements and limited business rule definitions, our team followed an iterative approach, continuously refining the solution. A key challenge was adapting to scope changes, limited feedback,
and the client’s lack of prior technical knowledge.
How we did it:
- Team Alignment and Planning:
Established regular check-ins and meetings to ensure alignment with priorities. Maintained clear communication channels for efficient collaboration. - Data Model Development:
Designed a flexible data model to accommodate future modifications and additional entities. Utilized DBT Cloud to transform raw data into a structured model. - Data Pipeline Implementation:
Leveraged Azure Data Factory to orchestrate data movement and processing. Created a pipeline to transfer data into a PostgreSQL database, execute DBT transformations, and trigger Python analysis scripts hosted on Azure. - Azure Function App Development:
Implemented business logic through scheduled Azure Functions, ensuring daily processing of compliance data without maintaining a live server, reducing costs. - Results Visualization:
Developed a Power BI dashboard to provide stakeholders with clear insights into compliance and project status. Enabled data interaction through PowerApps, eliminating the need for a custom frontend.
BENEFITS
Clearer data, Better decisions, Bigger scope
- Made previously unmapped data visible, allowing precise classification of work hours based on worker type, expertise, and job site.
- Facilitated internal discussions, leading the client to uncover gaps in their understanding of their own processes.
- Demonstrated the team’s capabilities, leading the client to extend the project scope beyond Apprenticeship Program tracking to Prevailing Wage calculations and system integrations, where other vendors had failed.
IMPACT
Key Learnings
- Managing highly dynamic requirements with minimal business rule definitions.
- Adapting to limited feedback and stakeholder involvement.
- Gaining expertise in Microsoft Azure technologies, including Data Factory, Function Apps, Power BI, and PowerApps.
Through this project, we successfully delivered a scalable, cost-effective solution that not only met the client’s needs but also paved the way for broader digital transformation within their organization.
BUILD WITH
If you are looking for a Tech Partner to help your startup reach the next level, contact us below, and let’s get started!