Introduction

This project is a groundbreaking application designed to solve the challenges of field data collection in the environmental sector. Previously, specialized teams such as those focusing on Contaminated Land, Ecology, and Hydrogeology were using fragmented and inconsistent methods.

The project’s goal was to build a single, centralized application that integrates all survey forms for each sub-field. This approach completely eliminates manual data entry, saving time and ensuring that data is collected consistently and efficiently.

Team size

7 members

Industry

Environmental

Technology

Python, AWS, PostgreSQL, AWS Cognito, Azure AD, AWS Amplify & IAM

Highlights

 Value Delivered

  • Increased Workflow Efficiency: By eliminating manual steps, the data collection process became faster and more efficient.
  • Accurate and Reliable Data: The integrated QA/QC process minimizes errors, ensuring high data quality.
  • Centralized Data Management: All data is stored in one location, making it easy for teams to collaborate and make informed decisions.

Challenges

  • Inconsistent Processes: Each specialized team used different methods, leading to unsynchronized and difficult-to-manage data.
  • Time-Consuming and Prone to Errors: Manual data entry, scanning notes, and uploading photos were time-intensive and highly susceptible to errors.
  • Scattered Data: Information was not stored centrally, making it difficult for teams to access and share.
  • Lack of Integrated Quality Control: Data validation and error correction were performed manually after collection, which slowed down the entire workflow.

Solutions

  • Multi-Platform Mobile Application: We built an application compatible with various devices, including tablets (iPad, Android) and mobile phones, allowing field staff to work anytime, anywhere.
  • Automated Data Collection Workflow: The solution completely eliminates manual transcription. All data, including photos, is entered directly into the app.
  • Centralized Data Hub: All data is stored in a single data hub using PostgreSQL on AWS Aurora, providing easy access and management for everyone in the environmental division.
  • Integrated QA/QC Processes: We built in quality assurance and quality control (QA/QC) processes directly into the application. This reduces data errors from the start and minimizes manual review work.
  • Serverless Architecture on AWS: The system uses a Serverless architecture (AWS Lambda) combined with other AWS services like S3, API Gateway, SQS, and CloudWatch Events. This ensures the system is efficient, cost-effective, and easily scalable.