{"id":2496,"date":"2021-11-14T18:22:45","date_gmt":"2021-11-14T18:22:45","guid":{"rendered":"https:\/\/bitsbytesoft.com\/?page_id=2496"},"modified":"2021-11-14T18:22:46","modified_gmt":"2021-11-14T18:22:46","slug":"development-platform-for-geospatial-services-and-big-data","status":"publish","type":"page","link":"https:\/\/bitsbytesoft.com\/development-platform-for-geospatial-services-and-big-data\/","title":{"rendered":"Development Platform for Geospatial Services and Big Data"},"content":{"rendered":"
\"\"

Case study<\/h3>\n\n

Development Platform for Geospatial Services and Big Data<\/h2>\n\n

We\u2019ve built an integrated tool for developing geospatial solutions and exchanging big data that will shape the future of autonomous driving<\/strong><\/p><\/div><\/div>

<\/p>\n\n

<\/p>\n\n

Business challenge<\/h2>\n\n

Our client, the world\u2019s leading innovator in the field of location-based services, is sparking the next generation of geodata-centric solutions and services for autonomous driving. BitsByteSoft became a technology partner in the development of our client\u2019s global infrastructure in 2015, when we were engaged in the ground-up development of a suite of automotive navigation solutions for the premium car segment. To shape the future of smart city, autonomous vehicle, and logistics solutions, our client decided to\u00a0develop a platform\u00a0for creating and sharing geospatial big data products and services powered by a variety of data sources.<\/p>\n\n

As a proven development partner, our team was entrusted to launch the development of an innovative high-definition maps and cloud data platform that would be a one-stop shop for exchanging geospatial big data.<\/p>\n\n

\"\"<\/figure>\n\n
\"\"<\/figure><\/div>\n\n

<\/p>\n\n

<\/p>\n\n

Key features<\/h3>\n\n
\"Develop<\/figure><\/div>\n\n

Develop custom geolocation solutions powered by a variety of data sources<\/span><\/strong><\/p>\n\n

\"Aggregate,<\/figure><\/div>\n\n

Aggregate, process, and analyze large quantities of geospatial data from diverse sources<\/span><\/strong><\/p>\n\n

\"Exchange<\/figure><\/div>\n\n

Exchange large quantities of geospatial data and enrich services using a marketplace solution<\/span><\/strong><\/p>\n\n

Industry:<\/strong> Automotive<\/p>\n\n

Market:<\/strong> Global<\/p>\n\n

Team size:<\/strong> 125 engineers<\/p>\n\n

Cooperation:<\/strong> 2017-present<\/p>\n\n

Technologies:<\/h5>\n\n

Akka HTTP \/ Akka Streams \/ AngularJS \/ AWS \/ Blockchain\/Hyperledger Fabric \/ Cassandra \/ Docker \/ ETL \/ Flink SQL \/ geoJSON \/ Grafana \/ Hadoop \/ Helm \/ Java \/ Kafka \/ Kotlin \/ Kubernetes \/ OAuth 2.0 \/ Redis \/ Scala \/ Spark SQL \/ Splunk<\/p><\/div><\/div>

Solution delivered<\/h2>

So that our client could share access to standardized geospatial big data and services from trusted providers at a global scale, our team of dedicated software development, quality assurance, and DevOps professionals helped implement a bespoke collaborative platform for big data and the development of location-centric solutions as well as a marketplace for simple data exchange.<\/p>

We took on the challenge of transferring our client\u2019s automotive navigation solution into a well-documented SDK and APIs that would allow our client to boost the development of innovative location-centric\u00a0platform services\u00a0across industries. Accompanied by a single marketplace for geospatial data services, this product became a central hub for interactions between automotive service providers and their customers.<\/p>

Source map compilation based on large quantities of geospatial big data<\/h3>

Our engineers handle massive datasets from a variety of sources to compile and update data optimized for rendering map vector tiles. Featuring worldwide coverage, versioning, rich attributes, and consistency, the output is widely used as the main source of geospatial big data by multiple parts of the platform such as the SDK, data libraries, and client portal. For web-based maps, we use a customized format that is effectively tooled for rendering vector data.<\/p>

Development of data-intensive libraries<\/h3>

Within the SDK, we\u2019ve developed and continue to support a set of data processing libraries that allow third-party engineering teams to process rich static and dynamic datasets on cities, traffic, and weather within pipelines.<\/p>

One of our challenges was to optimize the performance and throughput of the AWS-based library by analyzing and deleting unused storage volumes and old snapshots. Our enhancements have not only optimized storage space usage, data administration, and performance but also considerably reduced our client\u2019s AWS costs.<\/p>

Performing operations on large volumes of data<\/h3>

To ensure robust scalability and performance for end customers, we launched a tool that enables third-party engineering and data analysis teams to create custom pipelines for processing large volumes of data, including versioned data like maps and dynamic data received from vehicle sensors. Access to various data types is provided through batch and stream processing tools implemented with the Apache Spark and Apache Flink frameworks respectively.<\/p>

To create more value for data analysts, who are a significant part of our client\u2019s target audience, we complemented the solution with the possibility to run SQL queries, simplifying data analysis and validation.<\/p>

Implementing a hyper-growth hub of geospatial data services<\/h3>

The current version of our client\u2019s solution aims to bring all geospatial services and data on offer into one B2B marketplace. Introduced two years ago, this marketplace is intended to expand opportunities for securely enriching data and transferring it among enterprises across industries. It organizes big data and makes it findable and accessible through cloud-based infrastructure solutions.<\/p>

The marketplace we developed totally transformed the way our client does business online. By demonstrating value for both service providers and their consumers, it reached new businesses that are building the future of an autonomous world.<\/p>

End-to-end testing<\/h3>

In addition to swiftly scaling the development capacity of our client\u2019s team, we took on the challenge of establishing an efficient end-to-end (E2E) testing process that ensures the ongoing delivery of the highest quality mapping products. The goal of our E2E testing team is to understand and reproduce client-centric scenarios rather than only focus on functional testing.<\/p>

Business outcome<\/h2>

In two short years, we\u2019ve grown our partnership with this client by 30% and have delivered a platform that accelerates data-driven innovation. Developed in synergy with BitsByteSoft engineering professionals, who deliver excellence in data processing, storage, geospatial\u00a0big data analytics\u00a0and visualization, our client\u2019s solution not only influences the way end customers can ingest, process, and analyze geospatial data but more importantly enables secure data enrichment and data transfer for enterprises across industries.<\/p>

Partnering with BitsByteSoft has given our client access to technical expertise and the ability to respond to increasing demand by geospatial data services providers and their customers for a single development platform and data marketplace. For the first time, the automotive industry has received a complex automatic platform tool that can be used by third-party developers, data analysts, and data engineers to process, enrich, and share geospatial data.<\/p>

Engineering excellence in the automotive industry and expertise in big data technologies allowed us to reduce the time to market and resulted in our client offering best-of-breed deliverables that have attracted new customers.<\/p>

\"\"

<\/p>\n\n

Let\u2019s work together on your
next project<\/h2>\n\n

Drop us a line about your project at contact@bitsbytesoft.com<\/span><\/a> or via the contact form below with attachments, and we will contact you within a business day.<\/p>\n\n

<\/div>\n\n
\n
\n

<\/p>

    <\/ul><\/div>\n
    \n
    \n\n\n\n\n\n\n\n<\/div>\n