Revamping the Data Platform for MILES: Enabling Advanced Machine Learning and Experiments
Our team together with the data team of MILES Mobility embarked on an ambitious project to modernize their data platform. This endeavor aimed to empower even more people with data-intensive machine learning solutions, propelling the company into a new era of sustainable mobility while offering an unparalleled service to their users.
Data Max helped MILES reengineer and scale the existing data infrastructure and workflows to cover more data-intensive applications and be ready for future challenges.
​
Technologies: AWS, EKS, Airflow, Kubernetes, Cluster Autoscaler, Snowflake, dbt
Challenge
Being in the market leader position for shared mobility led to the rapid accumulation of vast amounts of data in the MILES platform. As the company evolved, it faced the challenge of managing and extracting valuable insights from this ever-expanding data ecosystem. The existing data infrastructure struggled to keep pace with the growing demands, hindering the development of innovative data-driven solutions and potentially compromising the overall customer experience.
Solution
Recognizing the crucial role of a robust data platform in shaping the future of sustainable mobility, the MILES team collaborated with our team to embark on a transformative journey. Our mission was to re-engineer and scale their data infrastructure and workflows, ensuring they could accommodate more data-intensive applications while staying resilient to future challenges.
We introduced a combination of Kubernetes, Cluster Autoscaler, and Airflow, to enable the users of the data platform to allocate resources based on their needs and to deploy their use cases.
​
Furthermore, to increase autonomy inside the data team, we developed a new deployment process that would allow every engineer to deploy their solutions without being affected by the other cases that are running on the platform.
Result
The modernization of the data platform fundamentally improved the amount of provided services and the speed at which these services are provided to the users. The project's user-oriented approach culminated in the following remarkable outcomes:
-
Expanded Services: The revamped data infrastructure enabled the provider to launch a myriad of new data-intensive machine learning use cases. From dynamic pricing models to predictive maintenance for vehicles, the company diversified its offerings, delighting users with cutting-edge solutions.
-
Improved Operational Efficiency: By streamlining data workflows and optimizing infrastructure, MILES experienced improved operational efficiency and cost-effectiveness, further empowering their growth in the market.
-
Future-Readiness: The new data platform's scalability and adaptability ensured that MILES remaines poised to tackle future challenges, staying ahead in the ever-evolving mobility landscape.
Fahd Lemheider, Head of Data
My team and I have enjoyed collaborating with Data Max on a project aimed at overhauling our data infrastructure at MILES Mobility. Their technical expertise facilitated the seamless integration and optimization of our data-intensive applications.
We found the Data Max team to be dependable, demonstrating professionalism and dedication to meeting our project requirements. Their work quality and attention to detail stood out impressively. They actively provided detailed presentations and offered extended support to ensure a smooth transition of the project to our team, which was greatly appreciated. I am pleased to recommend working with Data Max.