I have been a senior engineer with Uber for over 2 years. I have had a history of being part of high velocity teams, and using functional languages to build systems that perform at scale and correctness. Data engineering with functional languages is a field that I did some work on recently. LinkedIn: @anmshkmr
Uber's Sensing and Perception team is the gatekeeper for one of the highest volumes of data ingestion sources at the company. It controls the entry point for motion sensor (gyroscope, accelerometer, and GPS) related data, which is in the order of 8-16 TB per day from all of Uber’s drivers’ phones. A general purpose framework to instantiate data pipelines and derive ML based inferences from motion data for both real-time and batch processing scenarios is presented.