Since its establishment, Nuro’s perception system has extensively utilized artificial intelligence (AI). Initially, we focused on deploying multiple small models, each dedicated to a specific task and using a sensor set or a combination of sensor sets. However, it became apparent that the computation of extracting features from identical sensors could be shared, and the rich feature learned by multiple downstream tasks can potentially help to achieve the performance ceiling of each individual task, especially when some tasks have limited labels.