OnSiteVRU Trajectory Prediction

Overview

As road traffic environments become increasingly complex, protectingvulnerable road users (VRUs), who are susceptible to injury or face elevated risk,has become an important topic in traffic-safety research.VRUs generally refer to road users who are more vulnerable in traffic interactions, including non-motorized road users and pedestrians. A deep understanding and accurate prediction of their behavioral patterns are essential to improving traffic safety. In complex road environments, VRUs face many potential risks, such as traffic-rule violations and high-speed movement, which can lead to serious injuries or collisions. Accurately identifying and predicting VRU trajectories, followed by rigorous evaluation, is therefore a core task for road safety.

In recent years, trajectory prediction has become a key research direction for protecting VRUs. Yet the high randomness of their movement patterns, complex interactions, and abrupt changes in motion state create significant challenges. Although many prediction models have been proposed, fragmented datasets, inconsistent evaluation standards, and incomplete scenario coverage still limit technical progress and cross-domain comparison.

To address these issues, this leaderboard provides comprehensive scenario coverage and unified evaluation standards to assess how effectively trajectory prediction methods protect VRUs and reduce the potential risks autonomous-driving technology poses to vulnerable groups.

Leaderboard

ContributorModel / AlgorithmModesScoreminADEminFDEMRw-mAPSubmission Time
Cao Yue, Feng ZhiyuanSingularTrajectory++80.64740.70821.19460.44750.52272025-06-10
Liu Junshan, Huang Xingzhenghivt30.64320.59991.24680.45630.50542025-06-09
Mi Xinyu, Feng DingyiGATFormer80.62791.03261.26830.43490.50742025-06-10
Cao Yue, Feng ZhiyuanSingularTrajectory0.62560.96131.24290.46570.51582025-06-09
Hu Yizhou, Lin JuntingGAT-GRU30.61510.73501.29820.48060.46452025-06-09
tgSTGAT-ResMDN30.57500.76691.46700.53620.41052025-06-12
An Ziyang, Ye YufanSTGAT-ResMDN30.56460.77971.49420.55390.56462025-06-10
Yang Kaixiang, Hu DaiyaoGroupNet++80.56281.16341.53710.50560.41292025-06-10
Bu Chi Yabo_BiGRU30.55970.86431.46380.53100.37002025-06-12
Mi Xinyu, Feng DingyiTransformer+0.54551.22141.53500.54760.40682025-06-09
Cao Yue, Feng ZhiyuanEqMotion0.54721.22031.52450.54570.40922025-06-08
Qi Shaoyan, Yang YuxiMulti-head GAT + BiGRU30.54330.96861.57560.56370.37802025-06-10
Zhang Geyuan, Hu MinyueEqMotion+30.53970.93761.66090.55110.35762025-06-10
7hanyuCSQ30.52120.98631.75220.59020.35332025-06-10
OctBLINKReTrGCN80.51350.89311.68660.62300.33752025-06-11
Zhang GeyuanEqMotion30.51110.99071.77670.59080.32382025-06-11
xuge'nbMATOU0.50990.98791.74150.59010.31472025-06-09
Jiang Zhizhen, Zhu YisongMTG++70.50880.88511.74450.63280.33692025-06-10
Cao Yue, Feng ZhiyuanEqMotion++0.50841.54401.74890.57960.39252025-06-08
Zhu Yisongmixnll70.50770.90981.72550.63240.33472025-06-10
Li JianqiangGroupNet0.50401.27852.47350.56800.40242025-05-23
Jiang Maoxin, Wu TianhaoReSTGCN70.50080.90261.78050.64110.32532025-06-10
Jiang Zhizhen, Zhu YisongMTG+70.49790.90161.77690.63800.31192025-06-10
kadmb1GAT++0.49361.05361.82360.60720.29742025-06-09
Qi Hanyu, He YixuanGD-VRU0.49321.56181.82540.58500.35882025-06-09
Mi Xinyu, Feng DingyiGATU0.49311.44981.74720.61280.35872025-06-09
Zhu YisongNLL++70.48790.91481.80500.64780.29392025-06-10
Jiang Maoxin, Wu TianhaoReTrGCN50.48120.96181.89940.67250.31462025-06-10
Chen Yixuan, Li XiangGATv260.47401.12272.08390.64050.30602025-06-10
Jin MufengTransGCN0.47081.06241.93190.68320.31082025-06-09
skinll30.46960.96512.02510.68420.30202025-06-10
JZMnll30.46960.96512.02510.68420.30202025-06-10
Wang Ziqi, Bo Yupengbi-GRU30.46391.13702.17830.65210.29662025-06-16
Zhoudong YanKMR60.46071.07612.10160.66090.27622025-03-26
JMFLSTM0.45671.03272.07700.68780.27962025-06-09
Tian Kefei, Shi Yuru30.45263.20893.66490.42830.54572025-06-10
maplus7CrewLemon0.45200.97722.02290.67920.24002025-06-09
Mi Xinyu, Feng DingyiGAT++30.45111.41722.32810.61490.28002025-06-09
Zhang Geyuan, Hu MinyueGAT30.45021.00882.04590.68290.24502025-06-08
JZM+nll+30.43981.00792.0750.70080.23222025-06-10
mahunagMMX0.43891.06622.11130.69630.23832025-06-08
Hu Yunyuan, Qiao ZixuanGRU-Transformer30.43051.23782.50710.69100.27762025-06-10
Thomas NickGAT-GRU30.42051.80872.21940.69320.30952025-06-07
Jin MufengTransGCN0.41761.33002.07400.71800.22882025-06-09
MIKETCN0.41531.51862.85300.63790.25902025-06-09
MIKETCN+0.41151.72012.72860.63650.26482025-06-09
Li Yabo, Ma YuchaoMulti-head GAT30.41061.35422.38780.72330.24952025-06-12
Li Yabo, Ma Yuchaosocial-GAT-GRU30.39561.21162.51060.73550.21092025-06-11
Liu Tianyue, Mao YiningST-GAT50.39381.33002.39440.72880.19582025-06-10
skiLSTM0.38841.32982.78920.71840.21142025-06-08
Luo Jingtai, Zhu XuanzhiGAT-GRU30.38091.51382.71030.75530.24502025-06-12
Dong Yuhan, Ma Wei30.37681.40152.54220.76510.20402025-06-10
Zhang Yaokun, Lu Chuangtransformer30.37551.61942.83740.74280.24622025-06-10
Guo Tianzi, Luo YufanGATv250.36771.48752.95210.73180.20012025-06-11
Tian Kefeitransformer10.36651.44502.86100.75580.20292025-06-09
Liu Yufei, Ma RuoxuanGAT-ep30.36641.54712.49760.76600.18922025-06-14
skiMTG0.36511.47322.71580.75170.18262025-06-08
Zhou Ximuran, Zhang RuilinGRU10.36221.44143.05210.74520.19872025-06-12
MIKEGAT10.35931.82592.72470.71470.18612025-06-07
Beihai Nezhatransformer30.35821.65712.97540.74100.20852025-06-10
Zhou Ximuran, Zhang RuilinGAT-transformer10.35571.26492.72220.78570.15152025-06-10
Shi Yuru10.35541.48612.91290.75280.17552025-06-10
Jin Yijue, Xin Xineqmotion30.35531.64503.06180.73100.19632025-06-09
Jin MufengReGNN0.35081.50023.01310.76370.18452025-06-08
Wang Ziqi, Bo YupengGAT-GRU30.34501.63362.97330.75720.17632025-06-15
Zhang Yaokun, Lu Chuangtransformer30.34131.66052.71230.79190.17432025-06-10
Ai Chi YaboGAT-GRU30.34051.65332.99640.76660.17692025-06-09
Zhang HaoyangGAT-GRU30.34041.58522.95610.78000.17392025-06-12
yang36110.34041.58522.95610.78000.17392025-06-09
Guo Tianzi, Luo YufanTransformer-GCN0.33911.75343.15490.75280.19252025-06-10
Wang Shaohong, Wang HuaiyuTransformer30.33791.65792.83480.78200.16632025-06-14
Wang Siwei, Ge YumingGAT-GRU10.33501.33522.81210.81670.13482025-06-14
Han Boyangsocialgan30.32851.67763.08000.76110.14452025-06-14
Zhao Zeyu, Qu HongzeIA-GRU30.32781.71533.06080.77320.15852025-06-10
Xuekai Liu GAT-GRU30.32391.48792.97870.81270.13792025-03-21
Yang Lifeng, Zhang HaotingQCnet60.32132.06122.51190.82420.18462025-06-13
Qi Shaoyan, Yang Yuxi30.31881.80312.64870.82380.14792025-06-10
Zheng Zhichong, Wu XiuzeGNN-GRU30.31601.71923.41400.80300.18902025-06-11
Spicy Hot Pot, RookieST-GRU0.31451.72233.14420.82050.17192025-06-09
An Ziyang, Ye YufanLSTM30.31211.97982.79150.79540.14242025-06-10
AAAtransformer10.30861.66823.25850.79050.12602025-06-08
whitetransformer0.30801.94043.09540.78180.14242025-06-08
Li JianqiangConstant-Speed Inference10.29231.61293.40030.86300.15072025-05-23
Yang JieGNN-GRU30.28462.08252.86940.83940.12082025-06-10
Spicy Hot Pot, jptransformer30.28421.98863.64620.81770.16832025-06-10
Xia Nan, Zhang ShengqiTransformer-GAT40.26932.11483.23550.84010.11642025-06-10
Tianyi's Little RookieST-GRU30.26172.04293.49970.83150.09992025-06-09
2250441transformer-gnn0.25651.95823.49560.85300.08932025-06-09
Zhang Haoyang, Ji Yuhangvru_optimized0.23352.44563.54970.87530.12222025-06-10
Zhang ShengqiMT-GAT30.22562.41913.63550.87600.10172025-06-12
Zhang Yaokun, Lu Chuangtransformer0.22482.22603.81480.88380.09462025-06-10
skicross0.21862.35023.91500.86050.08252025-06-08
Xia YeyangGAT-GRU50.21732.46584.04370.83330.08472025-06-12
Zhang Yaokunsyalice0.20602.62353.76530.89570.10462025-06-10
Ye Yunjie, Ma YingfengGAT-GRU30.20562.63044.15410.84960.10172025-06-09
Zheng Zhichong, Wu XiuzeGAT-GRU30.20302.61873.91200.86960.08392025-06-10
hauvGAT-GRU30.18242.69494.18820.89440.08362025-06-07
skimainGG0.17992.55474.53500.87690.07282025-06-07
xsfGAT30.17512.90444.55530.85060.09102025-06-07
Qian ChenKalmanFilter10.16252.94304.57260.85760.06472025-03-26
Li Minxingtrans30.16004.18545.26860.73150.21422025-06-11
Zhang ShengqiGAT-Transformer40.14032.90055.10840.87910.06442025-06-11
xsfG-T30.13483.18704.19630.88100.07442025-06-08
Lin Chengyu, Ji Xiaoyutransformer+80.13334.75785.83200.70750.25942025-06-11
Ye Yunjie, Ma YingfengGAT-GRU30.11773.5285.2660.86970.10192025-06-10
frankerGATv230.10643.33305.47310.89870.08362025-06-09
Lin ChengyuTransformer80.10564.90385.92440.72680.22102025-06-12
Wang Ziqi, Bo Yupenghivt80.09804.74986.06600.76130.22022025-06-12
hhhuGAT-GRU20.09783.26865.39430.90800.04492025-06-10
JudeHeart0.09593.26465.89040.87320.05812025-06-08
Mi Xinyu, Feng DingyiGAT30.07973.50595.76100.89250.04932025-06-07
lcyTransformer80.07954.97785.89170.77540.19142025-06-12
Lin Chengyu, Ji XiaoyuTransformer30.07164.94556.09470.78790.19472025-06-11
Liu Yufei, Ma RuoxuanGAT-ep30.03464.39715.38840.92730.04092025-06-13
Wang Fengde, Chen Feiyutransformer30.03295.84726.83380.70350.21362025-06-16
Xiao PengyuGNN-GRU30.03255.32946.46100.77140.15232025-06-13
Li Minxing, Chen SiqiGAT+30.03185.48806.66130.75720.18482025-06-10
Wang Fengdetransformer30.03095.91277.02370.69660.23202025-06-13
hauvGAT30.02174.49705.47480.94000.03672025-06-07
Shuangqi, Huang ShitingGAT-GRU30.01184.71464.91980.97690.01522025-06-13
Lin Chengyu, Ji XiaoyuGAT-GRU3-0.01745.75216.90680.82130.15602025-06-12
Wang Siwei, Ge YumingTransform1-0.02925.92727.36060.79740.17242025-06-13
hzhmrGAT-GRU3-0.05066.06637.20020.85450.16352025-06-07
Wang Yingzhidian3-0.05875.95877.49510.83020.12722025/6/15
long yaoGP_GRU3-0.05908.76558.86380.52640.44222025-06-09
Huang Zhihui, Ming RuiGAT-GRU3-0.08126.18717.45780.84640.10232025-06-11
Cao JiayuGAT-GRU3-0.00984.24136.96250.93030.04492025-06-14
chenxiangtransformer3-0.11785.35937.83490.97050.00832025-06-08
Wang Siwei, Ge Yumingtransformer3-0.34169.754810.79050.81810.17092025-06-11
Shuangqi, Huang ShitingGAT-GRU3-0.34408.271910.11060.98570.00772025-06-12
Wang Ziqi, Bo Yupengtransformer3-0.36129.754810.79050.81810.10552025-06-11
Ding ZifengA-GATTP4-0.37228.99629.90570.98250.00842025-07-14
lulalaTransformer-GAT-0.39598.817911.33120.94340.01922025-06-08
Luo Jingtai, Zhu Xuanzhilstm3-0.40929.450010.38250.97950.01082025-06-11
LaiHuangDeepCDNan-0.42289.377611.01650.9791:0.02352025-06-09
Han Boyangsocialgan3-0.42877.913513.08720.99130.00192025-06-12
Yang Lifeng, Zhang HaotingQC+6-0.472311.357611.67960.86220.14522025-06-12
Yang Lifeng, Zhang Haotinglstm+transformer6-0.498110.508811.57450.97450.01832025-06-12
Zhu Chenshengtransformer3-0.60499.458616.11500.98770.00512025-06-12
Shuangqi, Huang ShitingGAT-GRU3-0.613211.739912.85120.99450.00162025-06-14
Shuangqi, Huang ShitingGAT-GRU3-0.616212.004012.50600.99800.00102025-06-15
sqGAT-GRU3-0.616212.004012.50600.99800.00102025-06-12
freeGNN-GRU3-0.655411.430914.86440.97410.01292025-06-08
abdgru-GRN1-1.211022.574414.65410.98650.00712025-06-08
Zhang Geyuan, Hu Minyuebaseline3-1.706125.625025.00280.98250.01132025-06-07
zzzzzssbl1-1.856019.762438.27120.99300.01922025-06-07
TractorEQmotionplus5-1.940527.754528.68170.99160.00252025-06-11
Ma Ruoxuan, Liu YufeiEQmotion++5-1.905027.340828.26440.98950.00332025-06-13
Jiang ZhongyangGAT3-2.654032.425742.99680.99870.00042025-06-14
Jin MufengSeq2Seq1-2.700136.471838.43460.99260.00802025-06-06
Li Minxing, Chen SiqiGAT3-2.954243.092436.02160.99740.00102025-06-12
X-teamGAT-GRU3-3.086242.434840.97110.99690.00102025-06-08
PhillipsGAT-GRU3-3.111142.805141.17310.99560.00082025-06-08
Ma RuoxuanGAT-GRU5-3.117442.254442.25520.99400.00682025-06-12
Gu Qiyu, Feng YixiaoCVAE10-3.317644.329845.09550.99660.00342025-06-12
Zhou Yang, Liu Peijiantransformer-0009053-3.318644.257445.22870.99800.00432025-06-15
Yang Siyao, Lu HaitianGAT-GRU5-3.344244.619145.41570.99820.00032025-06-11
Xiao ShijieGAT-GRU5-3.381045.160445.71490.99820.00122025-06-11
Zhou ZiyeGAT-GRU3-3.428245.739746.26720.99830.00162025-06-12
xsjGAT-GRU8-3.428245.739746.26720.99830.00162025-06-13
Xiao Shijie, Huang HezheGAT-GRU8-3.428245.739746.26720.99830.00162025-06-12
ayscene transformer3-3.581451.497442.23430.99800.00242025-06-09
TractorADATP3-4.178754.149156.14910.99920.00042025-06-11
Xiao Shijie, Huang HezheGAT-GRU5-4.413450.946568.01450.99780.00152025-06-12
Ma RuoxuanADATP1004-4.899764.028662.98260.99700.00082025-06-11
Xie Pei, Mao MengyueVRU_traj3-8.137595.3509113.10270.99990.00022025-06-12

How to Participate

Dataset Introduction

This trajectory prediction leaderboard uses two datasets: OnSiteVRU and SIND.

The OnSiteVRU dataset contains multiple intersection and road-section scenarios covering different types of traffic participants. Its intersections include Xianxia Road–Jianhe Road, Ningwu Road–Longchang Road, Moyu Road–Changji East Road, and Hejian Road–Ningwu Road. Data from each intersection include trajectories of motor vehicles, electric bicycles, and human-powered bicycles, totaling approximately 17,429 trajectories. The road-section portion includes Caoyang Road and Anyuan Road: Caoyang Road is a lane-marking-separated section with 50 minutes of data and 1,256 records, while Anyuan Road is an unseparated two-way, two-lane section with 1 hour and 40 minutes of data. The urban-village dataset was collected in Jiading District, Shanghai, and Pingjiang District, Suzhou. For more dataset information, please visitOnSite_VRU_Data. For details of the SIND dataset, refer to reference [1].

[1] Xu Y, Shao W, Li J, et al. SIND: A drone dataset at signalized intersection in China[C]//2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC). IEEE, 2022: 2471-2478.

The data-processing stage ensures trajectory-data quality and validity by cleaning and segmenting raw data, providing reliable support for subsequent model training and evaluation.

(1) Scenario segmentation:A sliding-window method is used to segment trajectory data over time. Fixed time steps enable fine-grained segmentation of each scenario. Each scenario spans 4.8 seconds, effectively capturing short-term behavioral changes between VRUs and the ego vehicle and more accurately representing their interactions.

(2) Spatial threshold:To ensure sufficient interaction information in each scenario, a spatial threshold of 5 meters is used. When the distance between two vehicles, or between a vehicle and a VRU, is below this threshold, they are considered to be in the same interaction scenario. This strategy captures potential interactions and avoids missing key events.

(3) Multi-participant interaction:Each interaction scenario consists of multiple participants (vehicles and VRUs). To prevent too many vehicles from affecting data quality, each scenario is limited to at most five vehicles, keeping complexity manageable while preserving diversity and representativeness.

(4) Filtering strategy:To ensure the validity and representativeness of selected scenarios, the dataset filters out extreme cases such as stationary scenes and scenes with excessively high curvature, whose trajectories could adversely affect model training and evaluation.

The data include 53,703 training samples and 3,516 test scenarios. Each scenario has four observation steps and six prediction steps, for a total of 10 steps, at a time interval of 0.48 seconds. The dataset is randomly split according to an 80% training and 20% test principle to ensure diversity and breadth. In addition, contestants who need an extra validation set for model tuning may split part of the training set themselves to meet individual needs.

The dataset contains the training set (train_data_x.npy), training labels (train_data_y.npy), and test set (test_data_x.npy), stored in .npy format. The data format is a four-dimensional matrix with dimensions [scenario ID, time step, individual ID, feature value]. Each feature value consists of 10 columns, as follows:

  • ‘world_x’: x-axis position in the global coordinate system
  • ‘world_y’: y-axis position in the global coordinate system
  • ‘speed_x’: speed in the x-axis direction
  • ‘speed_y’: speed in the y-axis direction
  • ‘acc_x’: acceleration in the x-axis direction
  • ‘acc_y’: acceleration in the y-axis direction
  • ‘Jerk_x’: rate of change of acceleration in the x-axis direction (jerk)
  • ‘Jerk_y’: rate of change of acceleration in the y-axis direction (jerk)
  • ‘Angle’: object's heading angle
  • ‘vehicle_type’: vehicle type, where “Car” is labeled 1, “Motorcycle” is labeled 2, and “Bicycle” is labeled 3. If the vehicle type is not one of these three, it is assigned the default value -1.

To ensure a uniform data format, positions corresponding to missing vehicles in a scenario have been filled with 0, and some missing motion parameters are recorded as NAN. This data-structure design enables each trajectory sample to be processed consistently in temporal and spatial dimensions and ensures the temporal integrity of trajectories for all participants, including the ego vehicle and non-motor vehicles.

Submit Results

Contestants must submit a prediction-result file and a confidence file, both in .npy format, named test_data_y_{name}_{number_of_modes}.npy and conf_{name}_{number_of_modes}.npy, respectively.

The prediction data are in a five-dimensional matrix with the following dimensions:scenario ID,number of modes,individual ID, time step, feature value. Each feature value includes:

  • ‘world_x’: vehicle x-axis position in the global coordinate system
  • ‘world_y’: vehicle y-axis position in the global coordinate system

This data structure ensures that the predicted positions of all vehicles at different time steps in each scenario can be accurately recorded, while supporting evaluation of multimodal prediction. To ensure rigor, the number of modes is set to a maximum of 10.

The confidence data are in a three-dimensional matrix with the following dimensions:scenario ID,number of modes,individual ID, used to represent the predicted probability of a trajectory. The confidence of each mode is between 0 and 1; there is no requirement for confidence values to sum across modes, and they may be different or identical.

Results are collected through a form. Participants can clickhere to access the form, complete the form to submit results, and receive analysis and statistics within no more than seven working days, after which the leaderboard will be updated.

Evaluation metrics

Given the sparse nature of the data, evaluation uses ground truth as the basis to select, in each scenario, individuals with complete time steps.

To calculate a model's overall score, this competition combines several evaluation metrics (minADE, minFDE, MissRate, and mAP) and evaluates them uniformly by weighted addition. The specific method is as follows:All metrics are normalized.

\(Score = 0.2*S_{\text{minADE}}+0.2*S_{\text{minFDE}}+0.3*S_{\text{MR}}+0.3*S_{\text{w-mAP}}\)

Definition: From the multiple predicted trajectories generated by the model, select the trajectory with the smallest average distance from the ground-truth trajectory across time steps, and calculate the mean positional error over all its time steps.

Formula

\(\text{min ADE} = \min_{k \in \{1, \ldots, K\}} \left( \frac{1}{T} \sum_{t=1}^{T} \sqrt{(x_{k,t} – x_{gt,t})^2 + (y_{k,t} – y_{gt,t})^2} \right)\)

K: the number of candidate trajectories generated by the model.

T: the total number of prediction time steps.

\((x_{k,t}, y_{k,t})\): the k trajectory at time step t predicted coordinates.

\((x_{gt,t}, y_{gt,t})\): the ground-truth trajectory at time step t coordinates.

Definition: From all predicted trajectories, select the one whose endpoint is closest to the ground-truth trajectory's endpoint, and calculate the Euclidean distance error at its endpoint.

Formula

\(\text{min FDE} = \min_{k \in \{1, \ldots, K\}} \sqrt{(x_{k,T} – x_{gt,T})^2 + (y_{k,T} – y_{gt,T})^2}\) T: the time step of the predicted endpoint.

Definition: under a given decision threshold, the proportion of prediction instances in which no trajectory satisfies the endpoint-threshold requirement (threshold = 1 m).

Definition: mAP (mean Average Precision) is a commonly used evaluation metric, widely applied in tasks such as object detection, image retrieval, and trajectory prediction to measure prediction accuracy. To more reasonably assess a model's overall performance at different matching thresholds, we propose w-mAP to emphasize the importance of different thresholds.

Calculation Method

① Confidence ranking and match-result statistics: At each threshold τ, we first rank all predictions from highest to lowest confidence and calculate their matching status. The steps are as follows:

    1. Set multiple matching thresholds τ∈Τ. For each τ, calculate the minimum final displacement error (minFDE) of every predicted trajectory.
    2. If minFDE satisfies minFDE≤τ, the prediction is treated as a successful match (True Positive, TP); otherwise, it is treated as a failed match (False Positive, FP).
    3. Record the maximum confidence for each prediction and use it for ranking.

② Calculate cumulative precision and recall: At each matching threshold τ:

    1. Sort in descending order by prediction confidence.
    2. Calculate cumulative true positives (cumulative TP) and cumulative false positives (cumulative FP).
    3. Calculate precision and recall.

③ Calculate AP at each threshold: using cumulative true positives, calculate the average precision (AP) at that threshold with the 11-point interpolation method.

④ Weighted calculation of w-mAP: Traditional mAP assigns the same weight to every matching threshold, whereas weighted mean average precision (w-mAP) introduces a set of weight parameters ω(τ) and defines w-mAP as follows:

\(w – \text{mAP} = \sum_{\tau \in T} w(\tau) \cdot \text{AP}(\tau) \)

Here, the weights ω(τ) satisfy the normalization condition. In this evaluation, the thresholds are [1, 2, 3], with corresponding weights [0.6, 0.3, 0.1]. Notably, given the highly stochastic nature of VRU behavior, this evaluation does not calculate results separately by trajectory type; it uses a unified endpoint-error threshold.

Conclusion and Outlook

This trajectory prediction leaderboard aims to provide a unified evaluation platform for researchers of trajectory prediction models in motor vehicle–non-motor vehicle interaction scenarios. Its release enables a deeper understanding of how current models perform in the same task scenarios and promotes continued development of related research. The current version still has limitations, such as insufficient scenario diversity, a lack of label information, an incomplete evaluation system, and a single testing approach. Future versions will continually improve the datasets, evaluation system, and test methods to provide researchers with more comprehensive and accurate evaluation tools and further promote innovation and development in autonomous-driving VRU behavior modeling and prediction.