Asia
f4f2f2b3c67da711df6df557fc870c4a-Paper-Conference.pdf
We find that the inconsistency between training and inference of BN is the leading cause that results in the failure of BN in NLP. We define Training Inference Discrepancy (TID) to quantitatively measure this inconsistencyand reveal that TID can indicate BN'sperformance, supported by extensiveexperiments,includingimageclassification,neuralmachinetranslation, language modeling, sequence labeling, andtextclassification tasks.
Legendre Decomposition for Tensors
Mahito Sugiyama, Hiroyuki Nakahara, Koji Tsuda
CP decomposition compresses an input tensor into a sum of rank-one components, and Tucker decomposition approximates an input tensor by a core tensor multiplied by matrices. To date, matrix and tensor decomposition has been extensively analyzed, and there are a number of variations of such decomposition (Kolda and Bader, 2009), where the common goal is to approximate a given tensor by a smaller number of components, or parameters,inanefficientmanner. However, despite the recent advances of decomposition techniques, a learning theory that can systematically define decomposition for any order tensors including vectors and matrices is still under development. Moreover, it is well known that CP and Tucker tensor decomposition include non-convex optimization and that the global convergence is not guaranteed.
Supplementary Materials Online Map Vectorization for Autonomous Driving: A Rasterization Perspective
The base model takes surround-view images of the ego-vehicle as input. As shown in Figure 1, we provide further visual comparisons of HD map vectorization results. The results reaffirm the necessity of a rasterization perspective in map vectorization. Figure 1 presents more visualization of MapVR's HD map construction results. As discussed in Section 3, the Chamfer-distance-based metric struggles to offer a fair evaluation for such scenarios.